Commit graph

1400 commits

Author SHA1 Message Date
Boris Arzentar
dd423ebc3d Merge remote-tracking branch 'origin/main' 2024-12-03 21:58:19 +01:00
Vasilije
1709e926e2
Code graph pipeline (#20) 2024-12-03 21:52:55 +01:00
Boris Arzentar
0b8b270933 fix: make get_embeddable_data static 2024-12-03 21:47:23 +01:00
Boris Arzentar
b89a4b8054 Merge remote-tracking branch 'origin/main' into code-graph 2024-12-03 21:14:19 +01:00
Boris Arzentar
27416afed0 fix: lancedb batch merge 2024-12-03 21:13:50 +01:00
alekszievr
706101113a
feat/add correctness score calculation with LLM as a judge (#30) 2024-12-03 17:47:18 +01:00
Rita Aleksziev
a0d5102bd8 add some spaces for readability 2024-12-03 17:22:23 +01:00
Rita Aleksziev
b98470887e fix env var issue 2024-12-03 16:46:13 +01:00
Rita Aleksziev
0fbb50960b prompt renaming 2024-12-03 15:59:03 +01:00
Boris Arzentar
e07364fc25 Merge remote-tracking branch 'origin/main' into code-graph 2024-12-03 12:44:57 +01:00
Boris Arzentar
70b1babdc5 Merge remote-tracking branch 'origin/main' 2024-12-03 12:16:59 +01:00
Rita Aleksziev
dc082de4c2 minor bugfix in folder creation 2024-12-02 14:54:40 +01:00
Igor Ilic
dd8af12aa9
Cog 502 backend error handling (#32)
Rework of the cognee lib exception/error handling.

Added custom exceptions and custom exception handling.

Whenever a custom exception is raised in the cognee fastapi backend it
will be processed by the exception handler making sure exception
information is logged and proper JSONResponse is sent. No need to catch
these exception in endpoints with the goal of logging and responding.

Note: The exception handler is only used for the cognee FastAPI backend
server, using cognee as a library won't utilize this exception handling
2024-12-02 13:47:38 +01:00
Rita Aleksziev
0eb40d0761 updating dependencies with deepeval as optional 2024-12-02 13:31:39 +01:00
Igor Ilic
343ac47fd4 fix: Update import location for LanceDB
Updated import path for LanceDB exceptions

Fix COG-502
2024-12-02 13:19:55 +01:00
Igor Ilic
04960eeb4e Merge branch 'main' of github.com:topoteretes/cognee-private into COG-502-backend-error-handling 2024-12-02 13:12:20 +01:00
Igor Ilic
34971d16cc
Cog 678 relational database singleton (#38)
1. Set relational database in cognee to be used as singleton and made
necessary changes to enable this
2. Added SQLite support to dlt pipeline in ingest_data
2024-12-02 13:02:34 +01:00
Rita Aleksziev
f966f099fc Prompt renaming to more specific names. Minor code changes. 2024-12-02 12:18:00 +01:00
Boris Arzentar
76e2b6a639 Merge remote-tracking branch 'origin/main' 2024-12-02 10:15:30 +01:00
Boris Arzentar
11acabdb6a fix: remove duplicate nodes and edges before saving; Fix FalkorDB vector index; 2024-12-02 10:10:18 +01:00
Boris Arzentar
925346986e Merge remote-tracking branch 'origin/code-graph' 2024-12-01 11:52:03 +01:00
Boris Arzentar
d6f0d65b63 Merge remote-tracking branch 'origin/code-graph' 2024-12-01 11:51:54 +01:00
hajdul88
198f71b9be
feat: Implements multiprocessing for get_repo_file_dependencies task (#43) 2024-12-01 11:51:04 +01:00
Boris Arzentar
e8a1ce531a Merge remote-tracking branch 'origin/main' 2024-12-01 11:44:07 +01:00
Vasilije
bbaf78f54e
Cog 669 implement dummy llm adapter (#37)
Adds the `class DummyLLMAdapter(LLMInterface)` class for profiling of
large datasets without actual LLM calls in the top level
`profiling/util` location.

I also move the `show_prompt` implementation from the child classes to
`LLMInterface`, since the implementations were identical.

I expanded the scope to also include a DummyEmbeddingEngine.
2024-11-30 17:02:49 +01:00
Vasilije
4d02560f1c
Cog 519 develop metadata storage integration (#35)
@borisarzentar this PR is ready, the all checks run through in the
"sister" MR targeting main:
https://github.com/topoteretes/cognee-private/pull/26
2024-11-30 17:02:18 +01:00
Vasilije
d855e2ee88
Update README.md 2024-11-30 16:36:34 +01:00
Vasilije
0da0cd761b
Update README.md 2024-11-30 16:35:04 +01:00
Igor Ilic
6b97e95e14 refactor: Split entity related exceptions into graph and database exceptions
Move and split database entity related exceptions into graph and database exceptions

Refactor COG-502
2024-11-29 17:40:48 +01:00
Igor Ilic
eb09e5ad89 refactor: Moved ingestion exceptions to ingestion module
Moved custom ingestion exceptions to ingestion module

Refactor COG-502
2024-11-29 17:15:54 +01:00
Igor Ilic
1b2bdd9b83 refactor: Update __init__.py of base exception module
Updated init file of cognee base exception module

Refactor COG-502
2024-11-29 17:07:27 +01:00
Igor Ilic
df0b4b4820 refactor: Move user and group errors to users module
Moved user and group errors to users module

Refactor #COG-502
2024-11-29 17:06:34 +01:00
Vasilije
57754b3ca0
Connect pipeline to benchmark (#42)
evals/eval_swe_bench runs the code graph pipeline, adds retrieval to the
end, then connects the whole thing with swe-bench

Some unnecessary utility functions were removed.

Note: the pipeline is called for a "graphrag" folder as an example, due
to bugs in the pipeline.
2024-11-29 17:05:37 +01:00
Rita Aleksziev
a4c56f118d Connect code graph pipeline + retriever + benchmarking 2024-11-29 15:24:49 +01:00
Igor Ilic
c702b6cae0
feat: Add singleton way of working to graph databases (#39)
Added signleton type of functioning to graph databases

Feature
2024-11-29 15:04:42 +01:00
Igor Ilic
e03de63c8c
feat: Add reusable workflows for jupyter notebooks and python examples (#40)
Add reusable workflows for:
1. Jupyer notebooks
2. Python examples

Add github actions for current python examples

Feature COG-686
2024-11-29 15:04:13 +01:00
Leon Luithlen
bc82430fb5 Merge latest COG-519 2024-11-29 14:36:03 +01:00
Igor Ilic
a345471fef test: Add dynamic steps and multimedia example python script testing in github actions
Added dynamic steps and multimedia python example scripts testing in github actions

Test COG-686
2024-11-29 13:51:09 +01:00
Igor Ilic
2389e60fc1 chore: Return example to previous state before testing error raising
Return example to normal state after confirming error raising will be caught by gh action

Chore COG-686
2024-11-29 13:48:13 +01:00
Igor Ilic
f363ece4a7 chore: Test if raised error will be caught
Test if error raised inside python example will be caught

Chore COG-686
2024-11-29 13:45:38 +01:00
Igor Ilic
c7a8d2995b test: Add reusable python example workflow
Add reusable workflow for python examples, add simple example python script test

Test COG-686
2024-11-29 13:42:04 +01:00
Igor Ilic
335b8ca0de fix: Remove creation of tables for PGVector
As PGVector is used as a vector database it doesn't need to create tables based on models

Fix COG-678
2024-11-29 13:14:25 +01:00
Igor Ilic
ea38a0f51b chore: Update all notebook github actions
Update all notebook github actions to use reusable_notebook workflow

Chore COG-686
2024-11-29 12:20:12 +01:00
Rita Aleksziev
4da1657140 merge changes from code-graph 2024-11-29 12:16:36 +01:00
Igor Ilic
eaf26b5c9e chore: Update github action regrading notebook
Update github action related to jupyter notebook

Chore COG-686
2024-11-29 12:16:28 +01:00
Igor Ilic
ce99936ed5 chore: Test github action
Test notebook github action

Chore COG-686
2024-11-29 12:14:04 +01:00
Igor Ilic
d0d033bf97 chore: Test work of github action when removing label need
Test work of github action when label is not needed

Chore COG-686
2024-11-29 12:06:25 +01:00
Rita Aleksziev
8f241fa6c5 convert edge to string 2024-11-29 12:05:52 +01:00
Igor Ilic
6e8ca2f0e6 test: Attempt to fix event propagation issue
Trying to resolve issue of propagating github events to reusable workflow

Test COG-686
2024-11-29 12:04:31 +01:00
Igor Ilic
e72a84c1c3 test: Resolve issue with notebook location
Reusable workflows must be in the workflows github folder

Test COG-686
2024-11-29 11:53:26 +01:00