Commit graph

4555 commits

Author SHA1 Message Date
Ryan Lin
f65070087f Feature: Integrate Milvus as the VectorDatabase 2024-12-03 03:40:28 -05:00
Vasilije
42ab60125b
Merge pull request #242 from topoteretes/main-cognify-fix
fix: fixes cognify duplicated edges and resets the methods to an olde…
2024-12-02 20:53:57 +01:00
Vasilije
1c47870d05
Merge pull request #241 from topoteretes/COG-595-optional-dependencies
chore: Add optional dependencies
2024-12-02 20:53:43 +01:00
hajdul88
6841c83566 fix: fixes cognify duplicated edges and resets the methods to an older version 2024-12-02 20:18:55 +01:00
Igor Ilic
ec65354eec Merge branch 'COG-595-optional-dependencies' of github.com:topoteretes/cognee into COG-595-optional-dependencies 2024-12-02 19:37:03 +01:00
Igor Ilic
dcb320da52 chore: Add groq and langfuse as optional dependencies
Added groq and langfuse as optional dependencies

Chore COG-595
2024-12-02 19:35:50 +01:00
Igor Ilic
19c83a5d23
Merge branch 'main' into COG-595-optional-dependencies 2024-12-02 19:09:51 +01:00
Igor Ilic
1a5f0fe10d chore: Update readme with more description about extras
Update readme to be a bit more descriptive about installation

Chore COG-595
2024-12-02 19:07:17 +01:00
Igor Ilic
ad56ff9c1a chore: Add langchain as optional dependency
Added langchain as optional dependency

Chore COG-595
2024-12-02 16:47:26 +01:00
Igor Ilic
836e3d29e1 chore: Update README.md
Update README.md with database optional dependencies

Chore COG-595
2024-12-02 16:24:12 +01:00
Igor Ilic
b0eb9af9c2
Merge pull request #240 from topoteretes/COG-741-proxy-domain-change
refactor: Change proxy url to be to custom domain
2024-12-02 15:36:46 +01:00
Igor Ilic
63e687978e chore: Remove falkordb and posthog non optional dependency
Switched falkordb and posthog to be optional dependencies

Chore COG-595
2024-12-02 15:30:30 +01:00
Rita Aleksziev
dc082de4c2 minor bugfix in folder creation 2024-12-02 14:54:40 +01:00
Igor Ilic
13b79320b6 fix: Resolve issue with gh actions not installing optional packages
Add install of optional databases packages for database gh actions

Fix COG-595
2024-12-02 14:54:20 +01:00
Igor Ilic
f41228aa51 fix: Resolve import of optional package
Resolve issue with forced import of optional pgvector package.

Fix COG-595
2024-12-02 14:52:24 +01:00
Igor Ilic
10dc6b1524 chore: Add optional dependencies
Change intended optional dependencies to really be optional

Chore COG-595
2024-12-02 14:38:41 +01:00
Igor Ilic
491dc49679 refactor: Change proxy url to be to custom domain
Added custom domain for proxy use

Refactor COG-741
2024-12-02 14:00:17 +01:00
Igor Ilic
dd8af12aa9
Cog 502 backend error handling (#32)
Rework of the cognee lib exception/error handling.

Added custom exceptions and custom exception handling.

Whenever a custom exception is raised in the cognee fastapi backend it
will be processed by the exception handler making sure exception
information is logged and proper JSONResponse is sent. No need to catch
these exception in endpoints with the goal of logging and responding.

Note: The exception handler is only used for the cognee FastAPI backend
server, using cognee as a library won't utilize this exception handling
2024-12-02 13:47:38 +01:00
Rita Aleksziev
0eb40d0761 updating dependencies with deepeval as optional 2024-12-02 13:31:39 +01:00
Igor Ilic
343ac47fd4 fix: Update import location for LanceDB
Updated import path for LanceDB exceptions

Fix COG-502
2024-12-02 13:19:55 +01:00
Igor Ilic
04960eeb4e Merge branch 'main' of github.com:topoteretes/cognee-private into COG-502-backend-error-handling 2024-12-02 13:12:20 +01:00
Igor Ilic
34971d16cc
Cog 678 relational database singleton (#38)
1. Set relational database in cognee to be used as singleton and made
necessary changes to enable this
2. Added SQLite support to dlt pipeline in ingest_data
2024-12-02 13:02:34 +01:00
Rita Aleksziev
f966f099fc Prompt renaming to more specific names. Minor code changes. 2024-12-02 12:18:00 +01:00
Boris Arzentar
76e2b6a639 Merge remote-tracking branch 'origin/main' 2024-12-02 10:15:30 +01:00
Boris Arzentar
11acabdb6a fix: remove duplicate nodes and edges before saving; Fix FalkorDB vector index; 2024-12-02 10:10:18 +01:00
Boris Arzentar
925346986e Merge remote-tracking branch 'origin/code-graph' 2024-12-01 11:52:03 +01:00
Boris Arzentar
d6f0d65b63 Merge remote-tracking branch 'origin/code-graph' 2024-12-01 11:51:54 +01:00
hajdul88
198f71b9be
feat: Implements multiprocessing for get_repo_file_dependencies task (#43) 2024-12-01 11:51:04 +01:00
Boris Arzentar
e8a1ce531a Merge remote-tracking branch 'origin/main' 2024-12-01 11:44:07 +01:00
Vasilije
bbaf78f54e
Cog 669 implement dummy llm adapter (#37)
Adds the `class DummyLLMAdapter(LLMInterface)` class for profiling of
large datasets without actual LLM calls in the top level
`profiling/util` location.

I also move the `show_prompt` implementation from the child classes to
`LLMInterface`, since the implementations were identical.

I expanded the scope to also include a DummyEmbeddingEngine.
2024-11-30 17:02:49 +01:00
Vasilije
4d02560f1c
Cog 519 develop metadata storage integration (#35)
@borisarzentar this PR is ready, the all checks run through in the
"sister" MR targeting main:
https://github.com/topoteretes/cognee-private/pull/26
2024-11-30 17:02:18 +01:00
Vasilije
d855e2ee88
Update README.md 2024-11-30 16:36:34 +01:00
Vasilije
0da0cd761b
Update README.md 2024-11-30 16:35:04 +01:00
Igor Ilic
6b97e95e14 refactor: Split entity related exceptions into graph and database exceptions
Move and split database entity related exceptions into graph and database exceptions

Refactor COG-502
2024-11-29 17:40:48 +01:00
Igor Ilic
eb09e5ad89 refactor: Moved ingestion exceptions to ingestion module
Moved custom ingestion exceptions to ingestion module

Refactor COG-502
2024-11-29 17:15:54 +01:00
Igor Ilic
1b2bdd9b83 refactor: Update __init__.py of base exception module
Updated init file of cognee base exception module

Refactor COG-502
2024-11-29 17:07:27 +01:00
Igor Ilic
df0b4b4820 refactor: Move user and group errors to users module
Moved user and group errors to users module

Refactor #COG-502
2024-11-29 17:06:34 +01:00
Vasilije
57754b3ca0
Connect pipeline to benchmark (#42)
evals/eval_swe_bench runs the code graph pipeline, adds retrieval to the
end, then connects the whole thing with swe-bench

Some unnecessary utility functions were removed.

Note: the pipeline is called for a "graphrag" folder as an example, due
to bugs in the pipeline.
2024-11-29 17:05:37 +01:00
Rita Aleksziev
a4c56f118d Connect code graph pipeline + retriever + benchmarking 2024-11-29 15:24:49 +01:00
Igor Ilic
c702b6cae0
feat: Add singleton way of working to graph databases (#39)
Added signleton type of functioning to graph databases

Feature
2024-11-29 15:04:42 +01:00
Igor Ilic
e03de63c8c
feat: Add reusable workflows for jupyter notebooks and python examples (#40)
Add reusable workflows for:
1. Jupyer notebooks
2. Python examples

Add github actions for current python examples

Feature COG-686
2024-11-29 15:04:13 +01:00
Leon Luithlen
bc82430fb5 Merge latest COG-519 2024-11-29 14:36:03 +01:00
Igor Ilic
a345471fef test: Add dynamic steps and multimedia example python script testing in github actions
Added dynamic steps and multimedia python example scripts testing in github actions

Test COG-686
2024-11-29 13:51:09 +01:00
Igor Ilic
2389e60fc1 chore: Return example to previous state before testing error raising
Return example to normal state after confirming error raising will be caught by gh action

Chore COG-686
2024-11-29 13:48:13 +01:00
Igor Ilic
f363ece4a7 chore: Test if raised error will be caught
Test if error raised inside python example will be caught

Chore COG-686
2024-11-29 13:45:38 +01:00
Igor Ilic
c7a8d2995b test: Add reusable python example workflow
Add reusable workflow for python examples, add simple example python script test

Test COG-686
2024-11-29 13:42:04 +01:00
Igor Ilic
335b8ca0de fix: Remove creation of tables for PGVector
As PGVector is used as a vector database it doesn't need to create tables based on models

Fix COG-678
2024-11-29 13:14:25 +01:00
Igor Ilic
ea38a0f51b chore: Update all notebook github actions
Update all notebook github actions to use reusable_notebook workflow

Chore COG-686
2024-11-29 12:20:12 +01:00
Rita Aleksziev
4da1657140 merge changes from code-graph 2024-11-29 12:16:36 +01:00
Igor Ilic
eaf26b5c9e chore: Update github action regrading notebook
Update github action related to jupyter notebook

Chore COG-686
2024-11-29 12:16:28 +01:00