Commit graph

209 commits

Author SHA1 Message Date
hajdul88
59f8ec665f Merge remote-tracking branch 'origin/main' into feature/cog-537-implement-retrieval-algorithm-from-research-paper 2024-11-26 16:38:32 +01:00
hajdul88
163bdc527c chore: fixes PR issues regarding vector normalization and cognee graph 2024-11-26 15:37:34 +01:00
hajdul88
a59517409c chore: Fixes some of the issues based on PR review + restructures things 2024-11-26 14:45:48 +01:00
Igor Ilic
66c321f206 fix: Add fix for getting transcription of audio and image from LLMs
Enable getting of text from audio and image files from LLMs

Fix
2024-11-25 17:32:11 +01:00
Igor Ilic
9193eca08b Trigger GitHub Actions 2024-11-25 15:00:02 +01:00
Igor Ilic
d33c740dc6
Cog 488 test database deletion (#16)
Added testing of database deletion for every end to end test
2024-11-22 10:32:43 +01:00
Boris
d1f8217320
feat: COG-585 enable custom llm and embeding models 2024-11-22 10:26:21 +01:00
hajdul88
676cdfcc84 Merge remote-tracking branch 'origin/main' into feature/cog-537-implement-retrieval-algorithm-from-research-paper 2024-11-21 17:07:16 +01:00
Igor Ilic
b60f2603f4 test: Add test for pgvector to confirm database deletion is working
Added assert to verify all tables in database have been cleared.
Added method to SqlAlchemyAdapter to get all table names in database.

Test COG-488
2024-11-20 17:11:23 +01:00
alekszievr
ad08b53ed7
Feat/cog 544 eval on swe bench (#5)
Evaluation script for SWE-bench benchmarking with and without cognee
2024-11-20 16:30:28 +01:00
Rita Aleksziev
98e693ad97 Merge branch 'main' into feat/COG-544-eval-on-swe-bench 2024-11-20 16:04:15 +01:00
hajdul88
0101d43b8d feat: Adds graph node filtering by feature 2024-11-20 15:13:38 +01:00
Igor Ilic
15b7b8ef2b fix: Resolve issue with table names in SQL commands
Some SQL commands require lowercase characters in table names unless table name is wrapped in quotes. Renamed all new tables to use lowercase

Fix COG-677
2024-11-20 14:54:35 +01:00
hajdul88
44ac9b68b4 feat: adds get_distances from collection method to LanceDB and PgVector 2024-11-19 16:39:45 +01:00
Igor Ilic
4b55354dce
fix: Resolve issue with pgvector timeout (#3)
By creating PGVector as a singleton all issues regrading timeout are
resolved as there are no more parallel instances trying to communicate
with the database
2024-11-19 15:31:26 +01:00
Rita Aleksziev
2948089806 Read patch generation instructions from file 2024-11-19 14:07:53 +01:00
0xideas
34e140a41d
Switch to gpt-4o-mini by default (#233)
* Switch to gpt-4o-mini by default

* Add option and make gpt-4o-mini default in frontend

* Run llama index notebook without extra arguments in poetry install

* Install extras for llama_index_notebook run
2024-11-18 17:38:54 +01:00
Boris
22a0e43d4a
Merge branch 'main' into COG-417-chunking-unit-tests 2024-11-17 13:40:32 +01:00
Boris
d8b6eeded5
feat: log search queries and results (#166)
* feat: log search queries and results

* fix: address coderabbit review comments

* fix: parse UUID when logging search results

* fix: remove custom UUID type and use DB agnostic UUID from sqlalchemy

* Add new cognee_db

---------

Co-authored-by: Leon Luithlen <leon@topoteretes.com>
2024-11-17 11:59:10 +01:00
Leon Luithlen
7cf8c74cf9 Merge latest main 2024-11-14 15:05:57 +01:00
hajdul88
867e18de86 fix: Changes GraphDBInterface typing in CogneeGraph 2024-11-14 14:01:20 +01:00
Leon Luithlen
e794bb8834 Return stripped value from get_embeddable_data if its string 2024-11-14 09:43:56 +01:00
hajdul88
d3fdddaa52 Revert "Checks the pgvector test issue"
This reverts commit 0d27371467.
2024-11-13 17:55:52 +01:00
hajdul88
0d27371467 Checks the pgvector test issue 2024-11-13 17:51:25 +01:00
hajdul88
bf4eedd20e
Merge branch 'main' into feat/COG-553-graph-memory-projection 2024-11-13 16:45:13 +01:00
hajdul88
9b62617394
Merge branch 'main' into feat/COG-553-graph-memory-projection 2024-11-12 16:56:40 +01:00
Leon Luithlen
fbd011560a Rebase onto main 2024-11-12 16:47:28 +01:00
Leon Luithlen
d7ffef1979 Remove old __tests__ folders 2024-11-12 16:47:28 +01:00
Leon Luithlen
86e726d741 Complete migrating unit tests 2024-11-12 16:47:28 +01:00
Vasilije
be792a7ba6
Merge branch 'main' into COG-575-remove-graph-overwrite-on-error 2024-11-12 10:18:09 +01:00
hajdul88
e988a67466 Fixes LanceDB datapoint add 2024-11-11 19:28:17 +01:00
Boris
52180eb6b5
feat: COG-184 add falkordb (#192)
* feat: add falkordb adapter

---------

Co-authored-by: hajdul88 <52442977+hajdul88@users.noreply.github.com>
2024-11-11 18:20:52 +01:00
Leon Luithlen
058b5916a4 Remove graph overwriting on exception in NetworkXAdapter 2024-11-11 12:59:36 +01:00
Igor Ilic
ddf495266b Merge branch 'main' of github.com:topoteretes/cognee into COG-334-structure-routing 2024-11-05 22:53:33 +01:00
Leon Luithlen
67f5d07919 Delete get_file_size 2024-11-04 17:24:56 +01:00
Leon Luithlen
5b07a0a3d2 Add type hint in extract_text_from_file 2024-11-04 17:24:46 +01:00
Leon Luithlen
115e93b791 Remove fastembed dependency 2024-11-04 17:02:47 +01:00
Igor Ilic
d5a220ef0b test: Test telemetry
Removed space to trigger github actions to test telemetry

Test
2024-11-02 16:49:56 +01:00
Igor Ilic
de1ba5cd7c feat: Add cascade deletion for datasets and data
Added cascade deletion so when a dataset or data is deleted the connection in the dataset_data table is also deleted

Feature #COG-455
2024-11-01 12:55:20 +01:00
Igor Ilic
3567e0d7e7 fix: Fix chunk naive llm classifier
Fixed chunk naive llm classifier uuid issue, added fix for deletion of data points for LanceDB

Fix #COG-472
2024-10-31 00:42:18 +01:00
Igor Ilic
c23a314b63
COG-414: fix postgres database deletion (#163)
* fix: Add deletion of all tables in all schemas for postgres

Added deletion of all tables in postgres database, but this fix causes an issue regrading creation of duplicate tables on next run

Fix #COG-414

* fix: Resolve issue with database deletion

Resolve issue with database deletion by cleaning Metadata after every schema

Fix #COG-414

* fix: Move cleaning of MetaData out of drop table loop

Moved cleaning of MetaData to be after all tables have been dropped

Fix #COG-414

* refactor: Remove unnecessary print statement

Removed unnecessary print statement

Refactor #COG-414

* fix: Fix table deletion for SqlAlchemyAdapter

Fixed deletion of tables in SqlAlchemyAdapter so it works for sqlite and postgres

Fix #COG-414

* feat: Add deletion by id for SqlAlchemyAdapter

Added ability to delete data from database by id

Feature #COG-414

* fix: Add support for postgresql syntax for getting table function in SqlAlchemyAdapter

Added support for schema namespace for getting tables

Fix #COG-414
2024-10-28 09:57:30 +01:00
Igor Ilic
1088b58f11
fix: Add missing await to create_database (#162)
Added missing await for database creation in PGVectorAdapter

Fix #COG-170
2024-10-22 20:15:36 +02:00
Igor Ilic
0c6f019838 refactor: Remove broad exception handling from PGVectorAdapter
Removed broad exception handling for the search function in PGVectorAdapter

Refactor #COG-170
2024-10-22 15:41:07 +02:00
Igor Ilic
dc46304a8d fix: Add missing await statement to LanceDBAdapter and PGVectorAdapter
Added missing await statement to batch search for LanceDB and PGVector adapters

Fix #COG-170
2024-10-22 15:15:45 +02:00
Igor Ilic
d30c337370 refactor: Use SQLAlchemyAdapter create_database
Added reusing of sqlalchemy adapters create_database method instead of directly writing code for database creation

Refactor #COG-170
2024-10-22 14:23:36 +02:00
Igor Ilic
c7ed46ddaa fix: Change to new syntax for vector_engine_provider
Syntax changed for vector_engine_provider to vector_db_provider

Fix #COG-170
2024-10-22 12:57:17 +02:00
Igor Ilic
88ded6e1a8 Merge branch 'main' of github.com:topoteretes/cognee into COG-170-PGvector-adapter 2024-10-22 12:41:18 +02:00
Boris
2f832b190c
fix: various fixes for the deployment
* fix: remove groups from UserRead model

* fix: add missing system dependencies for postgres

* fix: change vector db provider environment variable name

* fix: WeaviateAdapter retrieve bug

* fix: correctly return data point objects from retrieve method

* fix: align graph object properties

* feat: add node example
2024-10-22 11:26:48 +02:00
Igor Ilic
4a73505e23 refactor: Move create_db_and_tables module from vectors to pgvector
Moved create_db_and_tables module to pgvector so it only handles pgvector related db creation

Refactor #COG-170
2024-10-22 10:29:35 +02:00
Igor Ilic
71c1374859 refactor: Move serialize_datetime function
Move serialize_datetime function to be in it's own file

Refactor #COG-170
2024-10-22 10:19:39 +02:00