Commit graph

313 commits

Author SHA1 Message Date
Boris Arzentar
e1e5e7336a fix: remove unused import 2024-11-12 09:01:03 +01:00
Boris Arzentar
7ea5f638fe fix: add summaries to the graph 2024-11-12 09:01:03 +01:00
Boris Arzentar
63900f6b0a fix: serialize UUID in pgvector data point payload 2024-11-12 09:01:03 +01:00
Boris Arzentar
a2b1087c84 feat: add FalkorDB integration 2024-11-12 09:01:01 +01:00
Boris Arzentar
73372df31e feat: add falkordb adapter 2024-11-12 09:00:23 +01:00
Boris
52180eb6b5
feat: COG-184 add falkordb (#192)
* feat: add falkordb adapter

---------

Co-authored-by: hajdul88 <52442977+hajdul88@users.noreply.github.com>
2024-11-11 18:20:52 +01:00
Igor Ilic
33c3748d1e refactor: Renamed .anonymous_id file to anon_id
Renamed .anonymous_id file to anon_id

Refactor #COG-492
2024-11-11 11:53:09 +01:00
Igor Ilic
9277363c24 refactor: Remove unused dependency
Remove unused cognee dependency

Refactor #COG-492
2024-11-11 10:04:05 +01:00
Igor Ilic
99e74d7055 Merge branch 'main' of github.com:topoteretes/cognee into COG-492-posthog-unique-users 2024-11-08 17:38:29 +01:00
Igor Ilic
02982baf87 feat: Add unique identifier for reusing cognee-lib for posthog
an .anonymous_id file is created in the cognee directory which stores unique identifier that is reused in further cognee runs

Feature #COG-492
2024-11-08 17:35:05 +01:00
Leon Luithlen
4375742a82 Call os.getenv in BaseConfig 2024-11-08 13:54:33 +01:00
Vasilije
16ee97cb68 fixes 2024-11-08 12:01:47 +01:00
Igor Ilic
ddf495266b Merge branch 'main' of github.com:topoteretes/cognee into COG-334-structure-routing 2024-11-05 22:53:33 +01:00
Igor Ilic
bce6540302 refactor: Add default value for datetime
Added None as default value for datetime

Refactor #COG-334
2024-11-05 22:40:14 +01:00
Igor Ilic
742540929c docs: Documentation update for getting and deleting Data
Updated docs to functions related to getting and deleting Data model objects

Docs #COG-334
2024-11-05 22:17:28 +01:00
Igor Ilic
801efeb1cb fix: Resolve security concerns regarding os calls
Resolved security concerns in endpoints regarding os

Fix #COG-334-structure-routing
2024-11-05 21:29:56 +01:00
Leon Luithlen
67f5d07919 Delete get_file_size 2024-11-04 17:24:56 +01:00
Leon Luithlen
5b07a0a3d2 Add type hint in extract_text_from_file 2024-11-04 17:24:46 +01:00
Leon Luithlen
cb205069bc Replace parse_obj with model_validate 2024-11-04 17:20:01 +01:00
Leon Luithlen
115e93b791 Remove fastembed dependency 2024-11-04 17:02:47 +01:00
Leon Luithlen
79642cfca1 Replace update_forward_refs with model_rebuild calls 2024-11-04 15:53:40 +01:00
Leon Luithlen
287427a240 Update litellm and openai version, bump pydantic 2024-11-04 15:45:06 +01:00
Igor Ilic
d5a220ef0b test: Test telemetry
Removed space to trigger github actions to test telemetry

Test
2024-11-02 16:49:56 +01:00
Igor Ilic
de1ba5cd7c feat: Add cascade deletion for datasets and data
Added cascade deletion so when a dataset or data is deleted the connection in the dataset_data table is also deleted

Feature #COG-455
2024-11-01 12:55:20 +01:00
Igor Ilic
71ebfe7bb6 fix: Fix cognee graphistry and llm configuration through code
Fixed issue where graphistry and llm configuration options could not be set through code. Updated README.md

Fix #COG-472
2024-10-31 11:48:34 +01:00
Igor Ilic
3567e0d7e7 fix: Fix chunk naive llm classifier
Fixed chunk naive llm classifier uuid issue, added fix for deletion of data points for LanceDB

Fix #COG-472
2024-10-31 00:42:18 +01:00
Igor Ilic
eca1b9fddd feat: Add data deletion endpoint
Add ability to delete data instance through endpoint

Feature #COG-455
2024-10-28 14:40:49 +01:00
Igor Ilic
fc3eb9b9b5 Merge branch 'main' of github.com:topoteretes/cognee into COG-334-structure-routing 2024-10-28 13:43:42 +01:00
Igor Ilic
c23a314b63
COG-414: fix postgres database deletion (#163)
* fix: Add deletion of all tables in all schemas for postgres

Added deletion of all tables in postgres database, but this fix causes an issue regrading creation of duplicate tables on next run

Fix #COG-414

* fix: Resolve issue with database deletion

Resolve issue with database deletion by cleaning Metadata after every schema

Fix #COG-414

* fix: Move cleaning of MetaData out of drop table loop

Moved cleaning of MetaData to be after all tables have been dropped

Fix #COG-414

* refactor: Remove unnecessary print statement

Removed unnecessary print statement

Refactor #COG-414

* fix: Fix table deletion for SqlAlchemyAdapter

Fixed deletion of tables in SqlAlchemyAdapter so it works for sqlite and postgres

Fix #COG-414

* feat: Add deletion by id for SqlAlchemyAdapter

Added ability to delete data from database by id

Feature #COG-414

* fix: Add support for postgresql syntax for getting table function in SqlAlchemyAdapter

Added support for schema namespace for getting tables

Fix #COG-414
2024-10-28 09:57:30 +01:00
Igor Ilic
02d6750d05 refactor: Change class order in settings router
Changed class order in settings router to allow proper work of settings

Refactor #COG-334
2024-10-24 18:49:39 +02:00
Igor Ilic
4fd4651471 refactor: Add routers for datasets and add endpoints
Added routers for datasets and add endpoints

Refactor #COG-334
2024-10-24 17:56:15 +02:00
Igor Ilic
f8f2746603 refactor: Move permission router inside routers folder, add cognify router
Moved permissions router in it's routers folder, added cognify router

Refactor #COG-334
2024-10-24 17:18:50 +02:00
Igor Ilic
f09c28aada refactor: Add routers to search and settings
Added routers for search and settings endpoints

Refactor #COG-334
2024-10-24 17:01:34 +02:00
Igor Ilic
1088b58f11
fix: Add missing await to create_database (#162)
Added missing await for database creation in PGVectorAdapter

Fix #COG-170
2024-10-22 20:15:36 +02:00
Igor Ilic
0c6f019838 refactor: Remove broad exception handling from PGVectorAdapter
Removed broad exception handling for the search function in PGVectorAdapter

Refactor #COG-170
2024-10-22 15:41:07 +02:00
Igor Ilic
dc46304a8d fix: Add missing await statement to LanceDBAdapter and PGVectorAdapter
Added missing await statement to batch search for LanceDB and PGVector adapters

Fix #COG-170
2024-10-22 15:15:45 +02:00
Igor Ilic
195929e245 refactor: Fix typo
Refactor fix typo in pgvector integration test

Refactor #COG-170
2024-10-22 15:12:45 +02:00
Igor Ilic
d30c337370 refactor: Use SQLAlchemyAdapter create_database
Added reusing of sqlalchemy adapters create_database method instead of directly writing code for database creation

Refactor #COG-170
2024-10-22 14:23:36 +02:00
Igor Ilic
6b9a14270d refactor: Fix spacing, remove unused config methods
Remove unused config methods so we don't have to maintain them.
Fixed spacing in test_pgvector integration test.

Refactor #COG-170
2024-10-22 13:45:23 +02:00
Igor Ilic
c7ed46ddaa fix: Change to new syntax for vector_engine_provider
Syntax changed for vector_engine_provider to vector_db_provider

Fix #COG-170
2024-10-22 12:57:17 +02:00
Igor Ilic
88ded6e1a8 Merge branch 'main' of github.com:topoteretes/cognee into COG-170-PGvector-adapter 2024-10-22 12:41:18 +02:00
Igor Ilic
a3581689f2 refactor: Add setting of database configs through dictionary
Added the ability to set database configurations through dictionary for ease of use.
Updated test_pgvector to use this way of setting configuration

Refactor #COG-170
2024-10-22 11:53:33 +02:00
Boris
2f832b190c
fix: various fixes for the deployment
* fix: remove groups from UserRead model

* fix: add missing system dependencies for postgres

* fix: change vector db provider environment variable name

* fix: WeaviateAdapter retrieve bug

* fix: correctly return data point objects from retrieve method

* fix: align graph object properties

* feat: add node example
2024-10-22 11:26:48 +02:00
Igor Ilic
4a73505e23 refactor: Move create_db_and_tables module from vectors to pgvector
Moved create_db_and_tables module to pgvector so it only handles pgvector related db creation

Refactor #COG-170
2024-10-22 10:29:35 +02:00
Igor Ilic
71c1374859 refactor: Move serialize_datetime function
Move serialize_datetime function to be in it's own file

Refactor #COG-170
2024-10-22 10:19:39 +02:00
Igor Ilic
2cedcbe670 refactor: Change database name in PGVectorAdapter test and workflow
Changed database name in test and workflow to be the same as in the .env.template

Refactor #COG-170
2024-10-21 15:51:48 +02:00
Igor Ilic
4c381a3ae9 chore: Add pgvector dependency
Added pgvector dependency for PGVectorAdapter

Chore #COG-170
2024-10-21 15:08:27 +02:00
Igor Ilic
f8babbaa53 test: Add test for PGVectorAdapter
Added test for PGVectorAdapter

Test #COG-170
2024-10-21 14:33:00 +02:00
Igor Ilic
05e4ef349e fix: Fix pruning of postgres database
Fixed issue with newly added tables not being pruned from postgres database

Fix #COG-170
2024-10-21 14:28:57 +02:00
Igor Ilic
240c660eac refactor: Change raw SQL queries to SQLalchemy ORM for PGVectorAdapter
Changed raw SQL quries to use SQLalchemy ORM for PGVectorAdapter

Refactor #COG-170
2024-10-21 12:59:24 +02:00