Commit graph

949 commits

Author SHA1 Message Date
Igor Ilic
bce6540302 refactor: Add default value for datetime
Added None as default value for datetime

Refactor #COG-334
2024-11-05 22:40:14 +01:00
Igor Ilic
742540929c docs: Documentation update for getting and deleting Data
Updated docs to functions related to getting and deleting Data model objects

Docs #COG-334
2024-11-05 22:17:28 +01:00
Igor Ilic
801efeb1cb fix: Resolve security concerns regarding os calls
Resolved security concerns in endpoints regarding os

Fix #COG-334-structure-routing
2024-11-05 21:29:56 +01:00
Igor Ilic
d5a220ef0b test: Test telemetry
Removed space to trigger github actions to test telemetry

Test
2024-11-02 16:49:56 +01:00
Igor Ilic
de1ba5cd7c feat: Add cascade deletion for datasets and data
Added cascade deletion so when a dataset or data is deleted the connection in the dataset_data table is also deleted

Feature #COG-455
2024-11-01 12:55:20 +01:00
Igor Ilic
eca1b9fddd feat: Add data deletion endpoint
Add ability to delete data instance through endpoint

Feature #COG-455
2024-10-28 14:40:49 +01:00
Igor Ilic
fc3eb9b9b5 Merge branch 'main' of github.com:topoteretes/cognee into COG-334-structure-routing 2024-10-28 13:43:42 +01:00
Igor Ilic
c23a314b63
COG-414: fix postgres database deletion (#163)
* fix: Add deletion of all tables in all schemas for postgres

Added deletion of all tables in postgres database, but this fix causes an issue regrading creation of duplicate tables on next run

Fix #COG-414

* fix: Resolve issue with database deletion

Resolve issue with database deletion by cleaning Metadata after every schema

Fix #COG-414

* fix: Move cleaning of MetaData out of drop table loop

Moved cleaning of MetaData to be after all tables have been dropped

Fix #COG-414

* refactor: Remove unnecessary print statement

Removed unnecessary print statement

Refactor #COG-414

* fix: Fix table deletion for SqlAlchemyAdapter

Fixed deletion of tables in SqlAlchemyAdapter so it works for sqlite and postgres

Fix #COG-414

* feat: Add deletion by id for SqlAlchemyAdapter

Added ability to delete data from database by id

Feature #COG-414

* fix: Add support for postgresql syntax for getting table function in SqlAlchemyAdapter

Added support for schema namespace for getting tables

Fix #COG-414
2024-10-28 09:57:30 +01:00
Vasilije
99f50523e9
Merge pull request #169 from niranjan-kurhade/main
Fixed Broken Link in Readme
2024-10-27 17:53:35 +01:00
Niranjan Kurhade
1890f40d25
Merge pull request #1 from niranjan-kurhade/broken-link-fix
Fixed Broken Link in Readme
2024-10-27 02:19:39 +05:30
Niranjan Kurhade
65c2b77492
Fixed Broken Link in Readme 2024-10-27 02:17:50 +05:30
Boris
351355a48d
feature: add tracking to docs website (#165)
* feat: add segment tracking snippet
2024-10-25 14:09:27 +02:00
Igor Ilic
02d6750d05 refactor: Change class order in settings router
Changed class order in settings router to allow proper work of settings

Refactor #COG-334
2024-10-24 18:49:39 +02:00
Igor Ilic
4fd4651471 refactor: Add routers for datasets and add endpoints
Added routers for datasets and add endpoints

Refactor #COG-334
2024-10-24 17:56:15 +02:00
Igor Ilic
f8f2746603 refactor: Move permission router inside routers folder, add cognify router
Moved permissions router in it's routers folder, added cognify router

Refactor #COG-334
2024-10-24 17:18:50 +02:00
Igor Ilic
f09c28aada refactor: Add routers to search and settings
Added routers for search and settings endpoints

Refactor #COG-334
2024-10-24 17:01:34 +02:00
Igor Ilic
1088b58f11
fix: Add missing await to create_database (#162)
Added missing await for database creation in PGVectorAdapter

Fix #COG-170
2024-10-22 20:15:36 +02:00
Vasilije
b329d50a81
Merge pull request #159 from moli-debugger/bug/typo-error-fixes
Fic: typo error
2024-10-22 17:07:29 +02:00
Igor Ilic
c170bbb6e2
Merge pull request #158 from topoteretes/COG-170-PGvector-adapter
Cog 170 pgvector adapter
2024-10-22 15:46:49 +02:00
Igor Ilic
0c6f019838 refactor: Remove broad exception handling from PGVectorAdapter
Removed broad exception handling for the search function in PGVectorAdapter

Refactor #COG-170
2024-10-22 15:41:07 +02:00
Igor Ilic
dc46304a8d fix: Add missing await statement to LanceDBAdapter and PGVectorAdapter
Added missing await statement to batch search for LanceDB and PGVector adapters

Fix #COG-170
2024-10-22 15:15:45 +02:00
Igor Ilic
195929e245 refactor: Fix typo
Refactor fix typo in pgvector integration test

Refactor #COG-170
2024-10-22 15:12:45 +02:00
Igor Ilic
0e1533aa44 chore: Update how postgres dependencies are installed in integration test for pgvector
Updated how postgres dependencies are installed due to change in pyproject.toml

Chore #COG-170
2024-10-22 14:27:36 +02:00
Igor Ilic
d30c337370 refactor: Use SQLAlchemyAdapter create_database
Added reusing of sqlalchemy adapters create_database method instead of directly writing code for database creation

Refactor #COG-170
2024-10-22 14:23:36 +02:00
Igor Ilic
c78627f926 chore: Remove postgres group from pyproject.toml install postgres dependencies through extras
To be uniform with how we install optional dependencies a change has been made so that postgres optional dependencies are installed through extras

Chore #COG-170
2024-10-22 14:02:36 +02:00
Igor Ilic
6b9a14270d refactor: Fix spacing, remove unused config methods
Remove unused config methods so we don't have to maintain them.
Fixed spacing in test_pgvector integration test.

Refactor #COG-170
2024-10-22 13:45:23 +02:00
Igor Ilic
c7ed46ddaa fix: Change to new syntax for vector_engine_provider
Syntax changed for vector_engine_provider to vector_db_provider

Fix #COG-170
2024-10-22 12:57:17 +02:00
Igor Ilic
dbc86e284a chore: Add pgvector back to mandatory dependencies
pgvector is imported directly in PGVector adapter therefore it needs to be installed with mandatory dependencies

Chore #COG-170
2024-10-22 12:51:26 +02:00
Igor Ilic
8002db72c3 chore: Add installing of depdendencies along with postgres group
Since the postgres related libraries are no longer mandatory specification is needed for them to be installed as well

Chore #COG-170
2024-10-22 12:46:45 +02:00
Igor Ilic
88ded6e1a8 Merge branch 'main' of github.com:topoteretes/cognee into COG-170-PGvector-adapter 2024-10-22 12:41:18 +02:00
Igor Ilic
7b2022e5f3 refactor: Move psycopg2 to an optional dependency
Moved psycopg2 as an optional dependency for postgres to not block users with lib issues it might cause

Refactor #COG-170
2024-10-22 12:24:51 +02:00
Igor Ilic
a3581689f2 refactor: Add setting of database configs through dictionary
Added the ability to set database configurations through dictionary for ease of use.
Updated test_pgvector to use this way of setting configuration

Refactor #COG-170
2024-10-22 11:53:33 +02:00
Boris
2f832b190c
fix: various fixes for the deployment
* fix: remove groups from UserRead model

* fix: add missing system dependencies for postgres

* fix: change vector db provider environment variable name

* fix: WeaviateAdapter retrieve bug

* fix: correctly return data point objects from retrieve method

* fix: align graph object properties

* feat: add node example
2024-10-22 11:26:48 +02:00
Igor Ilic
4a73505e23 refactor: Move create_db_and_tables module from vectors to pgvector
Moved create_db_and_tables module to pgvector so it only handles pgvector related db creation

Refactor #COG-170
2024-10-22 10:29:35 +02:00
Igor Ilic
71c1374859 refactor: Move serialize_datetime function
Move serialize_datetime function to be in it's own file

Refactor #COG-170
2024-10-22 10:19:39 +02:00
Vasilije
9100de75f5
Merge pull request #160 from Akhsuna07/patch-2
Fixed Some grammatical errors in the file.
2024-10-21 18:34:34 +02:00
ANUSHKA KATHARE
8130171b7f
Fixed Some grammatical errors in the file. 2024-10-21 22:01:21 +05:30
Igor Ilic
2cedcbe670 refactor: Change database name in PGVectorAdapter test and workflow
Changed database name in test and workflow to be the same as in the .env.template

Refactor #COG-170
2024-10-21 15:51:48 +02:00
Igor Ilic
9461ba0fd1 chore: Add psycopg2 dependency
Add psycopg2 a postgresql database adapter dependency

Chore #COG-170
2024-10-21 15:32:51 +02:00
Igor Ilic
4c381a3ae9 chore: Add pgvector dependency
Added pgvector dependency for PGVectorAdapter

Chore #COG-170
2024-10-21 15:08:27 +02:00
Igor Ilic
9f4b8f2f42 test: Add github action workflow to run PGVectorAdapter integration test
Added github action workflow to run PGVectorAdapter integration test

Test #COG-170
2024-10-21 14:50:39 +02:00
Igor Ilic
f8babbaa53 test: Add test for PGVectorAdapter
Added test for PGVectorAdapter

Test #COG-170
2024-10-21 14:33:00 +02:00
Igor Ilic
05e4ef349e fix: Fix pruning of postgres database
Fixed issue with newly added tables not being pruned from postgres database

Fix #COG-170
2024-10-21 14:28:57 +02:00
Igor Ilic
240c660eac refactor: Change raw SQL queries to SQLalchemy ORM for PGVectorAdapter
Changed raw SQL quries to use SQLalchemy ORM for PGVectorAdapter

Refactor #COG-170
2024-10-21 12:59:24 +02:00
Mohamed Ali
c6267c5c2c Fic: typo error 2024-10-19 17:00:11 +00:00
Igor Ilic
d2772d22b8 refactor: Formatting change for create_vector_engine
Change formatting for connection string for PGVectorAdapter

Refactor #COG-170
2024-10-18 15:03:28 +02:00
Igor Ilic
7f7b015ea3 refactor: Add formatting to create_vector_engine
Added formatting for PGVector part of create_vector_engine

Refactor #COG-170
2024-10-18 15:00:51 +02:00
Igor Ilic
2cd255768e refactor: Add formatting to PGVector Adapter
Formatted PGVectorAdapter

Refactor #COG-170
2024-10-18 14:46:33 +02:00
Igor Ilic
325e6cd654 refactor: Rewrite search query
Optimize search query for PGVector

Refactor #COG-170
2024-10-18 13:33:40 +02:00
Igor Ilic
58e5854943 Merge branch 'main' of github.com:topoteretes/cognee into COG-170-PGvector-adapter 2024-10-18 12:05:06 +02:00