Commit graph

36 commits

Author SHA1 Message Date
Igor Ilic
4a73505e23 refactor: Move create_db_and_tables module from vectors to pgvector
Moved create_db_and_tables module to pgvector so it only handles pgvector related db creation

Refactor #COG-170
2024-10-22 10:29:35 +02:00
Igor Ilic
9fbf2d857f feat: Add PGVector support
Added first working iteration of PGVector for cognee, some important funcionality is still missing, but the core is there. Also some refactoring will be necessary.

Feature: #COG-170
2024-10-17 17:05:38 +02:00
Igor Ilic
fcd60861ba
fix: Fix Jupyter Notebook (#142)
* fix: resolve issue with dlt sqlalchemy usage
Cognee database configuration information was not handled properly by dlt, a new dlt handler
moudle was made to handle database configuration propagation.

* fix: resolve issue with jupyter notebook

cognee add function uses old way of working in the notebook, updated it to
work with the latest state of the cognee add function which doesn't return output.

* fix: Remove empty DB_PATH argument from .env.template

Empty value for DB_PATH in the .env file overrides default value for path intended to be used by cognee.

---------
2024-10-07 12:58:54 +02:00
Boris
01582d7a55
feat: split add into tasks and use pipeline architecture (#141)
* feat: split add into tasks and use pipeline architecture
2024-09-30 14:09:20 +02:00
Boris
56868d8a6f
feat: add telemetry logging to pipelines and tasks (#140)
* feat: add telemetry logging to pipelines and tasks

* fix: enable telemetry for local environment
2024-09-29 12:20:48 +02:00
Boris
a9433e9283
feat: add sqlalchemy as dlt destination (#137)
* feat: add sqlalchemy as dlt destination

* Fix the demo, update Readme

* fix: add 1.5 notebook

---------

Co-authored-by: Vasilije <8619304+Vasilije1990@users.noreply.github.com>
2024-09-21 15:58:28 +02:00
Boris
e1a0b55a21
feat: user authentication in routes (#133)
* feat: require logged in user in routes
2024-09-08 21:12:49 +02:00
Vasilije
2e367198cd Task updates and updates to SQLAlchemy Adapter 2024-08-07 18:21:14 +02:00
Boris Arzentar
cb9bfa27ea fix: search results preview 2024-08-06 15:23:36 +02:00
Boris Arzentar
709a10c50c fix: add dataset and data models 2024-08-05 23:42:36 +02:00
Vasilije
07e2bc1b39 Fixes to the pipeline 2024-08-05 09:56:45 +02:00
Boris Arzentar
401167bb0f fix: enable sqlalchemy adapter 2024-08-04 22:23:28 +02:00
Vasilije
66749fadc2 Updates to functions 2024-07-27 16:18:08 +02:00
Vasilije
b4d1a739be Fixes to the ACL model 2024-07-27 12:45:15 +02:00
Boris
14555a25d0
feat: pipelines and tasks (#119)
* feat: simple graph pipeline

* feat: implement incremental graph generation

* fix: various bug fixes

* fix: upgrade weaviate-client

---------

Co-authored-by: Vasilije <8619304+Vasilije1990@users.noreply.github.com>
2024-07-20 16:49:00 +02:00
Boris Arzentar
7c66364899 test: add weaviate integration test 2024-06-12 22:32:13 +02:00
Boris Arzentar
c9d9672fed fix: cognify status table update 2024-06-03 21:49:10 +02:00
Boris Arzentar
4fb3dc31a4 fix: enable sdk and fix config 2024-06-03 14:03:24 +02:00
Boris Arzentar
aef78c4a8f fix: set config before using it 2024-05-27 14:18:39 +02:00
Vasilije
bbfec1c044 Updates to the configs 2024-05-26 14:05:49 +02:00
Vasilije
8da1445ed7 Updates to the configs 2024-05-26 13:31:26 +02:00
Vasilije
cddf836fce Updates to the configs 2024-05-26 11:46:49 +02:00
Boris Arzentar
1ac28f4cb8 feat: add initial cognee frontend 2024-05-17 13:42:14 +02:00
Vasilije
212e5dcf78
Cog 174 (#84)
* Add telemetry

* test: add github action test

* fix: create graph only once

* fix: handle graph file not existing while deleting it

* fix: close qdrant connection in methods

---------

Co-authored-by: Boris Arzentar <borisarzentar@gmail.com>
2024-04-26 00:16:03 +02:00
Vasilije
1c2c72b8bf
Add telemetry (#82)
* Add telemetry
2024-04-24 19:06:53 +02:00
Boris Arzentar
9cbf450849 fix: move chunker to adapter 2024-04-23 14:59:09 +02:00
Boris Arzentar
e58251b00c fix: download nltk files when needed 2024-04-21 22:03:18 +02:00
Vasilije
bb679c2dd7
Improve processing, update networkx client, and Neo4j, and dspy (#69)
* Update cognify and the networkx client to prepare for running in Neo4j

* Fix for openai model

* Add the fix to the infra so that the models can be passed to the library. Enable llm_provider to be passed.

* Auto graph generation now works with neo4j

* Added fixes for both neo4j and networkx

* Explicitly name semantic node connections

* Added updated docs, readme, chunkers and updates to cognify

* Make docs build trigger only when changes on it happen

* Update docs, test git actions

* Separate cognify logic into tasks

* Introduce dspy knowledge graph extraction

---------
Co-authored-by: Boris Arzentar <borisarzentar@gmail.com>
2024-04-20 19:05:40 +02:00
Boris Arzentar
370b74988e chore: add functions to improve user experience 2024-03-30 15:25:34 +01:00
Boris Arzentar
fde01fec7b Merge remote-tracking branch 'origin/adding_ollama' into adding_ollama 2024-03-29 13:55:27 +01:00
Boris Arzentar
8d4be049f4 feat: add support for text and file in cognee.add 2024-03-29 13:53:59 +01:00
Vasilije
90c41512ed Ollama fixes, missing libs + config fixes 2024-03-28 11:26:22 +01:00
Boris Arzentar
a87d627ec2 fix: use pypdf for pdf text extraction 2024-03-26 16:21:33 +01:00
Boris Arzentar
9c06e293b2 feat: add EmbeddingEngine and use local embedding model 2024-03-26 14:43:26 +01:00
Boris Arzentar
d5391f903c chore: rename package in files 2024-03-13 16:27:07 +01:00
Boris Arzentar
40e760f517 chore: rename package 2024-03-13 16:08:11 +01:00