Commit graph

2773 commits

Author SHA1 Message Date
hajdul88
dd6e26fe41 Merge remote-tracking branch 'origin/dev' into feature/cog-2717-add-better-error-management-to-cognee 2025-08-14 16:17:36 +02:00
Daulet Amirkhanov
b297289060
Fix/add async lock to all vector databases (#1244)
<!-- .github/pull_request_template.md -->

## Description
1. Cleans up VectorDB adapters that have been migrated to
`cognee-community` repo
2. Adds async lock protection create_collection method in remaining
VectorDB - ChromaDB

See #1222

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

---------

Co-authored-by: Igor Ilic <30923996+dexters1@users.noreply.github.com>
2025-08-14 15:57:34 +02:00
hajdul88
a7d7e12d4c ruff fix 2025-08-14 14:48:35 +02:00
hajdul88
affbc557d2 chore: ruff formatting 2025-08-14 14:17:35 +02:00
hajdul88
63d071f0d8 feat: adds input checks for add datapoints and summarization tasks 2025-08-14 14:17:13 +02:00
hajdul88
9f965c44b4 feat: adds input checks for extract graph from data 2025-08-14 13:53:39 +02:00
hajdul88
df3a3df117 feat: adds errors to classify, and chunking top level 2025-08-14 13:12:08 +02:00
hajdul88
c99b453d96 feat: adds WrongDataDocumentError to classify documents 2025-08-14 10:57:16 +02:00
hajdul88
c75f017eb9
Merge branch 'dev' into feature/cog-2717-add-better-error-management-to-cognee 2025-08-14 10:53:31 +02:00
vasilije
0ed6f255c2 added fix 2025-08-14 10:52:39 +02:00
hajdul88
ca21122edb
Merge branch 'dev' into feature/cog-2717-add-better-error-management-to-cognee 2025-08-14 10:09:40 +02:00
Pavan Chilukuri
1ea632d0fa
Add health checks (#1184)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

Replaces basic /health endpoint with production-ready health monitoring
system that checks all critical backend components (databases, storage,
LLM providers) for container orchestration and monitoring.

Changes
New: cognee/api/health.py - Core health check system with structured
monitoring

Enhanced: cognee/api/client.py - Three new health endpoints

Added: examples/health_check_example.py - Testing utilities

New Endpoints
GET /health - Liveness probe (HTTP 200/503)
<img width="480" height="351" alt="Screenshot 2025-08-12 at 10 15 45 AM"
src="https://github.com/user-attachments/assets/53279b53-51bf-45a1-b3b9-4546e7bb6730"
/>

GET /health/detailed - Complete component status with metrics
<img width="1012" height="244" alt="Screenshot 2025-08-12 at 10 17
12 AM"
src="https://github.com/user-attachments/assets/ad3ac9cd-1135-490f-9641-726c4ea4e724"
/>


Components Monitored
Critical (failure = 503): Relational DB, Vector DB, Graph DB, File
Storage
Non-critical (failure = degraded): LLM Provider, Embedding Service


## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

---------

Co-authored-by: Daulet Amirkhanov <damirkhanov01@gmail.com>
Co-authored-by: Vasilije <8619304+Vasilije1990@users.noreply.github.com>
2025-08-13 20:41:36 +02:00
hajdul88
dbb967fda8 chore: updates neptune exception base + ruff 2025-08-13 16:28:05 +02:00
hajdul88
748e9fad86 feat: adds s3 file system not found error to ingestion 2025-08-13 16:17:58 +02:00
hajdul88
d14d31adbe chore: updating delete_by_id test 2025-08-13 15:39:11 +02:00
hajdul88
8bd2416bc7 chore: fixing delete exception import in dataset router 2025-08-13 15:36:17 +02:00
hajdul88
66d2c75128 chore: changing docstring 2025-08-13 15:20:24 +02:00
hajdul88
7af4775c56 chore: changed pypdf error base class 2025-08-13 15:17:01 +02:00
hajdul88
da40365932 ruff formatting 2025-08-13 15:15:39 +02:00
hajdul88
68327d3ab9 chore: Changing base classes for exceptions that were already defined 2025-08-13 15:14:43 +02:00
hajdul88
59c9204a74 Update exceptions.py 2025-08-13 15:03:44 +02:00
hajdul88
fabbd638a4 chore: renaming error 2025-08-13 15:03:12 +02:00
hajdul88
d1bfeaa0f2 fix: fixes search unit test error expectation 2025-08-13 15:00:25 +02:00
hajdul88
885f7c3f99 chore: fixing graph elements tests 2025-08-13 14:58:56 +02:00
hajdul88
544e08930b feat: removing invalidValueErrors 2025-08-13 14:42:57 +02:00
hajdul88
38329da0e8
Merge branch 'dev' into feature/cog-2717-add-better-error-management-to-cognee 2025-08-13 14:11:56 +02:00
hajdul88
bed523a36b feat: api error handling restruct 2025-08-13 13:59:12 +02:00
Igor Ilic
beea2f5e0a
Incremental loading migration (#1238)
<!-- .github/pull_request_template.md -->

## Description
Add relational db migration for incremental loading, change incremental
loading to work document per document instead of async together

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-08-13 07:58:09 -04:00
hajdul88
32996aa0d0 feat: adds new error classes to llm and databases + introduces loglevel and logging from child error 2025-08-13 13:40:50 +02:00
hajdul88
6dcd59c73c feat: Adds changes to cognee graph part 2025-08-13 13:07:04 +02:00
hajdul88
91b9c11cd0 changes base class for vectordb exceptions 2025-08-13 12:39:34 +02:00
hajdul88
9fb9f68c42 adds new base errors to retrieval exceptions 2025-08-13 12:36:31 +02:00
hajdul88
5bc00f1143 feat: adds new search classes to search.py 2025-08-13 12:29:35 +02:00
hajdul88
657c775cbe feat: adds configattributeerror 2025-08-13 12:22:03 +02:00
hajdul88
ebd4403c2f adds new error classes to keywordextration error and defines new error 2025-08-13 12:14:42 +02:00
hajdul88
6870bba5a9 feat: adds new error to delete 2025-08-13 12:03:18 +02:00
hajdul88
7bd2660d08 feat: setting base classes of data exceptions to the new ones 2025-08-13 11:58:32 +02:00
hajdul88
623148ec6a feat: adds new errors to litellm client 2025-08-13 11:53:29 +02:00
hajdul88
b40dbf3c68 feat: adds new error classes to litellm instructor 2025-08-13 11:50:24 +02:00
hajdul88
1b3898dd8b feat: updates rel_db exceptions with the new error classes 2025-08-13 11:38:38 +02:00
hajdul88
0555dd9dda Update __init__.py 2025-08-13 11:29:16 +02:00
hajdul88
ed555a731d feat: adds new Exception classes 2025-08-13 11:27:45 +02:00
hajdul88
fd9aaf57b1
feature: Adds doctype handling to delete (audio, image, unstructured) (#1239)
<!-- .github/pull_request_template.md -->

## Description
feature: Adds doctype handling to delete (audio, image, unstructured)

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-08-12 19:01:06 +02:00
Vasilije
0c42d19505
Update README.md 2025-08-12 15:38:30 +02:00
Igor Ilic
a75a79f012
Lancedb async lock (#1222)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

---------

Co-authored-by: Vasilije <8619304+Vasilije1990@users.noreply.github.com>
2025-08-12 08:46:15 -04:00
Igor Ilic
c33536685d
fix: Resolve Kuzu S3 issue (#1235)
<!-- .github/pull_request_template.md -->

## Description
Resolve issue with pushing Kuzu DBs to S3

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-08-11 16:29:36 +02:00
Hande
6e7e4506cc
chore: update readme (#1234)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-08-11 11:16:16 +02:00
EricXiao
815d639132
fix: graph visualization access for users with read permissions (#1220)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->
Description
This PR fix graph visualization access for users with read permissions
(https://github.com/topoteretes/cognee/issues/1182)

- Add permission checks for graph visualization endpoints to ensure
users can only access datasets they have permission to view
- Create get_dataset_with_permissions method to validate user access
before returning a dataset
- Remove redundant dataset existence validation in datasets router and
delegate permission checking to graph data retrieval
- Add comprehensive test suite for graph visualization permissions
covering owner access and permission granting scenarios
- Update get_formatted_graph_data() to use dataset owner's ID for
context
## Testing
Tests can be run with:
```bash
pytest -s cognee/tests/test_graph_visualization_permissions.py
```

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

---------

Signed-off-by: EricXiao <taoiaox@gmail.com>
Co-authored-by: Vasilije <8619304+Vasilije1990@users.noreply.github.com>
2025-08-08 20:42:57 +02:00
Vasilije
e3b41e0ed4
fix: Interface fixes (#1206)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

---------

Co-authored-by: Daulet Amirkhanov <damirkhanov01@gmail.com>
2025-08-08 20:41:33 +02:00
Vasilije
f65605b575
fix: Feature/cog 2648 evals update (#1221)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

---------

Co-authored-by: lxobr <122801072+lxobr@users.noreply.github.com>
Co-authored-by: Hande <159312713+hande-k@users.noreply.github.com>
2025-08-08 20:23:09 +02:00