Commit graph

450 commits

Author SHA1 Message Date
Pavel Zorin
7d5d19347a CI: removed unnecessary ulimit 2025-11-07 11:11:05 +01:00
Pavel Zorin
49fbad9ec0 CI: Run release workflow on PR to main 2025-11-06 16:44:43 +01:00
Pavel Zorin
d5caba144c CI: Initial Release test workflow 2025-11-06 16:01:39 +01:00
Vasilije
69c7aa2559
test: add load tests (#1573)
<!-- .github/pull_request_template.md -->

## Description
<!--
Please provide a clear, human-generated description of the changes in
this PR.
DO NOT use AI-generated descriptions. We want to understand your thought
process and reasoning.
-->
Added a load test to out codebase. The test runs N adds of a pdf, then
cognifies them and runs N searches. Cognify and the searches are
measured, with certain constraints on how fast they should be. We can
tweak the values if necessary, these are values for the gpt-5-mini
model.

## Type of Change
<!-- Please check the relevant option -->
- [ ] Bug fix (non-breaking change that fixes an issue)
- [ ] New feature (non-breaking change that adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to change)
- [ ] Documentation update
- [ ] Code refactoring
- [ ] Performance improvement
- [ ] Other (please specify):

## Screenshots/Videos (if applicable)
<!-- Add screenshots or videos to help explain your changes -->

## Pre-submission Checklist
<!-- Please check all boxes that apply before submitting your PR -->
- [ ] **I have tested my changes thoroughly before submitting this PR**
- [ ] **This PR contains minimal changes necessary to address the
issue/feature**
- [ ] My code follows the project's coding standards and style
guidelines
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] I have added necessary documentation (if applicable)
- [ ] All new and existing tests pass
- [ ] I have searched existing PRs to ensure this change hasn't been
submitted already
- [ ] I have linked any relevant issues in the description
- [ ] My commits have clear and descriptive messages

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.

<!-- CURSOR_SUMMARY -->
---

> [!NOTE]
> Introduce a load test for S3 ingest, cognify, and concurrent searches
with timing thresholds, and wire it into CI.
> 
> - **Tests**:
> - Add `cognee/tests/test_load.py` to measure end-to-end load: prunes
data/system, ingests from `s3://cognee-test-load-s3-bucket`, runs
`cognify` then concurrent GRAPH_COMPLETION searches, records timings
across reps, and asserts avg ≤ 8m and each run ≤ 10m.
> - **CI**:
> - Add `test-load` job in `.github/workflows/e2e_tests.yml`: installs
AWS deps, raises file descriptor limit, configures S3/env secrets, and
executes the new load test.
> 
> <sup>Written by [Cursor
Bugbot](https://cursor.com/dashboard?tab=bugbot) for commit
c7598122bb. This will update automatically
on new commits. Configure
[here](https://cursor.com/dashboard?tab=bugbot).</sup>
<!-- /CURSOR_SUMMARY -->
2025-11-06 08:42:01 +01:00
Vasilije
8cc55ac0b2
refactor: Enable multi user mode by default if graph and vector db pr… (#1695)
…oviders support it

<!-- .github/pull_request_template.md -->

## Description
Enable multi user mode by default for supported graph and vector DBs

## Type of Change
<!-- Please check the relevant option -->
- [ ] Bug fix (non-breaking change that fixes an issue)
- [ ] New feature (non-breaking change that adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to change)
- [ ] Documentation update
- [x] Code refactoring
- [ ] Performance improvement
- [ ] Other (please specify):

## Screenshots/Videos (if applicable)
<!-- Add screenshots or videos to help explain your changes -->

## Pre-submission Checklist
<!-- Please check all boxes that apply before submitting your PR -->
- [ ] **I have tested my changes thoroughly before submitting this PR**
- [ ] **This PR contains minimal changes necessary to address the
issue/feature**
- [ ] My code follows the project's coding standards and style
guidelines
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] I have added necessary documentation (if applicable)
- [ ] All new and existing tests pass
- [ ] I have searched existing PRs to ensure this change hasn't been
submitted already
- [ ] I have linked any relevant issues in the description
- [ ] My commits have clear and descriptive messages

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-11-06 08:40:06 +01:00
Vasilije
c7598122bb
Merge branch 'dev' into feature/cog-3165-add-load-tests 2025-11-05 14:49:29 +01:00
Igor Ilic
bee2fe3ba7
feat: Add initial custom pipeline (#1716)
<!-- .github/pull_request_template.md -->

## Description
Add run_custom_pipeline to have a way to execute a custom collection of tasks in Cognee

## Type of Change
<!-- Please check the relevant option -->
- [ ] Bug fix (non-breaking change that fixes an issue)
- [ ] New feature (non-breaking change that adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to change)
- [ ] Documentation update
- [ ] Code refactoring
- [ ] Performance improvement
- [ ] Other (please specify):

## Screenshots/Videos (if applicable)
<!-- Add screenshots or videos to help explain your changes -->

## Pre-submission Checklist
<!-- Please check all boxes that apply before submitting your PR -->
- [ ] **I have tested my changes thoroughly before submitting this PR**
- [ ] **This PR contains minimal changes necessary to address the
issue/feature**
- [ ] My code follows the project's coding standards and style
guidelines
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] I have added necessary documentation (if applicable)
- [ ] All new and existing tests pass
- [ ] I have searched existing PRs to ensure this change hasn't been
submitted already
- [ ] I have linked any relevant issues in the description
- [ ] My commits have clear and descriptive messages

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-11-04 17:58:34 +01:00
Pavel Zorin
e11a8b9a51 CI: Added timeouts for all OS tests 2025-11-04 12:13:48 +01:00
Andrej Milicevic
a7d63df98c test: add extra aws dependency to load test 2025-11-03 18:15:18 +01:00
Andrej Milicevic
eb8df45dab test: increase file descriptor limit on workflow load test 2025-11-03 18:10:19 +01:00
Andrej Milicevic
d0a3bfd39f merged dev into this branch 2025-11-03 17:08:08 +01:00
Pavel Zorin
b8241e58e5 CI: Limit deletion integration tests to 60 minutes 2025-11-03 16:20:03 +01:00
Igor Ilic
baac00923c
Merge branch 'dev' into enable-multi-user-mode-default 2025-11-03 15:57:06 +01:00
Vasilije
8d7c4d5384
CI: (dev)Extract Windows and MacOS tests to separate job (#1715)
<!-- .github/pull_request_template.md -->

## Description
Reduces the amount of macOS and Windows jobs by running these tests only
for the latest python version in the list.
`different-os-tests-basic` runs tests on ubuntu and python `'["3.10.x",
"3.11.x", "3.12.x", "3.13.x"]'`
`different-os-tests-extended` runs windows and macOS tests for python
`3.13.x`.

<img width="255" height="385" alt="Screenshot 2025-10-31 at 12 36 11"
src="https://github.com/user-attachments/assets/73813d69-70a1-40a6-8197-b323ddc7d365"
/>

<!--
Please provide a clear, human-generated description of the changes in
this PR.
DO NOT use AI-generated descriptions. We want to understand your thought
process and reasoning.
-->

## Type of Change
<!-- Please check the relevant option -->
- [ ] Bug fix (non-breaking change that fixes an issue)
- [ ] New feature (non-breaking change that adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to change)
- [ ] Documentation update
- [ ] Code refactoring
- [ ] Performance improvement
- [ ] Other (please specify):

## Screenshots/Videos (if applicable)
<!-- Add screenshots or videos to help explain your changes -->

## Pre-submission Checklist
<!-- Please check all boxes that apply before submitting your PR -->
- [ ] **I have tested my changes thoroughly before submitting this PR**
- [ ] **This PR contains minimal changes necessary to address the
issue/feature**
- [ ] My code follows the project's coding standards and style
guidelines
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] I have added necessary documentation (if applicable)
- [ ] All new and existing tests pass
- [ ] I have searched existing PRs to ensure this change hasn't been
submitted already
- [ ] I have linked any relevant issues in the description
- [ ] My commits have clear and descriptive messages

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin.
2025-11-01 06:50:08 +01:00
Igor Ilic
f368a1a4d5 fix: set tests to not use multi-user mode 2025-10-31 20:10:05 +01:00
Pavel Zorin
737f792ac6 use api/embed for ollama api 2025-10-31 13:43:29 +01:00
Pavel Zorin
5d2d4e51f1 Ollama: Use openAI compatible embeggings API 2025-10-31 13:30:26 +01:00
Pavel Zorin
645bda38e3 chore: Fix Ollama test / update Ollama API usage 2025-10-31 13:23:49 +01:00
Pavel Zorin
a60e53964c
Potential fix for code scanning alert no. 399: Workflow does not contain permissions
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-31 12:37:38 +01:00
Pavel Zorin
b30b52921a Remove trailing whitespaces 2025-10-30 13:08:09 +03:00
Pavel Zorin
e5df629ff3 CI: Extract Windows and MacOS tests to separate job 2025-10-30 12:51:43 +03:00
Vasilije
9865e4c5ec
Merge branch 'dev' into main 2025-10-29 20:34:58 +01:00
Vasilije
7f6f7bbc70
Simplify Docker Buildx setup in workflow
Removed unnecessary buildkitd-flags and provenance options.
2025-10-25 13:40:21 +02:00
Vasilije
f658510255
Change runner group from 'Runners' to 'Default' 2025-10-25 12:51:38 +02:00
vasilije
55d213f17d added a new runner 2025-10-25 12:47:50 +02:00
vasilije
c6c11d4973 added storage check 2025-10-25 12:29:14 +02:00
vasilije
9d497adb24 fixing the docker build 2025-10-25 12:20:49 +02:00
Daulet Amirkhanov
fa54469ea3 fix: remove redundant SDKs to reduce space used on Github Runner 2025-10-24 14:31:14 +01:00
lxobr
aba5f9ba55 test: add e2e feedback enrichment test 2025-10-23 17:09:15 +02:00
Vasilije
d0af7c3274
Merge branch 'dev' into main 2025-10-22 19:58:38 +02:00
hajdul88
22d3c20b90 chore:changes temporal tests llm provider to openai 2025-10-22 18:29:09 +02:00
hajdul88
8e59b1e933
Merge branch 'dev' into fix-baml-ci-tests 2025-10-22 15:00:17 +02:00
Andrej Milicevic
1d1c7d21f7 change model 2025-10-22 14:06:43 +02:00
Andrej Milicevic
bb756a0e19 remove api version 2025-10-22 12:42:23 +02:00
Andrej Milicevic
1ecea0a955 change endpoint 2025-10-22 12:39:31 +02:00
Andrej Milicevic
5f2e9bd84b fix: change baml llm provider 2025-10-22 10:37:37 +02:00
Andrej Milicevic
da05671fd7 test: changed the api key of baml tests 2025-10-22 10:23:34 +02:00
Andrej Milicevic
c5648e6337 test: Add load test. 2025-10-22 09:22:11 +02:00
Daulet Amirkhanov
abbbf88ad3 CI: use scraping dependenies for integration tests 2025-10-21 22:46:50 +01:00
hajdul88
e9c27fe2f2 Revert "Update basic_tests.yml"
This reverts commit 03f4a01499.
2025-10-21 14:47:22 +02:00
hajdul88
6ee8c9719d Revert "chore: changes BAML model to openai"
This reverts commit e64e29f841.
2025-10-21 14:47:18 +02:00
hajdul88
03f4a01499 Update basic_tests.yml 2025-10-21 14:44:47 +02:00
hajdul88
e64e29f841 chore: changes BAML model to openai 2025-10-21 14:40:50 +02:00
hajdul88
7f3be30bb9
Potential fix for code scanning alert no. 379: Workflow does not contain permissions
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-21 14:31:52 +02:00
hajdul88
62c1862748 feat: adds sessions test again 2025-10-21 14:26:53 +02:00
Andrej Milicevic
e8523bf4aa test: Add entity extraction test. Minor checks and fixes. 2025-10-21 13:00:42 +02:00
Andrej Milicevic
f8cb233389 merge conflicts resolved. merging dev into this branch 2025-10-21 11:40:37 +02:00
Igor Ilic
ea14771fd3
Create scorecard.yml 2025-10-20 15:22:01 +02:00
vasilije
a1927548ad added 2025-10-19 14:52:02 +02:00
vasilije
66876daf85 removed docs 2025-10-19 14:38:34 +02:00