Commit graph

162 commits

Author SHA1 Message Date
Boris
ea879b2882
Merge branch 'main' into COG-698 2024-12-08 14:23:03 +01:00
Boris
9429e5e1f5
Merge branch 'main' into COG-505-data-dataset-model-changes 2024-12-06 12:53:32 +01:00
Boris
0268df298f
Merge branch 'main' into COG-698 2024-12-06 12:14:15 +01:00
Igor Ilic
d254471023 test: Update gh actions so they can run outside of PR to main
Allow github actions to run on PRs that aren't targeting main

Test
2024-12-06 11:09:26 +01:00
Igor Ilic
add6730b9e test: Add testing of dataset data table content
Add testing of dataset data table content

Test COG-505
2024-12-05 19:37:12 +01:00
Igor Ilic
813b76c9c2 test: Add test for text deduplication
Added end to end test for text deduplication

Test COG-505
2024-12-05 19:25:50 +01:00
Vasilije
a96daef469 Bump release version 2024-12-04 19:56:09 +01:00
Vasilije
d2fccc1315 Bump release version 2024-12-04 19:53:33 +01:00
Vasilije
cf51555943 Bump release version 2024-12-04 19:50:25 +01:00
Vasilije
cc43a8c865 Bump release version 2024-12-04 19:48:01 +01:00
Vasilije
f37d96df6e Bump release version 2024-12-04 19:44:34 +01:00
Vasilije
8d1936f022 Bump release version 2024-12-04 19:35:06 +01:00
Vasilije
2df1eb6098 Bump release version 2024-12-04 19:31:14 +01:00
Vasilije
692770c197 Bump release version 2024-12-04 19:28:21 +01:00
Vasilije
54b88448c5 Bump release version 2024-12-04 19:24:20 +01:00
Vasilije
21c7b8eee9 Bump release version 2024-12-04 19:20:48 +01:00
Vasilije
e178d38ec6 Added basic profiling 2024-12-04 18:48:34 +01:00
Vasilije
c2896f3b5b Added basic profiling 2024-12-04 18:45:54 +01:00
Vasilije
d523f71b79 Added basic profiling 2024-12-04 18:42:26 +01:00
Vasilije
32ca751abe Added basic profiling 2024-12-04 18:40:56 +01:00
Vasilije
fa608270bb Added basic profiling 2024-12-04 18:40:07 +01:00
Vasilije
6ab427e0ad Added basic profiling 2024-12-04 18:38:07 +01:00
Vasilije
e2539cd396 Added basic profiling 2024-12-04 18:35:06 +01:00
Vasilije
bdef152dac Added basic profiling 2024-12-04 18:33:05 +01:00
Vasilije
a904b8d1fc Added basic profiling 2024-12-04 18:31:49 +01:00
Vasilije
bba32aac51 Added basic profiling 2024-12-04 18:30:58 +01:00
Vasilije
6171cd71ca Added basic profiling 2024-12-04 18:28:37 +01:00
Vasilije
94688ed340 Added basic profiling 2024-12-04 18:27:46 +01:00
Vasilije
d589255b25 Added basic profiling 2024-12-04 18:24:14 +01:00
Vasilije
df7bbfe3b9 Added basic profiling 2024-12-04 18:22:05 +01:00
Vasilije
7e66d5038e Added basic profiling 2024-12-04 18:20:02 +01:00
Vasilije
a935940d35 Added basic profiling 2024-12-04 18:18:26 +01:00
Vasilije
39c210681a Added basic profiling 2024-12-04 18:17:35 +01:00
Igor Ilic
764c0895df fix: Resolve Milvus connection issue, add config to milvus test, add milvus gh action
Resolved if statement resolution issue regrading api key,
Added vector db config to milvus test,
Added milvus gh action

Fix
2024-12-03 11:13:54 +01:00
Igor Ilic
13b79320b6 fix: Resolve issue with gh actions not installing optional packages
Add install of optional databases packages for database gh actions

Fix COG-595
2024-12-02 14:54:20 +01:00
Igor Ilic
a345471fef test: Add dynamic steps and multimedia example python script testing in github actions
Added dynamic steps and multimedia python example scripts testing in github actions

Test COG-686
2024-11-29 13:51:09 +01:00
Igor Ilic
c7a8d2995b test: Add reusable python example workflow
Add reusable workflow for python examples, add simple example python script test

Test COG-686
2024-11-29 13:42:04 +01:00
Igor Ilic
ea38a0f51b chore: Update all notebook github actions
Update all notebook github actions to use reusable_notebook workflow

Chore COG-686
2024-11-29 12:20:12 +01:00
Igor Ilic
eaf26b5c9e chore: Update github action regrading notebook
Update github action related to jupyter notebook

Chore COG-686
2024-11-29 12:16:28 +01:00
Igor Ilic
ce99936ed5 chore: Test github action
Test notebook github action

Chore COG-686
2024-11-29 12:14:04 +01:00
Igor Ilic
d0d033bf97 chore: Test work of github action when removing label need
Test work of github action when label is not needed

Chore COG-686
2024-11-29 12:06:25 +01:00
Igor Ilic
6e8ca2f0e6 test: Attempt to fix event propagation issue
Trying to resolve issue of propagating github events to reusable workflow

Test COG-686
2024-11-29 12:04:31 +01:00
Igor Ilic
e72a84c1c3 test: Resolve issue with notebook location
Reusable workflows must be in the workflows github folder

Test COG-686
2024-11-29 11:53:26 +01:00
Igor Ilic
d586336596 test: Fix issue with notebook action
Resolve issue with wrongly defined notebook action

Test COG-686
2024-11-29 11:46:20 +01:00
Igor Ilic
a2b4c5b9eb feat: Add reusable workflows for jupyter notebooks
Add reusable workflows for Jupyer notebooks

Feature COG-686
2024-11-29 11:36:20 +01:00
Igor Ilic
97dbede4c4 test: Add fix for telemetry issue in gh actions
Set environment variable of ENV to dev for all jobs in workflows in GH actions
2024-11-25 15:31:32 +01:00
Igor Ilic
38ef3d465f test: Add github action for multimedia notebook
Added github action for multimedia notebook

Test COG-507
2024-11-20 16:25:23 +01:00
0xideas
34e140a41d
Switch to gpt-4o-mini by default (#233)
* Switch to gpt-4o-mini by default

* Add option and make gpt-4o-mini default in frontend

* Run llama index notebook without extra arguments in poetry install

* Install extras for llama_index_notebook run
2024-11-18 17:38:54 +01:00
Igor Ilic
d30adb53f3
Cog 337 llama index support (#186)
* feat: Add support for LlamaIndex Document type

Added support for LlamaIndex Document type

Feature #COG-337

* docs: Add Jupyer Notebook for cognee with llama index document type

Added jupyter notebook which demonstrates cognee with LlamaIndex document type usage

Docs #COG-337

* feat: Add metadata migration from LlamaIndex document type

Allow usage of metadata from LlamaIndex documents

Feature #COG-337

* refactor: Change llama index migration function name

Change name of llama index function

Refactor #COG-337

* chore: Add llama index core dependency

Downgrade needed on tenacity and instructor modules to support llama index

Chore #COG-337

* Feature: Add ingest_data_with_metadata task

Added task that will have access to metadata if data is provided from different data ingestion tools

Feature #COG-337

* docs: Add description on why specific type checking is done

Explained why specific type checking is used instead of isinstance, as isinstace returns True for child classes as well

Docs #COG-337

* fix: Add missing parameter to function call

Added missing parameter to function call

Fix #COG-337

* refactor: Move storing of data from async to sync function

Moved data storing from async to sync

Refactor #COG-337

* refactor: Pretend ingest_data was changes instead of having two tasks

Refactor so ingest_data file was modified instead of having two ingest tasks

Refactor #COG-337

* refactor: Use old name for data ingestion with metadata

Merged new and old data ingestion tasks into one

Refactor #COG-337

* refactor: Return ingest_data and save_data_to_storage Tasks

Returned ingest_data and save_data_to_storage tasks

Refactor #COG-337

* refactor: Return previous ingestion Tasks to add function

Returned previous ignestion tasks to add function

Refactor #COG-337

* fix: Remove dict and use string for search query

Remove dictionary and use string for query in notebook and simple example

Fix COG-337

* refactor: Add changes request in pull request

Added the following changes that were requested in pull request:

Added synchronize label,
Made uniform syntax in if statement in workflow,
fixed instructor dependency,
added llama-index to be optional

Refactor COG-337

* fix: Resolve issue with llama-index being mandatory

Resolve issue with llama-index being mandatory to run cognee

Fix COG-337

* fix: Add install of llama-index to notebook

Removed additional references to llama-index from core cognee lib.
Added llama-index-core install from notebook

Fix COG-337

---------
2024-11-17 11:47:08 +01:00
Leon Luithlen
6f4ba20003 Run integration tests in pipeline 2024-11-12 16:47:28 +01:00