modal ollama POC

.coderabbit.yaml

@@ -1,127 +0,0 @@
-# yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json
-# .coderabbit.yaml
-language: en
-early_access: false
-enable_free_tier: true
-reviews:  
-  profile: chill
-  instructions: >-
-    # Code Review Instructions
-
-    - Ensure the code follows best practices and coding standards.
-    - For **Python** code, follow
-      [PEP 20](https://www.python.org/dev/peps/pep-0020/) and
-      [CEP-8](https://gist.github.com/reactive-firewall/b7ee98df9e636a51806e62ef9c4ab161)
-      standards.
-
-    # Documentation Review Instructions
-    - Verify that documentation and comments are clear and comprehensive.
-    - Verify that documentation and comments are free of spelling mistakes.
-
-    # Test Code Review Instructions
-    - Ensure that test code is automated, comprehensive, and follows testing best practices.
-    - Verify that all critical functionality is covered by tests.
-    - Ensure that test code follow
-      [CEP-8](https://gist.github.com/reactive-firewall/d840ee9990e65f302ce2a8d78ebe73f6)
-
-    # Misc.
-    - Confirm that the code meets the project's requirements and objectives.
-    - Confirm that copyright years are up-to date whenever a file is changed.
-  request_changes_workflow: false
-  high_level_summary: true
-  high_level_summary_placeholder: '@coderabbitai summary'
-  auto_title_placeholder: '@coderabbitai'
-  review_status: true
-  poem: false
-  collapse_walkthrough: false
-  sequence_diagrams: false
-  changed_files_summary: true
-  path_filters: ['!*.xc*/**', '!node_modules/**', '!dist/**', '!build/**', '!.git/**', '!venv/**', '!__pycache__/**']
-  path_instructions:
-    - path: README.md
-      instructions: >-
-        1. Consider the file 'README.md' the overview/introduction of the project.
-           Also consider the 'README.md' file the first place to look for project documentation.
-
-        2. When reviewing the file 'README.md' it should be linted with help
-           from the tools `markdownlint` and `languagetool`, pointing out any issues.
-
-        3. You may assume the file 'README.md' will contain GitHub flavor Markdown.
-    - path: '**/*.py'
-      instructions: >-
-        When reviewing Python code for this project:
-
-        1. Prioritize portability over clarity, especially when dealing with cross-Python compatibility. However, with the priority in mind, do still consider improvements to clarity when relevant.
-
-        2. As a general guideline, consider the code style advocated in the PEP 8 standard (excluding the use of spaces for indentation) and evaluate suggested changes for code style compliance.
-
-        3. As a style convention, consider the code style advocated in [CEP-8](https://gist.github.com/reactive-firewall/b7ee98df9e636a51806e62ef9c4ab161) and evaluate suggested changes for code style compliance.
-
-        4. As a general guideline, try to provide any relevant, official, and supporting documentation links to any tool's suggestions in review comments. This guideline is important for posterity.
-
-        5. As a general rule, undocumented function definitions and class definitions in the project's Python code are assumed incomplete. Please consider suggesting a short summary of the code for any of these incomplete definitions as docstrings when reviewing.
-    - path: cognee/tests/*
-      instructions: >-
-        When reviewing test code:
-
-        1. Prioritize portability over clarity, especially when dealing with cross-Python compatibility. However, with the priority in mind, do still consider improvements to clarity when relevant.
-
-        2. As a general guideline, consider the code style advocated in the PEP 8 standard (excluding the use of spaces for indentation) and evaluate suggested changes for code style compliance.
-
-        3. As a style convention, consider the code style advocated in [CEP-8](https://gist.github.com/reactive-firewall/b7ee98df9e636a51806e62ef9c4ab161) and evaluate suggested changes for code style compliance, pointing out any violations discovered.
-
-        4. As a general guideline, try to provide any relevant, official, and supporting documentation links to any tool's suggestions in review comments. This guideline is important for posterity.
-
-        5. As a project rule, Python source files with names prefixed by the string "test_" and located in the project's "tests" directory are the project's unit-testing code. It is safe, albeit a heuristic, to assume these are considered part of the project's minimal acceptance testing unless a justifying exception to this assumption is documented.
-
-        6. As a project rule, any files without extensions and with names prefixed by either the string "check_" or the string "test_", and located in the project's "tests" directory, are the project's non-unit test code. "Non-unit test" in this context refers to any type of testing other than unit testing, such as (but not limited to) functional testing, style linting, regression testing, etc. It can also be assumed that non-unit testing code is usually written as Bash shell scripts.
-    - path: requirements.txt
-      instructions: >-
-        * The project's own Python dependencies are recorded in 'requirements.txt' for production code.
-
-        * The project's testing-specific Python dependencies are recorded in 'tests/requirements.txt' and are used for testing the project.
-
-        * The project's documentation-specific Python dependencies are recorded in 'docs/requirements.txt' and are used only for generating Python-focused documentation for the project. 'docs/requirements.txt' may be absent if not applicable.
-
-        Consider these 'requirements.txt' files the records of truth regarding project dependencies.
-    - path: .github/**
-      instructions: >-
-        * When the project is hosted on GitHub: All GitHub-specific configurations, templates, and tools should be found in the '.github' directory tree.
-
-        * 'actionlint' erroneously generates false positives when dealing with GitHub's `${{ ... }}` syntax in conditionals.
-
-        * 'actionlint' erroneously generates incorrect solutions when suggesting the removal of valid `${{ ... }}` syntax.
-  abort_on_close: true
-  auto_review:
-    enabled: true
-    auto_incremental_review: true
-    ignore_title_keywords: []
-    labels: []
-    drafts: false
-    base_branches:
-      - dev
-      - main
-  tools:
-    shellcheck:
-      enabled: true
-    ruff:
-      enabled: true
-      configuration:
-        extend_select:
-          - E  # Pycodestyle errors (style issues)
-          - F  # PyFlakes codes (logical errors)
-          - W  # Pycodestyle warnings
-          - N  # PEP 8 naming conventions
-        ignore:
-          - W191
-          - W391
-          - E117
-          - D208
-        line_length: 100
-        dummy_variable_rgx: '^(_.*|junk|extra)$'  # Variables starting with '_' or named 'junk' or 'extras', are considered dummy variables        
-    markdownlint:
-      enabled: true
-    yamllint:
-      enabled: true
-chat:
-  auto_reply: true

.data/code/example.txt

@@ -0,0 +1,28 @@
+'''
+	Given a string, find the length of the longest substring without repeating characters.
+
+	Examples:
+
+	Given "abcabcbb", the answer is "abc", which the length is 3.
+
+	Given "bbbbb", the answer is "b", with the length of 1.
+
+	Given "pwwkew", the answer is "wke", with the length of 3. Note that the answer must be a substring, "pwke" is a subsequence and not a substring.
+'''
+
+class Solution(object):
+    def lengthOfLongestSubstring(self, s):
+        """
+        :type s: str
+        :rtype: int
+        """
+        mapSet = {}
+        start, result = 0, 0
+
+        for end in range(len(s)):
+        	if s[end] in mapSet:
+        		start = max(mapSet[s[end]], start)
+        	result = max(result, end-start+1)
+        	mapSet[s[end]] = end+1
+
+        return result

.dlt/config.toml

@@ -0,0 +1,6 @@
+# put your configuration values here
+
+[runtime]
+log_level = "WARNING"  # the system log level of dlt
+# use the dlthub_telemetry setting to enable/disable anonymous usage data reporting, see https://dlthub.com/docs/telemetry
+dlthub_telemetry = false

.env.template

@@ -1,300 +1,49 @@
-###############################################################################
-# NOTE: With default settings Cognee only needs an OpenAI LLM_API_KEY to be set.
-#       The rest of the settings don't have to be set.
-#       Default relational database: SQLite
-#       Default vector database   : LanceDB
-#       Default graph database    : Kuzu
-#
-#       These default databases are all file-based, so no extra setup is needed
-#       for local use. The data by default will be stored in your .venv
-###############################################################################
+ENV="local"
+TOKENIZERS_PARALLELISM="false"
 
-################################################################################
-#  🧠 LLM Settings
-################################################################################
-# Currently we support BAML and Instructor(using litellm) for structured outputs
-STRUCTURED_OUTPUT_FRAMEWORK="instructor"
-
-LLM_API_KEY="your_api_key"
-LLM_MODEL="openai/gpt-5-mini"
+# LLM Configuration
+LLM_API_KEY=""
+LLM_MODEL="openai/gpt-4o-mini"
 LLM_PROVIDER="openai"
 LLM_ENDPOINT=""
 LLM_API_VERSION=""
 LLM_MAX_TOKENS="16384"
-# Instructor's modes determine how structured data is requested from and extracted from LLM responses
-# You can change this type (i.e. mode) via this env variable
-# Each LLM has its own default value, e.g. gpt-5 models have "json_schema_mode"
-LLM_INSTRUCTOR_MODE=""
 
+GRAPHISTRY_USERNAME=
+GRAPHISTRY_PASSWORD=
+
+SENTRY_REPORTING_URL=
+
+# Embedding Configuration
 EMBEDDING_PROVIDER="openai"
+EMBEDDING_API_KEY=""
 EMBEDDING_MODEL="openai/text-embedding-3-large"
 EMBEDDING_ENDPOINT=""
 EMBEDDING_API_VERSION=""
 EMBEDDING_DIMENSIONS=3072
 EMBEDDING_MAX_TOKENS=8191
-EMBEDDING_BATCH_SIZE=36
-# If embedding key is not provided same key set for LLM_API_KEY will be used
-#EMBEDDING_API_KEY="your_api_key"
 
+# "neo4j", "networkx" or "kuzu"
+GRAPH_DATABASE_PROVIDER="networkx"
+# Only needed if using neo4j
+GRAPH_DATABASE_URL=
+GRAPH_DATABASE_USERNAME=
+GRAPH_DATABASE_PASSWORD=
 
-# If using BAML structured output these env variables will be used
-BAML_LLM_PROVIDER=openai
-BAML_LLM_MODEL="gpt-5-mini"
-BAML_LLM_ENDPOINT=""
-BAML_LLM_API_KEY="your_api_key"
-BAML_LLM_API_VERSION=""
-
-
-################################################################################
-#  📂 ROOT DIRECTORY FOR DATABASES
-################################################################################
-# Set up the Cognee system directory. Cognee will store system files and databases here.
-# Useful for setting root directory inside docker and also to avoid storing the databases in .venv
-# DATA_ROOT_DIRECTORY='/Users/<user>/Desktop/cognee/.cognee_data/'
-# SYSTEM_ROOT_DIRECTORY='/Users/<user>/Desktop/cognee/.cognee_system/'
-
-################################################################################
-# ☁️ Storage Backend Settings
-################################################################################
-# Configure storage backend (local filesystem or S3)
-# STORAGE_BACKEND="local"  # Default: uses local filesystem
-#
-# -- To switch to S3 storage, uncomment and fill these: ---------------------
-# STORAGE_BACKEND="s3"
-# STORAGE_BUCKET_NAME="your-bucket-name"
-# AWS_REGION="us-east-1"
-# AWS_ACCESS_KEY_ID="your-access-key"
-# AWS_SECRET_ACCESS_KEY="your-secret-key"
-#
-# -- S3 Root Directories (optional) -----------------------------------------
-# DATA_ROOT_DIRECTORY="s3://your-bucket/cognee/data"
-# SYSTEM_ROOT_DIRECTORY="s3://your-bucket/cognee/system"
-#
-# -- Cache Directory (auto-configured for S3) -------------------------------
-# When STORAGE_BACKEND=s3, cache automatically uses S3: s3://BUCKET/cognee/cache
-# To override the automatic S3 cache location, uncomment:
-# CACHE_ROOT_DIRECTORY="s3://your-bucket/cognee/cache"
-
-################################################################################
-# 🗄️ Relational database settings
-################################################################################
-
-DB_PROVIDER="sqlite"
-DB_NAME=cognee_db
-
-# -- To switch to Postgres / PGVector, uncomment and fill these: -------------
-#DB_PROVIDER=postgres
-#DB_NAME=cognee_db
-# To use Postgres with the Cognee backend in Docker compose use the following instead: DB_HOST=host.docker.internal
-#DB_HOST=127.0.0.1
-#DB_PORT=5432
-#DB_USERNAME=cognee
-#DB_PASSWORD=cognee
-
-################################################################################
-# 🕸️ Graph Database settings
-################################################################################
-
-# Default (local file-based)
-GRAPH_DATABASE_PROVIDER="kuzu"
-# Handler for multi-user access control mode, it handles how should the mapping/creation of separate DBs be handled per Cognee dataset
-GRAPH_DATASET_DATABASE_HANDLER="kuzu"
-
-# -- To switch to Remote Kuzu uncomment and fill these: -------------------------------------------------------------
-#GRAPH_DATABASE_PROVIDER="kuzu"
-#GRAPH_DATABASE_PROVIDER="kuzu-remote"
-#GRAPH_DATABASE_URL="http://localhost:8000"
-#GRAPH_DATABASE_USERNAME=XXX
-#GRAPH_DATABASE_PASSWORD=YYY
-
-# -- To switch to Neo4j uncomment and fill these: -------------------------------------------------------------------
-#GRAPH_DATABASE_PROVIDER="neo4j"
-#GRAPH_DATABASE_URL=bolt://localhost:7687
-#GRAPH_DATABASE_NAME="neo4j"
-#GRAPH_DATABASE_USERNAME=neo4j
-#GRAPH_DATABASE_PASSWORD=localneo4j
-
-################################################################################
-#  📐 Vector Database settings
-################################################################################
-
-# Supported providers: pgvector | qdrant | weaviate | milvus | lancedb | chromadb
+# "qdrant", "pgvector", "weaviate", "milvus", "lancedb" or "chromadb"
 VECTOR_DB_PROVIDER="lancedb"
-# Not needed if a cloud vector database is not used
+# Not needed if using "lancedb" or "pgvector"
 VECTOR_DB_URL=
 VECTOR_DB_KEY=
-# Handler for multi-user access control mode, it handles how should the mapping/creation of separate DBs be handled per Cognee dataset
-VECTOR_DATASET_DATABASE_HANDLER="lancedb"
 
-################################################################################
-# 🧩 Ontology resolver settings
-################################################################################
+# Relational Database provider "sqlite" or "postgres"
+DB_PROVIDER="sqlite"
 
-# -- Ontology resolver params --------------------------------------
-# ONTOLOGY_RESOLVER=rdflib  # Default: uses rdflib and owl file to read ontology structures
-# MATCHING_STRATEGY=fuzzy # Default: uses fuzzy matching with 80% similarity threshold
-# ONTOLOGY_FILE_PATH=YOUR_FULL_FULE_PATH # Default: empty
-# To add ontology resolvers, either set them as it is set in ontology_example or add full_path and settings as envs.
+# Database name
+DB_NAME=cognee_db
 
-################################################################################
-#  🔄  MIGRATION (RELATIONAL → GRAPH) SETTINGS
-################################################################################
-
-MIGRATION_DB_PATH="/path/to/migration/directory"
-MIGRATION_DB_NAME="migration_database.sqlite"
-MIGRATION_DB_PROVIDER="sqlite"
-
-# -- Postgres-specific migration params --------------------------------------
-# MIGRATION_DB_USERNAME=cognee
-# MIGRATION_DB_PASSWORD=cognee
-# MIGRATION_DB_HOST="127.0.0.1"
-# MIGRATION_DB_PORT=5432
-
-################################################################################
-# 🔒 Security Settings
-################################################################################
-
-# When set to false don't allow adding of local system files to Cognee. Should be set to False when Cognee is used as a backend.
-ACCEPT_LOCAL_FILE_PATH=True
-
-# When set to false don't allow HTTP requests to be sent from Cognee.
-# This protects against Server Side Request Forgery when proper infrastructure is not in place.
-ALLOW_HTTP_REQUESTS=True
-
-# When set to false don't allow cypher search to be used in Cognee.
-ALLOW_CYPHER_QUERY=True
-
-# When set to False errors during data processing will be returned as info but not raised to allow handling of faulty documents
-RAISE_INCREMENTAL_LOADING_ERRORS=True
-
-# When set to True, the Cognee backend will require authentication for requests to the API.
-# If you're disabling this, make sure to also disable ENABLE_BACKEND_ACCESS_CONTROL.
-REQUIRE_AUTHENTICATION=False
-
-# Set this variable to True to enforce usage of backend access control for Cognee
-# Note: This is only currently supported by the following databases:
-#       Relational: SQLite, Postgres
-#       Vector: LanceDB
-#       Graph: KuzuDB
-#
-# It enforces creation of databases per Cognee user + dataset. Does not work with some graph and database providers.
-# Disable mode when using not supported graph/vector databases.
-ENABLE_BACKEND_ACCESS_CONTROL=True
-
-################################################################################
-# ☁️ Cloud Sync Settings
-################################################################################
-
-# Cognee Cloud API settings for syncing data to/from cloud infrastructure
-COGNEE_CLOUD_API_URL="http://localhost:8001"
-COGNEE_CLOUD_AUTH_TOKEN="your-api-key"
-
-################################################################################
-# UI Settings
-################################################################################
-
-# URL where the frontend is served, defaults to http://localhost:3000
-UI_APP_URL=http://localhost:3000
-
-################################################################################
-#  🛠️ DEV Settings
-################################################################################
-
-ENV="local"
-
-TOKENIZERS_PARALLELISM="false"
-
-# LITELLM Logging Level. Set to quiet down logging
-LITELLM_LOG="ERROR"
-
-# Set this environment variable to disable sending telemetry data
-# TELEMETRY_DISABLED=1
-
-# Default User Configuration
-# DEFAULT_USER_EMAIL=""
-# DEFAULT_USER_PASSWORD=""
-
-################################################################################
-#  📂 AWS Settings
-################################################################################
-
-#AWS_REGION=""
-#AWS_ENDPOINT_URL=""
-#AWS_ACCESS_KEY_ID=""
-#AWS_SECRET_ACCESS_KEY=""
-#AWS_SESSION_TOKEN=""
-
-------------------------------- END OF POSSIBLE SETTINGS -------------------------------
-
-
-###############################################################################
-# 🧪  EXAMPLE OVERRIDES (commented out)
-###############################################################################
-# The blocks below show how to configure alternative providers.
-# Uncomment + fill values to switch.
-
-########## Azure OpenAI #######################################################
-#LLM_MODEL="azure/gpt-5-mini"
-#LLM_ENDPOINT="https://DNS.azure.com/openai/deployments/gpt-5-mini"
-#LLM_API_KEY="<<TALK TO YOUR AZURE GUY"
-#LLM_API_VERSION="2024-12-01-preview"
-
-## llm api version might not be relevant
-#LLM_MAX_TOKENS="16384"
-
-#EMBEDDING_MODEL="azure/text-embedding-3-large"
-#EMBEDDING_ENDPOINT="https://DNS.openai.azure.com/openai/deployments/text-embedding-3-large"
-#EMBEDDING_API_KEY="<<TALK TO YOUR AZURE GUY>"
-#EMBEDDING_API_VERSION="2024-12-01-preview"
-#EMBEDDING_DIMENSIONS=3072
-#EMBEDDING_MAX_TOKENS=8191
-
-########## Local LLM via Ollama ###############################################
-
-
-#LLM_API_KEY ="ollama"
-#LLM_MODEL="llama3.1:8b"
-#LLM_PROVIDER="ollama"
-#LLM_ENDPOINT="http://localhost:11434/v1"
-#EMBEDDING_PROVIDER="ollama"
-#EMBEDDING_MODEL="nomic-embed-text:latest"
-#EMBEDDING_ENDPOINT="http://localhost:11434/api/embed"
-#EMBEDDING_DIMENSIONS=768
-#HUGGINGFACE_TOKENIZER="nomic-ai/nomic-embed-text-v1.5"
-
-########## OpenRouter (also free) #########################################################
-
-#LLM_API_KEY="<<go-get-one-yourself"
-#LLM_PROVIDER="custom"
-#LLM_MODEL="openrouter/google/gemini-2.0-flash-lite-preview-02-05:free"
-#LLM_ENDPOINT="https://openrouter.ai/api/v1"
-
-########## DeepInfra ##########################################################
-
-#LLM_API_KEY="<<>>"
-#LLM_PROVIDER="custom"
-#LLM_MODEL="deepinfra/meta-llama/Meta-Llama-3-8B-Instruct"
-#LLM_ENDPOINT="https://api.deepinfra.com/v1/openai"
-
-#EMBEDDING_PROVIDER="openai"
-#EMBEDDING_API_KEY="<<>>"
-#EMBEDDING_MODEL="deepinfra/BAAI/bge-base-en-v1.5"
-#EMBEDDING_ENDPOINT=""
-#EMBEDDING_API_VERSION=""
-#EMBEDDING_DIMENSIONS=3072
-#EMBEDDING_MAX_TOKENS=8191
-
-
-########## Release Test ###############################################
-
-#LLM_API_KEY="..."
-
-#OPENAI_API_KEY="..."
-
-#MIGRATION_DB_PATH="~/Downloads/"
-#MIGRATION_DB_NAME="Chinook_Sqlite.sqlite"
-#MIGRATION_DB_PROVIDER="sqlite"
-
-#GRAPH_DATABASE_URL="bolt://54.246.89.112:7687"
-#GRAPH_DATABASE_USERNAME="neo4j"
-#GRAPH_DATABASE_PASSWORD="pleaseletmein"
+# Postgres specific parameters (Only if Postgres or PGVector is used). Do not use for cognee default simplest setup of SQLite-NetworkX-LanceDB
+# DB_HOST=127.0.0.1
+# DB_PORT=5432
+# DB_USERNAME=cognee
+# DB_PASSWORD=cognee

.gitattributes

@@ -1,2 +0,0 @@
-# ignore jupyter notebooks in the language bar on github
-notebooks/** linguist-vendored

.gitguardian.yml

@@ -1,31 +0,0 @@
-# .gitguardian.yml
-version: v1
-
-secret-scan:
-  # Ignore specific files
-  excluded-paths:
-    - '.env.template'
-    - '.github/workflows/*.yml'
-    - 'examples/**'
-    - 'tests/**'
-
-  # Ignore specific patterns
-  excluded-detectors:
-    - 'Generic Password'
-    - 'Generic High Entropy Secret'
-
-  # Ignore by commit (if needed)
-  excluded-commits:
-    - '782bbb4'
-    - 'f857e07'
-
-  # Custom rules for template files
-  paths-ignore:
-    - path: '.env.template'
-      comment: 'Template file with placeholder values'
-    - path: '.github/workflows/search_db_tests.yml'
-      comment: 'Test workflow with test credentials'
-    - path: 'docker-compose.yml'
-      comment: 'Development docker compose with test credentials (neo4j/pleaseletmein, postgres cognee/cognee)'
-    - path: 'deployment/helm/docker-compose-helm.yml'
-      comment: 'Helm deployment docker compose with test postgres credentials (cognee/cognee)'

.github/ISSUE_TEMPLATE/bug_report.yml

@@ -1,97 +0,0 @@
-name: 🐛 Bug Report
-description: Report a bug or unexpected behavior
-title: "[Bug]: "
-labels: ["bug", "needs-triage"]
-assignees: []
-body:
-  - type: markdown
-    attributes:
-      value: |
-        Thanks for taking the time to fill out this bug report! Please provide a clear and detailed description.
-        
-  - type: textarea
-    id: description
-    attributes:
-      label: Bug Description
-      description: Please provide a clear and concise description of the bug. What happened vs what you expected?
-      placeholder: Describe the bug in detail...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: reproduction
-    attributes:
-      label: Steps to Reproduce
-      description: Please provide detailed steps to reproduce the issue
-      placeholder: |
-        1. Go to...
-        2. Click on...
-        3. See error...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: expected
-    attributes:
-      label: Expected Behavior
-      description: What did you expect to happen?
-      placeholder: Describe what you expected...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: actual
-    attributes:
-      label: Actual Behavior
-      description: What actually happened?
-      placeholder: Describe what actually happened...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: environment
-    attributes:
-      label: Environment
-      description: Please provide your environment details
-      placeholder: |
-        - OS: [e.g. macOS 13.0, Ubuntu 20.04]
-        - Python version: [e.g. 3.9.0]
-        - Cognee version: [e.g. 0.1.0]
-        - LLM Provider: [e.g. OpenAI, Ollama]
-        - Database: [e.g. Neo4j]
-    validations:
-      required: true
-      
-  - type: textarea
-    id: logs
-    attributes:
-      label: Logs/Error Messages
-      description: Please include any relevant logs or error messages
-      placeholder: Paste logs here...
-      render: shell
-    validations:
-      required: false
-      
-  - type: textarea
-    id: additional
-    attributes:
-      label: Additional Context
-      description: Add any other context about the problem here
-      placeholder: Any additional information...
-    validations:
-      required: false
-      
-  - type: checkboxes
-    id: checklist
-    attributes:
-      label: Pre-submission Checklist
-      description: Please confirm the following before submitting
-      options:
-        - label: I have searched existing issues to ensure this bug hasn't been reported already
-          required: true
-        - label: I have provided a clear and detailed description of the bug
-          required: true
-        - label: I have included steps to reproduce the issue
-          required: true
-        - label: I have included my environment details
-          required: true

.github/ISSUE_TEMPLATE/config.yml

@@ -1,8 +0,0 @@
-blank_issues_enabled: false
-contact_links:
-  - name: 💬 Discord Community
-    url: https://discord.gg/NQtRemgQVD
-    about: Join our Discord community for questions, discussions, and support
-  - name: 📖 Documentation
-    url: https://docs.cognee.ai
-    about: Check our documentation for guides and API references

.github/ISSUE_TEMPLATE/documentation.yml

@@ -1,74 +0,0 @@
-name: 📚 Documentation Issue
-description: Report an issue with documentation or suggest documentation improvements
-title: "[Docs]: "
-labels: ["documentation", "needs-triage"]
-assignees: []
-body:
-  - type: markdown
-    attributes:
-      value: |
-        Thanks for helping improve our documentation! Please provide details about the documentation issue or improvement.
-        
-  - type: dropdown
-    id: doc-type
-    attributes:
-      label: Documentation Type
-      description: What type of documentation issue is this?
-      options:
-        - Missing documentation
-        - Incorrect documentation
-        - Unclear documentation
-        - Documentation improvement
-        - New documentation request
-    validations:
-      required: true
-      
-  - type: textarea
-    id: location
-    attributes:
-      label: Documentation Location
-      description: Where is the documentation issue located? (URL, file path, section, etc.)
-      placeholder: https://cognee.ai/docs/... or specific file/section
-    validations:
-      required: true
-      
-  - type: textarea
-    id: issue
-    attributes:
-      label: Issue Description
-      description: Please describe the documentation issue or improvement needed
-      placeholder: The documentation is unclear about...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: suggestion
-    attributes:
-      label: Suggested Improvement
-      description: How would you improve this documentation?
-      placeholder: I suggest changing this to...
-    validations:
-      required: false
-      
-  - type: textarea
-    id: additional
-    attributes:
-      label: Additional Context
-      description: Add any other context about the documentation issue
-      placeholder: Additional context...
-    validations:
-      required: false
-      
-  - type: checkboxes
-    id: checklist
-    attributes:
-      label: Pre-submission Checklist
-      description: Please confirm the following before submitting
-      options:
-        - label: I have searched existing issues to ensure this documentation issue hasn't been reported already
-          required: true
-        - label: I have provided a clear description of the documentation issue
-          required: true
-        - label: I have specified the location of the documentation issue
-          required: true
-

.github/ISSUE_TEMPLATE/feature_request.yml

@@ -1,78 +0,0 @@
-name: 🚀 Feature Request
-description: Suggest a new feature or enhancement
-title: "[Feature]: "
-labels: ["enhancement", "needs-triage"]
-assignees: []
-body:
-  - type: markdown
-    attributes:
-      value: |
-        Thanks for suggesting a new feature! Please provide a clear and detailed description of your idea.
-        
-  - type: textarea
-    id: problem
-    attributes:
-      label: Problem Statement
-      description: Is your feature request related to a problem? Please describe the problem you're trying to solve.
-      placeholder: I'm always frustrated when...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: solution
-    attributes:
-      label: Proposed Solution
-      description: Describe the solution you'd like to see implemented
-      placeholder: I would like to see...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: alternatives
-    attributes:
-      label: Alternatives Considered
-      description: Describe any alternative solutions or features you've considered
-      placeholder: I have also considered...
-    validations:
-      required: false
-      
-  - type: textarea
-    id: use-case
-    attributes:
-      label: Use Case
-      description: Describe your specific use case and how this feature would help
-      placeholder: This feature would help me...
-    validations:
-      required: true
-      
-  - type: textarea
-    id: implementation
-    attributes:
-      label: Implementation Ideas
-      description: If you have ideas about how this could be implemented, please share them
-      placeholder: This could be implemented by...
-    validations:
-      required: false
-      
-  - type: textarea
-    id: additional
-    attributes:
-      label: Additional Context
-      description: Add any other context, screenshots, or examples about the feature request
-      placeholder: Additional context...
-    validations:
-      required: false
-      
-  - type: checkboxes
-    id: checklist
-    attributes:
-      label: Pre-submission Checklist
-      description: Please confirm the following before submitting
-      options:
-        - label: I have searched existing issues to ensure this feature hasn't been requested already
-          required: true
-        - label: I have provided a clear problem statement and proposed solution
-          required: true
-        - label: I have described my specific use case
-          required: true
-

.github/README_WORKFLOW_MIGRATION.md

@@ -1,97 +0,0 @@
-# Workflow Migration to Test Suites
-
-This document explains how to ensure all test workflows are only run through the central test-suites.yml workflow.
-
-## Why Migrate to Test Suites?
-
-1. **Prevent Duplicate Runs**: Avoid running the same tests multiple times
-2. **Sequential Execution**: Ensure tests run in the correct order
-3. **Centralized Control**: Manage all tests from a single place
-4. **Resource Efficiency**: Run tests only when needed
-
-## Automated Migration
-
-We've provided a script to automatically convert individual workflows to only run when called by the test-suites.yml file:
-
-```bash
-# Make the script executable
-chmod +x .github/workflows/disable_independent_workflows.sh
-
-# Run the script
-.github/workflows/disable_independent_workflows.sh
-```
-
-## Manual Migration
-
-For each workflow file that should only run through test-suites.yml:
-
-1. Open the workflow file
-2. Find the `on:` section, which typically looks like:
-   ```yaml
-   on:
-     workflow_dispatch:
-     pull_request:
-       types: [labeled, synchronize]
-   ```
-
-3. Replace it with:
-   ```yaml
-   on:
-     workflow_call:
-       secrets:
-         inherit: true
-   ```
-
-4. Save the file
-
-## Verification
-
-After modifying the workflows, verify that:
-
-1. The workflows no longer trigger on pushes or PRs
-2. The workflows still run correctly when called by test-suites.yml
-3. No tests are left out of the test-suites.yml orchestrator
-
-## Example Conversion
-
-**Before:**
-```yaml
-name: test | chromadb
-
-on:
-  workflow_dispatch:
-  pull_request:
-    types: [labeled, synchronize]
-
-concurrency:
-  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
-  cancel-in-progress: false
-
-jobs:
-  run_chromadb_integration_test:
-    name: chromadb test
-    runs-on: ubuntu-22.04
-    # ...rest of workflow...
-```
-
-**After:**
-```yaml
-name: test | chromadb
-
-on:
-  workflow_call:
-    secrets:
-      inherit: true
-
-jobs:
-  run_chromadb_integration_test:
-    name: chromadb test
-    runs-on: ubuntu-22.04
-    # ...rest of workflow...
-```
-
-## Special Cases
-
-- **CI/CD Workflows**: Don't modify workflows for CI/CD pipelines like cd.yaml and cd_prd.yaml
-- **Shared Workflows**: Keep reusable_*.yml workflows as they are, since they're already designed to be called by other workflows
-- **Infrastructure Workflows**: Don't modify workflows that handle infrastructure or deployments

.github/actions/cognee_setup/action.yml

@@ -1,54 +0,0 @@
-name: cognee-setup
-description: "Sets up Python, installs uv, and installs dependencies for Cognee."
-
-inputs:
-  python-version:
-    description: "Which Python version to use"
-    required: false
-    default: "3.11.x"
-  extra-dependencies:
-    description: "Additional extra dependencies to install (space-separated)"
-    required: false
-    default: ""
-  rebuild-lockfile:
-    description: "Whether to rebuild the uv lockfile"
-    required: false
-    default: "false"
-
-runs:
-  using: "composite"
-  steps:
-
-    - name: Set up Python
-      uses: actions/setup-python@v5
-      with:
-        python-version: ${{ inputs.python-version }}
-
-    - name: Install uv
-      uses: astral-sh/setup-uv@v4
-      with:
-        enable-cache: true
-
-    - name: Rebuild uv lockfile
-      if: ${{ inputs.rebuild-lockfile == 'true' }}
-      shell: bash
-      run: |
-        rm uv.lock
-        uv lock
-
-    - name: Install dependencies
-      shell: bash
-      run: |
-        EXTRA_ARGS=""
-        if [ -n "${{ inputs.extra-dependencies }}" ]; then
-          IFS=' ' read -r -a deps <<< "${{ inputs.extra-dependencies }}"
-          for extra in "${deps[@]}"; do
-            EXTRA_ARGS="$EXTRA_ARGS --extra $extra"
-          done
-        fi
-        uv sync --extra api --extra docs --extra evals --extra codegraph --extra ollama --extra dev --extra neo4j --extra redis $EXTRA_ARGS
-
-    - name: Add telemetry identifier for telemetry test and in case telemetry is enabled by accident
-      shell: bash
-      run: |
-        echo "test-machine" > .anon_id

.github/actions/setup_neo4j/action.yml

@@ -1,67 +0,0 @@
-name: 'Setup Neo4j with Graph Data Science'
-description: 'Sets up a Neo4j instance with APOC and Graph Data Science plugins for testing'
-inputs:
-  neo4j-version:
-    description: 'Neo4j version to use'
-    required: false
-    default: '5.21'
-  neo4j-password:
-    description: 'Password for Neo4j'
-    required: false
-    default: 'cognee_test_password'
-outputs:
-  neo4j-url:
-    description: 'Neo4j connection URL'
-    value: 'bolt://localhost:7687'
-  neo4j-username:
-    description: 'Neo4j username'
-    value: 'neo4j'
-  neo4j-password:
-    description: 'Neo4j password'
-    value: ${{ inputs.neo4j-password }}
-runs:
-  using: 'composite'
-  steps:
-    - name: Start Neo4j with GDS
-      shell: bash
-      run: |
-        docker run -d \
-          --name neo4j-test \
-          -p 7474:7474 -p 7687:7687 \
-          -e NEO4J_AUTH="neo4j/${{ inputs.neo4j-password }}" \
-          -e NEO4J_PLUGINS='["apoc", "graph-data-science"]' \
-          -e NEO4J_dbms_security_procedures_unrestricted="apoc.*,gds.*" \
-          -e NEO4J_apoc_export_file_enabled=true \
-          -e NEO4J_apoc_import_file_enabled=true \
-          neo4j:${{ inputs.neo4j-version }}
-    
-    - name: Wait for Neo4j to be ready
-      shell: bash
-      run: |
-        echo "Waiting for Neo4j to start..."
-        timeout=60
-        counter=0
-        
-        while [ $counter -lt $timeout ]; do
-          if docker exec neo4j-test cypher-shell -u neo4j -p "${{ inputs.neo4j-password }}" "RETURN 1" > /dev/null 2>&1; then
-            echo "Neo4j is ready!"
-            break
-          fi
-          echo "Waiting... ($counter/$timeout)"
-          sleep 2
-          counter=$((counter + 2))
-        done
-        
-        if [ $counter -ge $timeout ]; then
-          echo "Neo4j failed to start within $timeout seconds"
-          docker logs neo4j-test
-          exit 1
-        fi
-    
-    - name: Verify GDS is available
-      shell: bash
-      run: |
-        echo "Verifying Graph Data Science library is available..."
-        docker exec neo4j-test cypher-shell -u neo4j -p "${{ inputs.neo4j-password }}" \
-          "CALL gds.version() YIELD gdsVersion RETURN gdsVersion"
-        echo "GDS verification complete!"

.github/core-team.txt

@@ -1,12 +0,0 @@
-# Core team GitHub logins (one per line). Lines may begin with @; case-insensitive.
-borisarzentar
-daukadolt
-dexters1
-hajdul88
-hande-k
-lxobr
-pazone
-siillee
-vasilije1990
-
-

.github/pull_request_template.md

@@ -1,43 +1,7 @@
 <!-- .github/pull_request_template.md -->
 
 ## Description
-<!--
-Please provide a clear, human-generated description of the changes in this PR.
-DO NOT use AI-generated descriptions. We want to understand your thought process and reasoning.
--->
-
-## Acceptance Criteria
-<!--
-* Key requirements to the new feature or modification;
-* Proof that the changes work and meet the requirements;
-* Include instructions on how to verify the changes. Describe how to test it locally;
-* Proof that it's sufficiently tested.
--->
-
-## Type of Change
-<!-- Please check the relevant option -->
-- [ ] Bug fix (non-breaking change that fixes an issue)
-- [ ] New feature (non-breaking change that adds functionality)
-- [ ] Breaking change (fix or feature that would cause existing functionality to change)
-- [ ] Documentation update
-- [ ] Code refactoring
-- [ ] Performance improvement
-- [ ] Other (please specify):
-
-## Screenshots/Videos (if applicable)
-<!-- Add screenshots or videos to help explain your changes -->
-
-## Pre-submission Checklist
-<!-- Please check all boxes that apply before submitting your PR -->
-- [ ] **I have tested my changes thoroughly before submitting this PR**
-- [ ] **This PR contains minimal changes necessary to address the issue/feature**
-- [ ] My code follows the project's coding standards and style guidelines
-- [ ] I have added tests that prove my fix is effective or that my feature works
-- [ ] I have added necessary documentation (if applicable)
-- [ ] All new and existing tests pass
-- [ ] I have searched existing PRs to ensure this change hasn't been submitted already
-- [ ] I have linked any relevant issues in the description
-- [ ] My commits have clear and descriptive messages
+<!-- Provide a clear description of the changes in this PR -->
 
 ## DCO Affirmation
-I affirm that all code in every commit of this pull request conforms to the terms of the Topoteretes Developer Certificate of Origin.
+I affirm that all code in every commit of this pull request conforms to the terms of the Topoteretes Developer Certificate of Origin

.github/release-drafter.yml

@@ -1,20 +0,0 @@
-name-template: 'v$NEXT_PATCH_VERSION'
-tag-template: 'v$NEXT_PATCH_VERSION'
-
-categories:
-  - title: 'Features'
-    labels: ['feature', 'enhancement']    
-  - title: 'Bug Fixes'
-    labels: ['bug', 'fix']
-  - title: 'Maintenance'
-    labels: ['chore', 'refactor', 'ci']
-
-change-template: '- $TITLE (#$NUMBER) @$AUTHOR'
-template: |
-  ## What’s Changed
-
-  $CHANGES
-
-  ## Contributors
-
-  $CONTRIBUTORS

.github/workflows/basic_tests.yml

@@ -1,199 +0,0 @@
-name: Reusable Basic Tests
-
-on:
-  workflow_call:
-    inputs:
-      python-version:
-        required: false
-        type: string
-        default: '3.11.x'
-    secrets:
-      LLM_PROVIDER:
-        required: true
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_PROVIDER:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs:
-
-  lint:
-    name: Run Linting
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run Linting
-        uses: astral-sh/ruff-action@v2
-
-  format-check:
-    name: Run Formatting Check
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run Formatting Check
-        uses: astral-sh/ruff-action@v2
-        with:
-          args: "format --check"
-
-  unit-tests:
-    name: Run Unit Tests
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-      EMBEDDING_PROVIDER: openai
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run Unit Tests
-        run: uv run pytest cognee/tests/unit/
-
-  integration-tests:
-    name: Run Integration Tests
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "scraping"
-
-      - name: Run Integration Tests
-        run: uv run pytest cognee/tests/integration/
-
-  simple-examples:
-    name: Run Simple Examples
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-      EMBEDDING_PROVIDER: openai
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run Simple Examples
-        run: uv run python ./examples/python/simple_example.py
-
-  simple-examples-baml:
-    name: Run Simple Examples BAML
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      STRUCTURED_OUTPUT_FRAMEWORK: "BAML"
-      BAML_LLM_PROVIDER: openai
-      BAML_LLM_MODEL: ${{ secrets.OPENAI_MODEL }}
-      BAML_LLM_ENDPOINT: ${{ secrets.OPENAI_ENDPOINT }}
-      BAML_LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-#      BAML_LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-      EMBEDDING_PROVIDER: openai
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "baml"
-
-      - name: Run Simple Examples
-        run: uv run python ./examples/python/simple_example.py

.github/workflows/cd.yaml

@@ -0,0 +1,77 @@
+name: publish dev | Docker image
+
+on:
+  push:
+    branches:
+      - dev
+    paths-ignore:
+      - '**.md'
+      - 'examples/**'
+
+env:
+  AWS_ROLE_DEV_CICD: "arn:aws:iam::463722570299:role/cognee-dev-base-role-github-ci-cd"
+  AWS_ACCOUNT_ID_DEV: "463722570299"
+
+jobs:
+
+  publish_docker_to_ecr:
+    name: Publish Cognee Docker image
+    runs-on: ubuntu-22.04
+    permissions:
+      id-token: write
+      contents: read
+    steps:
+      - name: Checkout code from repo
+        uses: actions/checkout@v4
+
+      - name: Set environment variable for stage
+        id: set-env
+        run: |
+          echo "STAGE=dev" >> $GITHUB_ENV
+          echo "::set-output name=stage::dev"
+
+      - name: Use output
+        run: echo "The stage is ${{ steps.set-env.outputs.stage }}"
+
+      - name: Configure AWS credentials
+        uses: aws-actions/configure-aws-credentials@v4
+        with:
+          role-to-assume: ${{ env.AWS_ROLE_DEV_CICD }}
+          aws-region: eu-west-1
+
+      - name: Build Docker image and push to ECR
+        uses: ./.github/actions/image_builder
+        id: build-cognee-docker-image
+        with:
+          stage: dev
+          aws_account_id: ${{ env.AWS_ACCOUNT_ID_DEV }}
+          should_publish: true
+          ecr_image_repo_name: cognee-dev-backend-cognee-ecr
+          dockerfile_location: ./
+
+      - name: Export Cognee image tag
+        id: export-cognee-image-tag
+        run: |
+          export IMAGE_TAG=$(cat /tmp/.DOCKER_IMAGE_VERSION)
+          echo "Docker tag is: $IMAGE_TAG"
+          echo "cognee_image_tag=$IMAGE_TAG" >> $GITHUB_OUTPUT
+
+    outputs:
+      cognee_image_tag: ${{ steps.export-cognee-image-tag.outputs.cognee_image_tag }}
+
+  trigger_deployment:
+    name: Trigger deployment
+    runs-on: ubuntu-latest
+    needs: publish_docker_to_ecr
+    steps:
+      - name: Trigger deployment in the infrastructure
+        uses: actions/github-script@v7
+        with:
+          github-token: ${{ secrets.PAT_FOR_CROSS_REPOS_CICD_TRIGGERING }}
+          script: |
+            await github.rest.actions.createWorkflowDispatch({
+              owner: 'topoteretes',
+              repo: 'cognee-infra',
+              workflow_id: 'terraform.apply.yml',
+              ref: 'main'
+            })

.github/workflows/cd_prd.yaml

@@ -0,0 +1,106 @@
+name: publish prd | Docker image
+
+on:
+  push:
+    branches:
+        - main
+    paths-ignore:
+      - '**.md'
+      - 'examples/**'
+
+env:
+  AWS_ROLE_DEV_CICD: "arn:aws:iam::463722570299:role/cognee-dev-base-role-github-ci-cd"
+  AWS_ACCOUNT_ID_DEV: "463722570299"
+  ENVIRONMENT: prd
+
+jobs:
+
+  publish_docker_to_ecr:
+    name: Publish Docker PromethAI image
+    runs-on: ubuntu-22.04
+    permissions:
+      id-token: write
+      contents: read
+    steps:
+      - name: Checkout code from repo
+        uses: actions/checkout@v4
+
+      - name: Set environment variable for stage
+        id: set-env
+        run: |
+          if [[ "${{ github.ref }}" == "refs/heads/main" ]]; then
+            echo "STAGE=prd" >> $GITHUB_ENV
+            echo "::set-output name=stage::prd"
+          else
+            echo "STAGE=dev" >> $GITHUB_ENV
+            echo "::set-output name=stage::dev"
+          fi
+
+      - name: Use output
+        run: echo "The stage is ${{ steps.set-env.outputs.stage }}"
+
+      - name: Configure AWS credentials
+        uses: aws-actions/configure-aws-credentials@v4
+        with:
+          role-to-assume: ${{ env.AWS_ROLE_DEV_CICD }}
+          aws-region: eu-west-1
+
+      - name: Build Docker image and push to ECR
+        uses: ./.github/actions/image_builder
+        id: generate-promethai-docker
+        with:
+          stage: prd
+          aws_account_id: ${{ env.AWS_ACCOUNT_ID_DEV }}
+          should_publish: true
+          ecr_image_repo_name: cognee-prd-backend-cognee-ecr
+          dockerfile_location: ./
+
+      - name: Export Docker image tag
+        id: export-cognee-docker-tag
+        run: |
+          export DOCKER_TAG=$(cat /tmp/.DOCKER_IMAGE_VERSION)
+          echo "Docker tag is: $DOCKER_TAG"
+          echo "cognee_image_tag=$DOCKER_TAG" >> $GITHUB_OUTPUT
+
+    #   - name: Create Tag and Release
+    #     runs-on: ubuntu-latest
+    #     uses: actions/checkout@v3
+    #     needs: publish_docker_to_ecr  # ensure this job runs after Docker image is pushed
+    #     steps:
+    #       - name: Check out code
+    #         uses: actions/checkout@v3
+    #       - name: Bump version and push tag
+    #         id: bump_version_and_push_tag
+    #         uses: anothrNick/github-tag-action@1.34.0
+    #         env:
+    #           GITHUB_TOKEN: ${{ secrets.PAT_FOR_CROSS_REPOS_CICD_TRIGGERING }}
+    #           WITH_V: true
+    #           DEFAULT_BUMP: 'minor'  # or 'minor' or 'major'
+    #       - name: Create Release
+    #         id: create_release
+    #         uses: actions/create-release@v1
+    #         env:
+    #           GITHUB_TOKEN: ${{ secrets.PAT_FOR_CROSS_REPOS_CICD_TRIGGERING }}
+    #         with:
+    #           tag_name: ${{ steps.bump_version_and_push_tag.outputs.tag }}
+    #           release_name: Release ${{ steps.bump_version_and_push_tag.outputs.tag }}
+
+    outputs:
+      cognee_image_tag: ${{ steps.export-promethai-docker-tag.outputs.cognee_image_tag }}
+
+  trigger_deployment:
+    name: Trigger deployment
+    runs-on: ubuntu-latest
+    needs: publish_docker_to_ecr
+    steps:
+      - name: TF apply workflow triggers step
+        uses: actions/github-script@v7
+        with:
+          github-token: ${{ secrets.PAT_FOR_CROSS_REPOS_CICD_TRIGGERING }}
+          script: |
+            await github.rest.actions.createWorkflowDispatch({
+              owner: 'topoteretes',
+              repo: 'cognee-infra',
+              workflow_id: 'terraform.apply.yml',
+              ref: 'main'
+            })

.github/workflows/ci.yaml

@@ -1,7 +1,6 @@
 name: build test | Docker image
 
-on:
-  workflow_call:
+on: pull_request
 
 env:
   AWS_ACCOUNT_ID_DEV: "463722570299"
@@ -13,7 +12,7 @@ jobs:
     runs-on: ubuntu-22.04
     steps:
       - name: Check out Cognee code
-        uses: actions/checkout@v4
+        uses: actions/checkout@v3
 
       - name: Build Cognee Docker image
         id: cognee-docker-tag

.github/workflows/cli_tests.yml

@@ -1,149 +0,0 @@
-name: CLI Tests
-
-on:
-  workflow_call:
-    inputs:
-      python-version:
-        required: false
-        type: string
-        default: '3.11.x'
-    secrets:
-      LLM_PROVIDER:
-        required: true
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_PROVIDER:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs:
-  cli-unit-tests:
-    name: CLI Unit Tests
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run CLI Unit Tests
-        run: uv run pytest cognee/tests/cli_tests/cli_unit_tests/ -v
-
-  cli-integration-tests:
-    name: CLI Integration Tests
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run CLI Integration Tests
-        run: uv run pytest cognee/tests/cli_tests/cli_integration_tests/ -v
-
-  cli-functionality-tests:
-    name: CLI Functionality Tests
-    runs-on: ubuntu-22.04
-    env:
-      ENV: 'dev'
-      LLM_PROVIDER: openai
-      LLM_MODEL: ${{ secrets.LLM_MODEL }}
-      LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-      LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-      LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Test CLI Help Commands
-        run: |
-          uv run python -m cognee.cli._cognee --help
-          uv run python -m cognee.cli._cognee --version
-          uv run python -m cognee.cli._cognee add --help
-          uv run python -m cognee.cli._cognee search --help
-          uv run python -m cognee.cli._cognee cognify --help
-          uv run python -m cognee.cli._cognee delete --help
-          uv run python -m cognee.cli._cognee config --help
-
-      - name: Test CLI Config Subcommands
-        run: |
-          uv run python -m cognee.cli._cognee config get --help
-          uv run python -m cognee.cli._cognee config set --help
-          uv run python -m cognee.cli._cognee config list --help
-          uv run python -m cognee.cli._cognee config unset --help
-          uv run python -m cognee.cli._cognee config reset --help
-
-      - name: Test CLI Error Handling
-        run: |
-          # Test invalid command (should fail gracefully)
-          ! uv run python -m cognee.cli._cognee invalid_command
-
-          # Test missing required arguments (should fail gracefully)
-          ! uv run python -m cognee.cli._cognee search
-
-          # Test invalid search type (should fail gracefully)
-          ! uv run python -m cognee.cli._cognee search "test" --query-type INVALID_TYPE
-
-          # Test invalid chunker (should fail gracefully)
-          ! uv run python -m cognee.cli._cognee cognify --chunker InvalidChunker

.github/workflows/community_greetings.yml

@@ -1,14 +1,6 @@
 name: community | Greetings
 
-on:
-  issues:
-    types: [opened]
-  pull_request_target:
-    types: [opened]
-
-permissions:
-  issues: write
-  pull-requests: write
+on: [pull_request, issues]
 
 jobs:
   greeting:

.github/workflows/db_examples_tests.yml

@@ -1,156 +0,0 @@
-name: Reusable DB Examples Tests
-
-on:
-  workflow_call:
-    inputs:
-      databases:
-        required: false
-        type: string
-        default: "all"
-        description: "Which databases to run (comma-separated or 'all')"
-      python-version:
-        required: false
-        type: string
-        default: "3.11.x"
-    secrets:
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-
-      POSTGRES_PASSWORD:
-        required: false
-      NEO4J_API_URL:
-        required: false
-      NEO4J_API_KEY:
-        required: false
-
-
-
-
-jobs:
-  run-db-example-neo4j:
-    name: "Neo4j DB Example Test"
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'neo4j') }}
-    steps:
-      - name: Check out
-        uses: actions/checkout@master
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Run Neo4j Example
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: "neo4j"
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-        run: |
-          uv run python examples/database_examples/neo4j_example.py
-
-  run-db-example-kuzu:
-    name: "Kuzu DB Example Test"
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'kuzu') }}
-
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Kuzu Example
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: "kuzu"
-        run: |
-          uv run python examples/database_examples/kuzu_example.py
-
-  run-db-example-pgvector:
-    name: "PostgreSQL PGVector DB Example Test"
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'postgres') }}
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: ${{ secrets.POSTGRES_PASSWORD }}
-          POSTGRES_DB: cognee_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-            fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "postgres"
-
-      - name: Run PGVector Example
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: |
-          uv run python examples/database_examples/pgvector_example.py

.github/workflows/disable_independent_workflows.sh

@@ -1,84 +0,0 @@
-#!/bin/bash
-
-# Navigate to the workflows directory
-cd "$(dirname "$0")"
-
-# List of workflows that should only be triggered via test-suites.yml
-WORKFLOWS=(
-  "test_chromadb.yml"
-  "test_weaviate.yml"
-  "test_kuzu.yml"
-  "test_multimetric_qa_eval_run.yaml"
-  "test_graphrag_vs_rag_notebook.yml"
-  "test_llms.yml"
-  "test_multimedia_example.yaml"
-  "test_deduplication.yml"
-  "test_eval_framework.yml"
-  "test_descriptive_graph_metrics.yml"
-  "test_llama_index_cognee_integration_notebook.yml"
-  "test_cognee_llama_index_notebook.yml"
-  "test_cognee_multimedia_notebook.yml"
-  "test_cognee_server_start.yml"
-  "test_telemetry.yml"
-  "test_neo4j.yml"
-  "test_pgvector.yml"
-  "test_ollama.yml"
-  "test_notebook.yml"
-  "test_simple_example.yml"
-  "test_code_graph_example.yml"
-)
-
-for workflow in "${WORKFLOWS[@]}"; do
-  if [ -f "$workflow" ]; then
-    echo "Processing $workflow..."
-    
-    # Create a backup
-    cp "$workflow" "${workflow}.bak"
-    
-    # Check if the file begins with a workflow_call trigger
-    if grep -q "workflow_call:" "$workflow"; then
-      echo "$workflow already has workflow_call trigger, skipping..."
-      continue
-    fi
-    
-    # Get the content after the 'on:' section
-    on_line=$(grep -n "^on:" "$workflow" | cut -d ':' -f1)
-    
-    if [ -z "$on_line" ]; then
-      echo "Warning: No 'on:' section found in $workflow, skipping..."
-      continue
-    fi
-    
-    # Create a new file with the modified content
-    {
-      # Copy the part before 'on:'
-      head -n $((on_line-1)) "$workflow"
-      
-      # Add the new on: section that only includes workflow_call
-      echo "on:"
-      echo "  workflow_call:"
-      echo "    secrets:"
-      echo "      inherit: true"
-      
-      # Find where to continue after the original 'on:' section
-      next_section=$(awk "NR > $on_line && /^[a-z]/ {print NR; exit}" "$workflow")
-      
-      if [ -z "$next_section" ]; then
-        next_section=$(wc -l < "$workflow")
-        next_section=$((next_section+1))
-      fi
-      
-      # Copy the rest of the file starting from the next section
-      tail -n +$next_section "$workflow"
-    } > "${workflow}.new"
-    
-    # Replace the original with the new version
-    mv "${workflow}.new" "$workflow"
-    
-    echo "Modified $workflow to only run when called from test-suites.yml"
-  else
-    echo "Warning: $workflow not found, skipping..."
-  fi
-done
-
-echo "Finished modifying workflows!" 

.github/workflows/distributed_test.yml

@@ -1,74 +0,0 @@
-name: Distributed Cognee test with modal
-permissions:
-  contents: read
-on:
-  workflow_call:
-    inputs:
-      python-version:
-        required: false
-        type: string
-        default: '3.11.x'
-    secrets:
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-      OPENAI_API_KEY:
-        required: true
-
-jobs:
-  run-server-start-test:
-    name: Distributed Cognee test (Modal)
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "distributed postgres"
-
-      - name: Run Distributed Cognee (Modal)
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          MODAL_TOKEN_ID: ${{ secrets.MODAL_TOKEN_ID }}
-          MODAL_TOKEN_SECRET: ${{ secrets.MODAL_TOKEN_SECRET }}
-          MODAL_SECRET_NAME: ${{ secrets.MODAL_SECRET_NAME }}
-          GRAPH_DATABASE_PROVIDER: "neo4j"
-          GRAPH_DATABASE_URL: ${{ secrets.AZURE_NEO4j_URL }}
-          GRAPH_DATABASE_USERNAME: ${{ secrets.AZURE_NEO4J_USERNAME }}
-          GRAPH_DATABASE_PASSWORD: ${{ secrets.AZURE_NEO4J_PW }}
-          DB_PROVIDER: "postgres"
-          DB_NAME: ${{ secrets.AZURE_POSTGRES_DB_NAME }}
-          DB_HOST: ${{ secrets.AZURE_POSTGRES_HOST }}
-          DB_PORT: ${{ secrets.AZURE_POSTGRES_PORT }}
-          DB_USERNAME: ${{ secrets.AZURE_POSTGRES_USERNAME }}
-          DB_PASSWORD: ${{ secrets.AZURE_POSTGRES_PW }}
-          VECTOR_DB_PROVIDER: "pgvector"
-          COGNEE_DISTRIBUTED: "true"
-        run: uv run modal run ./distributed/entrypoint.py

.github/workflows/docker_compose.yml

@@ -1,7 +1,14 @@
 name: test | docker compose
 
 on:
-  workflow_call:
+  push:
+    branches:
+      - main
+      - dev
+  pull_request:
+    branches:
+      - main
+      - dev
 
 jobs:
   docker-compose-test:

.github/workflows/dockerhub-mcp.yml

@@ -7,29 +7,14 @@ on:
 
 jobs:
   docker-build-and-push:
-    runs-on:
-      group: Default
-      labels:
-        - docker_build_runner
+    runs-on: ubuntu-latest
 
     steps:
-      - name: Check and free disk space before build
-        run: |
-          echo "=== Before cleanup ==="
-          df -h
-          echo "Removing unused preinstalled SDKs to free space..."
-          sudo rm -rf /usr/share/dotnet /usr/local/lib/android /opt/ghc || true
-          docker system prune -af || true
-          echo "=== After cleanup ==="
-          df -h
-
       - name: Checkout repository
         uses: actions/checkout@v4
 
       - name: Set up Docker Buildx
         uses: docker/setup-buildx-action@v3
-        with:
-          buildkitd-flags: --root /tmp/buildkit
 
       - name: Log in to Docker Hub
         uses: docker/login-action@v3
@@ -49,17 +34,15 @@ jobs:
 
       - name: Build and push
         id: build
-        uses: docker/build-push-action@v6
+        uses: docker/build-push-action@v5
         with:
-          context: .
+          context: cognee-mcp
           platforms: linux/amd64,linux/arm64
           push: true
-          file: cognee-mcp/Dockerfile
           tags: ${{ steps.meta.outputs.tags }}
           labels: ${{ steps.meta.outputs.labels }}
           cache-from: type=registry,ref=cognee/cognee-mcp:buildcache
           cache-to: type=registry,ref=cognee/cognee-mcp:buildcache,mode=max
 
-
       - name: Image digest
         run: echo ${{ steps.build.outputs.digest }}

.github/workflows/e2e_tests.yml

@@ -1,636 +0,0 @@
-name: Reusable Integration Tests
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-    inputs:
-      python-version:
-        required: false
-        type: string
-        default: '3.11.x'
-    secrets:
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-      OPENAI_API_KEY:
-        required: true
-      AWS_ACCESS_KEY_ID:
-        required: true
-      AWS_SECRET_ACCESS_KEY:
-        required: true
-
-jobs:
-  run-server-start-test:
-    name: Server Start Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Server Tests
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_cognee_server_start.py
-
-  run-telemetry-test:
-    name: Run Telemetry Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Telemetry Tests
-        env:
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_telemetry.py
-
-  run-telemetry-pipeline-test:
-    name: Run Telemetry Pipeline Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Add telemetry identifier
-        run: |
-          echo "test-machine" > .anon_id
-
-      - name: Run default basic pipeline with telemetry on
-        env:
-          ENV: 'local'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_library.py
-
-  run-deduplication-test:
-    name: Deduplication Test
-    runs-on: ubuntu-latest
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: cognee_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-    steps:
-      - name: Checkout repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres"
-
-      - name: Run Deduplication Example
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }} # Test needs OpenAI endpoint to handle multimedia
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_deduplication.py
-
-  run-s3-bucket-test:
-      name: S3 Bucket Test
-      runs-on: ubuntu-22.04
-      steps:
-        - name: Check out repository
-          uses: actions/checkout@v4
-
-        - name: Cognee Setup
-          uses: ./.github/actions/cognee_setup
-          with:
-            python-version: '3.11.x'
-            extra-dependencies: "aws"
-
-        - name: Run S3 Bucket Test
-          env:
-            ENV: 'dev'
-            LLM_MODEL: ${{ secrets.LLM_MODEL }}
-            LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-            LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-            LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-            EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-            EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-            EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-            EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-            AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
-            AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
-          run: uv run python ./cognee/tests/test_s3.py
-
-  test-parallel-databases:
-    name: Test using different async databases in parallel in Cognee
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run parallel databases test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_parallel_databases.py
-
-  test-dataset-database-handler:
-    name: Test dataset database handlers in Cognee
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run dataset databases handler test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_dataset_database_handler.py
-
-  test-dataset-database-deletion:
-    name: Test dataset database deletion in Cognee
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run dataset databases deletion test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_dataset_delete.py
-
-  test-permissions:
-    name: Test permissions with different situations in Cognee
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run permissions test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_permissions.py
-
-  test-multi-tenancy:
-    name: Test multi tenancy with different situations in Cognee
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run multi tenancy test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_multi_tenancy.py
-
-  test-graph-edges:
-    name: Test graph edge ingestion
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run graph edges test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_edge_ingestion.py
-
-  run_concurrent_subprocess_access_test:
-    name: Concurrent Subprocess access test
-    runs-on: ubuntu-latest
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: cognee_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-
-      redis:
-        image: redis:7
-        ports:
-          - 6379:6379
-        options: >-
-          --health-cmd "redis-cli ping"
-          --health-interval 5s
-          --health-timeout 3s
-          --health-retries 5
-
-    steps:
-      - name: Checkout repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres redis"
-
-      - name: Run Concurrent subprocess access test (Kuzu/Lancedb/Postgres/Redis)
-        env:
-          ENV: dev
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'kuzu'
-          CACHING: true
-          CACHE_BACKEND: 'redis'
-          SHARED_KUZU_LOCK: true
-          DB_PROVIDER: 'postgres'
-          DB_NAME: 'cognee_db'
-          DB_HOST: '127.0.0.1'
-          DB_PORT: 5432
-          DB_USERNAME: cognee
-          DB_PASSWORD: cognee
-        run: uv run python ./cognee/tests/test_concurrent_subprocess_access.py
-
-  test-entity-extraction:
-    name: Test Entity Extraction
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Entity Extraction Test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/tasks/entity_extraction/entity_extraction_test.py
-
-  test-feedback-enrichment:
-    name: Test Feedback Enrichment
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Feedback Enrichment Test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_feedback_enrichment.py
-
-  test-edge-centered-payload:
-    name: Test Cognify - Edge Centered Payload
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Edge Centered Payload Test
-        env:
-          ENV: 'dev'
-          TRIPLET_EMBEDDING: True
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_edge_centered_payload.py
-
-  run_conversation_sessions_test_redis:
-    name: Conversation sessions test (Redis)
-    runs-on: ubuntu-latest
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: cognee_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-
-      redis:
-        image: redis:7
-        ports:
-          - 6379:6379
-        options: >-
-          --health-cmd "redis-cli ping"
-          --health-interval 5s
-          --health-timeout 3s
-          --health-retries 5
-
-    steps:
-      - name: Checkout repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres redis"
-
-      - name: Run Conversation session tests (Redis)
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'kuzu'
-          CACHING: true
-          CACHE_BACKEND: 'redis'
-          DB_PROVIDER: 'postgres'
-          DB_NAME: 'cognee_db'
-          DB_HOST: '127.0.0.1'
-          DB_PORT: 5432
-          DB_USERNAME: cognee
-          DB_PASSWORD: cognee
-        run: uv run python ./cognee/tests/test_conversation_history.py
-
-  run_conversation_sessions_test_fs:
-    name: Conversation sessions test (FS)
-    runs-on: ubuntu-latest
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: cognee_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-
-    steps:
-      - name: Checkout repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres"
-
-      - name: Run Conversation session tests (FS)
-        env:
-          ENV: dev
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'kuzu'
-          CACHING: true
-          CACHE_BACKEND: 'fs'
-          DB_PROVIDER: 'postgres'
-          DB_NAME: 'cognee_db'
-          DB_HOST: '127.0.0.1'
-          DB_PORT: 5432
-          DB_USERNAME: cognee
-          DB_PASSWORD: cognee
-        run: uv run python ./cognee/tests/test_conversation_history.py
-
-  run-pipeline-cache-test:
-    name: Test Pipeline Caching
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Pipeline Cache Test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_pipeline_cache.py

.github/workflows/examples_tests.yml

@@ -1,298 +0,0 @@
-name: Reusable Examples Tests
-
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-
-jobs:
-  test-multimedia-example:
-    name: Run Multimedia Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Multimedia Example
-        env:
-          ENV: 'dev'
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-        run: uv run python ./examples/python/multimedia_example.py
-
-  test-eval-example:
-    name: Run Eval Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "deepeval"
-
-      - name: Run Evaluation Framework Example
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/eval_framework/run_eval.py
-
-  test-descriptive-metrics:
-    name: Run Descriptive Metrics Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Run Descriptive Graph Metrics Example
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: "neo4j"
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-        run: uv run python ./cognee/tests/tasks/descriptive_metrics/neo4j_metrics_test.py
-
-
-  test-dynamic-steps-metrics:
-    name: Run Dynamic Steps Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Dynamic Steps Tests
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/dynamic_steps_example.py
-
-  test-temporal-example:
-    name: Run Temporal Tests
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Temporal Example
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/temporal_example.py
-
-  test-ontology-example:
-    name: Run Ontology Tests
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Ontology Demo Example
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/ontology_demo_example.py
-
-  test-agentic-reasoning:
-    name: Run Agentic Reasoning Tests
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Agentic Reasoning Example
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/agentic_reasoning_procurement_example.py
-
-  test-memify:
-    name: Run Memify Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Memify Tests
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/memify_coding_agent_example.py
-
-  test-custom-pipeline:
-    name: Run Custom Pipeline Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Custom Pipeline Example
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/run_custom_pipeline_example.py
-
-  test-permissions-example:
-    name: Run Permissions Example
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Memify Tests
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./examples/python/permissions_example.py
-  test_docling_add:
-    name: Run Add with Docling Test
-    runs-on: macos-15
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: 'docling'
-
-      - name: Run Docling Test
-        env:
-          ENV: 'dev'
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_add_docling_document.py

.github/workflows/graph_db_tests.yml

@@ -1,111 +0,0 @@
-name: Reusable Graph DB Tests
-
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-    inputs:
-      databases:
-        required: false
-        type: string
-        default: "all"
-        description: "Which vector databases to test (comma-separated list or 'all')"
-
-jobs:
-  run-kuzu-tests:
-    name: Kuzu Tests
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'kuzu') }}
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Kuzu Tests
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_kuzu.py
-
-      - name: Run Weighted Edges Tests with Kuzu
-        env:
-          ENV: 'dev'
-          GRAPH_DATABASE_PROVIDER: "kuzu"
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run pytest cognee/tests/unit/interfaces/graph/test_weighted_edges.py -v
-
-  run-neo4j-tests:
-    name: Neo4j Tests
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'neo4j') }}
-    steps:
-      - name: Check out
-        uses: actions/checkout@master
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Run default Neo4j
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: "neo4j"
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-        run: uv run python ./cognee/tests/test_neo4j.py
-
-      - name: Run Weighted Edges Tests with Neo4j
-        env:
-          ENV: 'dev'
-          GRAPH_DATABASE_PROVIDER: "neo4j"
-          GRAPH_DATABASE_URL: ${{ secrets.NEO4J_API_URL }}
-          GRAPH_DATABASE_PASSWORD: ${{ secrets.NEO4J_API_KEY }}
-          GRAPH_DATABASE_USERNAME: "neo4j"
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run pytest cognee/tests/unit/interfaces/graph/test_weighted_edges.py -v

.github/workflows/label-core-team.yml

@@ -1,76 +0,0 @@
-name: Label PRs from core team
-
-on:
-  pull_request_target:
-    types: [opened, reopened, synchronize, ready_for_review, edited]
-
-permissions:
-  contents: read
-  issues: write
-
-jobs:
-  label-core-team:
-    if: ${{ !github.event.pull_request.draft }}
-    runs-on: ubuntu-latest
-    steps:
-      - name: Check out base repository
-        uses: actions/checkout@v4
-        with:
-          repository: ${{ github.repository }}
-          ref: ${{ github.event.pull_request.base.ref }}
-
-      - name: Determine if PR author is a core team member
-        id: check_core
-        shell: bash
-        run: |
-          AUTHOR="${{ github.event.pull_request.user.login }}"
-          LIST_FILE=".github/core-team.txt"
-
-          if [ ! -f "$LIST_FILE" ]; then
-            echo "core=false" >> "$GITHUB_OUTPUT"
-            exit 0
-          fi
-
-          # Normalize author to lowercase and strip leading '@'
-          AUTHOR_NORM="$(echo "$AUTHOR" | tr '[:upper:]' '[:lower:]' | sed 's/^@//')"
-
-          # Compare against normalized list values (ignore comments/blank lines)
-          if awk -v author="$AUTHOR_NORM" '
-            BEGIN { found=0 }
-            {
-              line=$0
-              sub(/^[ \t]+|[ \t]+$/, "", line)
-              if (line ~ /^#/ || line == "") next
-              sub(/^@/, "", line)
-              line=tolower(line)
-              if (line == author) { found=1; exit }
-            }
-            END { exit(found ? 0 : 1) }
-          ' "$LIST_FILE"; then
-            echo "core=true" >> "$GITHUB_OUTPUT"
-          else
-            echo "core=false" >> "$GITHUB_OUTPUT"
-          fi
-
-      - name: Add core-team label
-        if: steps.check_core.outputs.core == 'true'
-        uses: actions/github-script@v7
-        with:
-          github-token: ${{ secrets.GITHUB_TOKEN }}
-          script: |
-            const label = 'core-team';
-            const { owner, repo } = context.repo;
-            const prNumber = context.payload.pull_request.number;
-            try {
-              await github.rest.issues.addLabels({
-                owner,
-                repo,
-                issue_number: prNumber,
-                labels: [label],
-              });
-              core.info(`Label '${label}' added to PR #${prNumber}`);
-            } catch (error) {
-              core.warning(`Failed to add label: ${error.message}`);
-            }
-
-

.github/workflows/load_tests.yml

@@ -1,70 +0,0 @@
-name: Load tests
-
-permissions:
-  contents: read
-
-on:
-  workflow_dispatch:
-  workflow_call:
-    secrets:
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-      OPENAI_API_KEY:
-        required: true
-      AWS_ACCESS_KEY_ID:
-        required: true
-      AWS_SECRET_ACCESS_KEY:
-        required: true
-
-jobs:
-  test-load:
-    name: Test Load
-    runs-on: ubuntu-22.04
-    timeout-minutes: 60
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "aws"
-
-      - name: Verify File Descriptor Limit
-        run: ulimit -n
-
-      - name: Run Load Test
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: True
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          STORAGE_BACKEND: s3
-          AWS_REGION: eu-west-1
-          AWS_ENDPOINT_URL: https://s3-eu-west-1.amazonaws.com
-          AWS_ACCESS_KEY_ID: ${{ secrets.AWS_S3_DEV_USER_KEY_ID }}
-          AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_S3_DEV_USER_SECRET_KEY }}
-        run: uv run python ./cognee/tests/test_load.py
-  
-    

.github/workflows/notebooks_tests.yml

@@ -1,19 +0,0 @@
-name: Reusable Notebook Tests
-
-on:
-  workflow_call:
-
-jobs:
-#  run-main-notebook:
-#    name: Main Notebook Test
-#    uses: ./.github/workflows/reusable_notebook.yml
-#    with:
-#      notebook-location: notebooks/cognee_demo.ipynb
-#    secrets: inherit
-
-  run-cognee-multimedia:
-    name: Cognee Multimedia Notebook
-    uses: ./.github/workflows/reusable_notebook.yml
-    with:
-      notebook-location: notebooks/cognee_multimedia_demo.ipynb
-    secrets: inherit

.github/workflows/pre_test.yml

@@ -1,22 +0,0 @@
-on:
-  workflow_call:
-
-permissions:
-  contents: read
-jobs:
-  check-uv-lock:
-    name: Validate uv lockfile and project metadata
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Install uv
-        uses: astral-sh/setup-uv@v4
-        with:
-          enable-cache: true
-      
-      - name: Validate uv lockfile and project metadata
-        run: uv lock --check || { echo "'uv lock --check' failed."; echo "Run 'uv lock' and push your changes."; exit 1; }

.github/workflows/py_lint.yml

@@ -0,0 +1,79 @@
+
+name: lint | code & tests
+
+on:
+  workflow_dispatch:
+  pull_request:
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_lint:
+    name: lint
+    strategy:
+      fail-fast: true
+      matrix:
+        os:
+          - ubuntu-latest
+        python-version: ["3.10.x", "3.11.x"]
+
+    defaults:
+      run:
+        shell: bash
+    runs-on: ${{ matrix.os }}
+
+    steps:
+
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: ${{ matrix.python-version }}
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Load cached venv
+        id: cached-poetry-dependencies
+        uses: actions/cache@v4
+        with:
+          path: .venv
+          key: venv-${{ matrix.os }}-${{ matrix.python-version }}-${{ hashFiles('**/poetry.lock') }}
+
+      - name: Install dependencies
+        # if: steps.cached-poetry-dependencies.outputs.cache-hit != 'true'
+        run: poetry install --all-extras --no-root
+
+      - name: Set Script Permissions
+        run: chmod +x ./tools/check-package.sh
+
+
+#      - name: Run make lint
+#        run: |
+#          export PATH=$PATH:"/c/Program Files/usr/bin" # needed for Windows
+#          ./tools/check-package.sh
+#          poetry run python ./tools/check-lockfile.py
+#          poetry run mypy --config-file mypy.ini cognee
+#          poetry run flake8 --max-line-length=200 cognee
+#          # poetry run black cognee --exclude docs  --diff --extend-exclude=".*syntax_error.py"
+#          # poetry run isort ./ --diff
+#              poetry run bandit -r cognee/ -n 3 -l
+#
+#  matrix_job_required_check:
+#    name: lint | code & tests
+#    needs: run_lint
+#    runs-on: ubuntu-latest
+#    if: always()
+#    steps:
+#      - name: Check matrix job results
+#        if: contains(needs.*.result, 'failure') || contains(needs.*.result, 'cancelled')
+#        run: |
+#          echo "One or more matrix job tests failed or were cancelled. You may need to re-run them." && exit 1

.github/workflows/relational_db_migration_tests.yml

@@ -1,228 +0,0 @@
-name: Relational DB Migration Tests
-
-on:
-  workflow_call:
-    inputs:
-      python-version:
-        required: false
-        type: string
-        default: '3.11.x'
-    secrets:
-      LLM_PROVIDER:
-        required: true
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_PROVIDER:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-
-jobs:
-  run-relational-db-migration-test-networkx:
-    name: NetworkX Relational DB Migration Test
-    runs-on: ubuntu-22.04
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: test_migration_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres"
-
-      - name: Install specific db dependency
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run PostgreSQL Script to create test data (Chinook_PostgreSql.sql)
-        env:
-          PGPASSWORD: cognee
-        run: |
-          # Wait until the PostgreSQL service is available
-          until pg_isready -h localhost -p 5432; do
-            echo "Waiting for postgres..."
-            sleep 2
-          done
-
-          # Execute the SQL script against the test_migration_db database
-          psql -h localhost -U cognee -d test_migration_db -f ./cognee/tests/test_data/Chinook_PostgreSql.sql
-
-      - name: Run relational db test
-        env:
-          ENV: 'dev'
-          LLM_PROVIDER: openai
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-          EMBEDDING_PROVIDER: openai
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_relational_db_migration.py
-
-  run-relational-db-migration-test-kuzu:
-    name: Kuzu Relational DB Migration Test
-    runs-on: ubuntu-22.04
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: test_migration_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres"
-
-      - name: Install specific db dependency
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run PostgreSQL Script to create test data (Chinook_PostgreSql.sql)
-        env:
-          PGPASSWORD: cognee
-        run: |
-          # Wait until the PostgreSQL service is available
-          until pg_isready -h localhost -p 5432; do
-            echo "Waiting for postgres..."
-            sleep 2
-          done
-
-          # Execute the SQL script against the test_migration_db database
-          psql -h localhost -U cognee -d test_migration_db -f ./cognee/tests/test_data/Chinook_PostgreSql.sql
-
-      - name: Run relational db test
-        env:
-          ENV: 'dev'
-          GRAPH_DATABASE_PROVIDER: 'kuzu'
-
-          LLM_PROVIDER: openai
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-          EMBEDDING_PROVIDER: openai
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_relational_db_migration.py
-
-  run-relational-db-migration-test-neo4j:
-    name: Neo4j Relational DB Migration Test
-    runs-on: ubuntu-22.04
-    defaults:
-      run:
-        shell: bash
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: test_migration_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "postgres"
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Install specific db dependency
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run PostgreSQL Script to create test data (Chinook_PostgreSql.sql)
-        env:
-          PGPASSWORD: cognee
-        run: |
-          # Wait until the PostgreSQL service is available
-          until pg_isready -h localhost -p 5432; do
-            echo "Waiting for postgres..."
-            sleep 2
-          done
-
-          # Execute the SQL script against the test_migration_db database
-          psql -h localhost -U cognee -d test_migration_db -f ./cognee/tests/test_data/Chinook_PostgreSql.sql
-
-      - name: Run relational db test
-        env:
-          ENV: 'dev'
-          GRAPH_DATABASE_PROVIDER: "neo4j"
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-
-          LLM_PROVIDER: openai
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-          EMBEDDING_PROVIDER: openai
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_relational_db_migration.py

.github/workflows/release.yml

@@ -1,138 +0,0 @@
-name: release.yml
-on:
-  workflow_dispatch:
-    inputs:
-      flavour:
-        required: true
-        default: dev
-        type: choice
-        options:
-          - dev
-          - main
-        description: Dev or Main release
-
-jobs:
-  release-github:
-    name: Create GitHub Release from ${{ inputs.flavour }}
-    outputs:
-      tag: ${{ steps.create_tag.outputs.tag }}
-      version: ${{ steps.create_tag.outputs.version }}
-    permissions:
-      contents: write
-    runs-on: ubuntu-latest
-
-    steps:
-      - name: Check out ${{ inputs.flavour }}
-        uses: actions/checkout@v4
-        with:
-          ref: ${{ inputs.flavour }}
-      - name: Install uv
-        uses: astral-sh/setup-uv@v7
-
-      - name: Create and push git tag
-        id: create_tag
-        run: |
-          VERSION="$(uv version --short)"
-          TAG="v${VERSION}"
-
-          echo "Tag to create: ${TAG}"
-
-          git config user.name "github-actions[bot]"
-          git config user.email "41898282+github-actions[bot]@users.noreply.github.com"
-
-          echo "tag=${TAG}" >> "$GITHUB_OUTPUT"
-          echo "version=${VERSION}" >> "$GITHUB_OUTPUT"
-          
-          git tag "${TAG}"
-          git push origin "${TAG}"
-          
-
-      - name: Create GitHub Release
-        uses: softprops/action-gh-release@v2
-        with:
-          tag_name: ${{ steps.create_tag.outputs.tag }}
-          generate_release_notes: true
-        env:
-          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
-  
-  release-pypi-package:    
-    needs: release-github
-    name: Release PyPI Package from ${{ inputs.flavour }}
-    permissions:
-      contents: read
-    runs-on: ubuntu-latest
-
-    steps:
-      - name: Check out ${{ inputs.flavour }}
-        uses: actions/checkout@v4
-        with:
-          ref: ${{ inputs.flavour }}
-      
-      - name: Install uv
-        uses: astral-sh/setup-uv@v7
-      
-      - name: Install Python
-        run: uv python install
-      
-      - name: Install dependencies
-        run: uv sync --locked --all-extras
-      
-      - name: Build distributions
-        run: uv build
-      
-      - name: Publish ${{ inputs.flavour }} release to PyPI
-        env:
-          UV_PUBLISH_TOKEN: ${{ secrets.PYPI_TOKEN }}
-        run: uv publish
-  
-  release-docker-image:    
-    needs: release-github
-    name: Release Docker Image from ${{ inputs.flavour }}
-    permissions:
-      contents: read
-    runs-on: ubuntu-latest
-
-    steps:
-      - name: Check out ${{ inputs.flavour }}
-        uses: actions/checkout@v4
-        with:
-          ref: ${{ inputs.flavour }}
-
-      - name: Set up Docker Buildx
-        uses: docker/setup-buildx-action@v3
-
-      - name: Log in to Docker Hub
-        uses: docker/login-action@v3
-        with:
-          username: ${{ secrets.DOCKER_USERNAME }}
-          password: ${{ secrets.DOCKER_PASSWORD }}
-
-      - name: Build and push Dev Docker Image
-        if: ${{ inputs.flavour == 'dev' }}
-        uses: docker/build-push-action@v5
-        with:
-          context: .
-          platforms: linux/amd64,linux/arm64
-          push: true
-          tags: cognee/cognee:${{ needs.release-github.outputs.version }}
-          labels: |
-            version=${{ needs.release-github.outputs.version }}
-            flavour=${{ inputs.flavour }}
-          cache-from: type=registry,ref=cognee/cognee:buildcache
-          cache-to: type=registry,ref=cognee/cognee:buildcache,mode=max
-
-      - name: Build and push Main Docker Image
-        if: ${{ inputs.flavour == 'main' }}
-        uses: docker/build-push-action@v5
-        with:
-          context: .
-          platforms: linux/amd64,linux/arm64
-          push: true
-          tags: | 
-            cognee/cognee:${{ needs.release-github.outputs.version }}
-            cognee/cognee:latest
-          labels: |
-            version=${{ needs.release-github.outputs.version }}
-            flavour=${{ inputs.flavour }}
-          cache-from: type=registry,ref=cognee/cognee:buildcache
-          cache-to: type=registry,ref=cognee/cognee:buildcache,mode=max

.github/workflows/release_test.yml

@@ -1,17 +0,0 @@
-# Long-running, heavy and resource-consuming tests for release validation
-name: Release Test Workflow
-
-permissions:
-  contents: read
-
-on:
-  workflow_dispatch:
-  pull_request:
-    branches:
-      - main
-
-jobs:
-  load-tests:
-    name: Load Tests
-    uses: ./.github/workflows/load_tests.yml
-    secrets: inherit

.github/workflows/reusable_notebook.yml

@@ -8,6 +8,10 @@ on:
         required: true
         type: string
     secrets:
+      GRAPHISTRY_USERNAME:
+        required: true
+      GRAPHISTRY_PASSWORD:
+        required: true
       #LLM_MODEL:
       #  required: true
       #LLM_ENDPOINT:
@@ -42,11 +46,22 @@ jobs:
       - name: Check out
         uses: actions/checkout@master
 
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
+      - name: Setup Python
+        uses: actions/setup-python@v5
         with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "notebook"
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: |
+          poetry install --no-interaction --all-extras
+          poetry add jupyter --no-interaction
 
       - name: Execute Jupyter Notebook
         env:
@@ -60,8 +75,10 @@ jobs:
           EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
           EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
           EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+          GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+          GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}
         run: |
-          uv run jupyter nbconvert \
+          poetry run jupyter nbconvert \
           --to notebook \
           --execute ${{ inputs.notebook-location }} \
           --output executed_notebook.ipynb \

.github/workflows/reusable_python_example.yml

@@ -0,0 +1,63 @@
+name: test-example
+
+on:
+  workflow_call:
+    inputs:
+      example-location:
+        description: "Location of example script to run"
+        required: true
+        type: string
+      arguments:
+        description: "Arguments for example script"
+        required: false
+        type: string
+    secrets:
+      GRAPHISTRY_USERNAME:
+        required: true
+      GRAPHISTRY_PASSWORD:
+        required: true
+      LLM_API_KEY:
+        required: true
+      OPENAI_API_KEY:
+        required: false
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+
+  run_notebook_test:
+    name: test
+    runs-on: ubuntu-22.04
+    defaults:
+      run:
+        shell: bash
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.12.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: |
+          poetry install --no-interaction --all-extras
+
+      - name: Execute Python Example
+        env:
+          ENV: 'dev'
+          PYTHONFAULTHANDLER: 1
+          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+          GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+          GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}
+        run: poetry run python ${{ inputs.example-location }} ${{ inputs.arguments }}

.github/workflows/ruff_format.yaml

@@ -0,0 +1,11 @@
+name: lint | ruff format
+on: [ pull_request ]
+
+jobs:
+  ruff:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: astral-sh/ruff-action@v2
+        with:
+          args: "format --check"

.github/workflows/ruff_lint.yaml

@@ -0,0 +1,9 @@
+name: lint | ruff lint
+on: [ pull_request ]
+
+jobs:
+  ruff:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: astral-sh/ruff-action@v2

.github/workflows/scorecard.yml

@@ -1,78 +0,0 @@
-# This workflow uses actions that are not certified by GitHub. They are provided
-# by a third-party and are governed by separate terms of service, privacy
-# policy, and support documentation.
-
-name: Scorecard supply-chain security
-on:
-  # For Branch-Protection check. Only the default branch is supported. See
-  # https://github.com/ossf/scorecard/blob/main/docs/checks.md#branch-protection
-  branch_protection_rule:
-  # To guarantee Maintained check is occasionally updated. See
-  # https://github.com/ossf/scorecard/blob/main/docs/checks.md#maintained
-  schedule:
-    - cron: '35 8 * * 2'
-  push:
-    branches: [ "main" ]
-
-# Declare default permissions as read only.
-permissions: read-all
-
-jobs:
-  analysis:
-    name: Scorecard analysis
-    runs-on: ubuntu-latest
-    # `publish_results: true` only works when run from the default branch. conditional can be removed if disabled.
-    if: github.event.repository.default_branch == github.ref_name || github.event_name == 'pull_request'
-    permissions:
-      # Needed to upload the results to code-scanning dashboard.
-      security-events: write
-      # Needed to publish results and get a badge (see publish_results below).
-      id-token: write
-      # Uncomment the permissions below if installing in a private repository.
-      # contents: read
-      # actions: read
-
-    steps:
-      - name: "Checkout code"
-        uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
-        with:
-          persist-credentials: false
-
-      - name: "Run analysis"
-        uses: ossf/scorecard-action@f49aabe0b5af0936a0987cfb85d86b75731b0186 # v2.4.1
-        with:
-          results_file: results.sarif
-          results_format: sarif
-          # (Optional) "write" PAT token. Uncomment the `repo_token` line below if:
-          # - you want to enable the Branch-Protection check on a *public* repository, or
-          # - you are installing Scorecard on a *private* repository
-          # To create the PAT, follow the steps in https://github.com/ossf/scorecard-action?tab=readme-ov-file#authentication-with-fine-grained-pat-optional.
-          # repo_token: ${{ secrets.SCORECARD_TOKEN }}
-
-          # Public repositories:
-          #   - Publish results to OpenSSF REST API for easy access by consumers
-          #   - Allows the repository to include the Scorecard badge.
-          #   - See https://github.com/ossf/scorecard-action#publishing-results.
-          # For private repositories:
-          #   - `publish_results` will always be set to `false`, regardless
-          #     of the value entered here.
-          publish_results: true
-
-          # (Optional) Uncomment file_mode if you have a .gitattributes with files marked export-ignore
-          # file_mode: git
-
-      # Upload the results as artifacts (optional). Commenting out will disable uploads of run results in SARIF
-      # format to the repository Actions tab.
-      - name: "Upload artifact"
-        uses: actions/upload-artifact@4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 # v4.6.1
-        with:
-          name: SARIF file
-          path: results.sarif
-          retention-days: 5
-
-      # Upload the results to GitHub's code scanning dashboard (optional).
-      # Commenting out will disable upload of results to your repo's Code Scanning dashboard
-      - name: "Upload to code-scanning"
-        uses: github/codeql-action/upload-sarif@v3
-        with:
-          sarif_file: results.sarif

.github/workflows/search_db_tests.yml

@@ -1,208 +0,0 @@
-name: Reusable Search DB Tests
-
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-    inputs:
-      databases:
-        required: false
-        type: string
-        default: "all"
-        description: "Which vector databases to test (comma-separated list or 'all')"
-
-jobs:
-  run-kuzu-lance-sqlite-search-tests:
-    name: Search test for Kuzu/LanceDB/Sqlite
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'kuzu/lance/sqlite') }}
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Kuzu search Tests
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'kuzu'
-          VECTOR_DB_PROVIDER: 'lancedb'
-          DB_PROVIDER: 'sqlite'
-        run: uv run python ./cognee/tests/test_search_db.py
-
-  run-neo4j-lance-sqlite-search-tests:
-    name: Search test for Neo4j/LanceDB/Sqlite
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'neo4j/lance/sqlite') }}
-
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Neo4j search Tests
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'neo4j'
-          VECTOR_DB_PROVIDER: 'lancedb'
-          DB_PROVIDER: 'sqlite'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-        run: uv run python ./cognee/tests/test_search_db.py
-
-  run-kuzu-pgvector-postgres-search-tests:
-      name: Search test for Kuzu/PGVector/Postgres
-      runs-on: ubuntu-22.04
-      if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'kuzu/pgvector/postgres') }}
-      services:
-        postgres:
-          image: pgvector/pgvector:pg17
-          env:
-            POSTGRES_USER: cognee
-            POSTGRES_PASSWORD: cognee
-            POSTGRES_DB: cognee_db
-          options: >-
-            --health-cmd pg_isready
-            --health-interval 10s
-            --health-timeout 5s
-            --health-retries 5
-          ports:
-            - 5432:5432
-      steps:
-        - name: Check out
-          uses: actions/checkout@v4
-          with:
-            fetch-depth: 0
-
-        - name: Cognee Setup
-          uses: ./.github/actions/cognee_setup
-          with:
-            python-version: ${{ inputs.python-version }}
-            extra-dependencies: "postgres"
-
-        - name: Dependencies already installed
-          run: echo "Dependencies already installed in setup"
-
-        - name: Run Kuzu/PGVector/Postgres Tests
-          env:
-            ENV: dev
-            LLM_MODEL: ${{ secrets.LLM_MODEL }}
-            LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-            LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-            LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-            EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-            EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-            EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-            EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-            GRAPH_DATABASE_PROVIDER: 'kuzu'
-            VECTOR_DB_PROVIDER: 'pgvector'
-            ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-            DB_PROVIDER: 'postgres'
-            DB_NAME: 'cognee_db'
-            DB_HOST: '127.0.0.1'
-            DB_PORT: 5432
-            DB_USERNAME: cognee
-            DB_PASSWORD: cognee
-          run: uv run python ./cognee/tests/test_search_db.py
-
-  run-neo4j-pgvector-postgres-search-tests:
-    name: Search test for Neo4j/PGVector/Postgres
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'neo4j/pgvector/postgres') }}
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: cognee_db
-        ports:
-          - 5432:5432
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries=5
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "postgres"
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Neo4j + PGVector + Postgres search Tests
-        env:
-          ENV: dev
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'neo4j'
-          VECTOR_DB_PROVIDER: 'pgvector'
-          DB_PROVIDER: 'postgres'
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          DB_NAME: cognee_db
-          DB_HOST: 127.0.0.1
-          DB_PORT: 5432
-          DB_USERNAME: cognee
-          DB_PASSWORD: cognee
-        run: uv run python ./cognee/tests/test_search_db.py

.github/workflows/temporal_graph_tests.yml

@@ -1,213 +0,0 @@
-name: Temporal Graph Tests
-
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-    inputs:
-      databases:
-        required: false
-        type: string
-        default: "all"
-        description: "Which vector databases to test (comma-separated list or 'all')"
-
-jobs:
-  run_temporal_graph_kuzu_lance_sqlite:
-    name: Temporal Graph test Kuzu (lancedb + sqlite)
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'kuzu/lance/sqlite') }}
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Temporal Graph with Kuzu (lancedb + sqlite)
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.OPENAI_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.OPENAI_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'kuzu'
-          VECTOR_DB_PROVIDER: 'lancedb'
-          DB_PROVIDER: 'sqlite'
-        run: uv run python ./cognee/tests/test_temporal_graph.py
-
-  run_temporal_graph_neo4j_lance_sqlite:
-    name: Temporal Graph test Neo4j (lancedb + sqlite)
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'neo4j/lance/sqlite') }}
-
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Temporal Graph with Neo4j (lancedb + sqlite)
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.OPENAI_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.OPENAI_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'neo4j'
-          VECTOR_DB_PROVIDER: 'lancedb'
-          DB_PROVIDER: 'sqlite'
-          GRAPH_DATABASE_URL: ${{ steps.neo4j.outputs.neo4j-url }}
-          GRAPH_DATABASE_USERNAME: ${{ steps.neo4j.outputs.neo4j-username }}
-          GRAPH_DATABASE_PASSWORD: ${{ steps.neo4j.outputs.neo4j-password }}
-        run: uv run python ./cognee/tests/test_temporal_graph.py
-
-  run_temporal_graph_kuzu_postgres_pgvector:
-      name: Temporal Graph test Kuzu (postgres + pgvector)
-      runs-on: ubuntu-22.04
-      if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'kuzu/pgvector/postgres') }}
-      services:
-        postgres:
-          image: pgvector/pgvector:pg17
-          env:
-            POSTGRES_USER: cognee
-            POSTGRES_PASSWORD: cognee
-            POSTGRES_DB: cognee_db
-          options: >-
-            --health-cmd pg_isready
-            --health-interval 10s
-            --health-timeout 5s
-            --health-retries 5
-          ports:
-            - 5432:5432
-      steps:
-        - name: Check out
-          uses: actions/checkout@v4
-          with:
-            fetch-depth: 0
-
-        - name: Cognee Setup
-          uses: ./.github/actions/cognee_setup
-          with:
-            python-version: ${{ inputs.python-version }}
-            extra-dependencies: "postgres"
-
-        - name: Dependencies already installed
-          run: echo "Dependencies already installed in setup"
-
-        - name: Run Temporal Graph with Kuzu (postgres + pgvector)
-          env:
-            ENV: dev
-            ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-            LLM_MODEL: ${{ secrets.OPENAI_MODEL }}
-            LLM_ENDPOINT: ${{ secrets.OPENAI_ENDPOINT }}
-            LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-            EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-            EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-            EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-            EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-            GRAPH_DATABASE_PROVIDER: 'kuzu'
-            VECTOR_DB_PROVIDER: 'pgvector'
-            DB_PROVIDER: 'postgres'
-            DB_NAME: 'cognee_db'
-            DB_HOST: '127.0.0.1'
-            DB_PORT: 5432
-            DB_USERNAME: cognee
-            DB_PASSWORD: cognee
-          run: uv run python ./cognee/tests/test_temporal_graph.py
-
-  run_temporal_graph_neo4j_postgres_pgvector:
-    name: Temporal Graph test Neo4j (postgres + pgvector)
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'neo4j/pgvector/postgres') }}
-    services:
-      neo4j:
-        image: neo4j:5.11
-        env:
-          NEO4J_AUTH: neo4j/pleaseletmein
-          NEO4J_PLUGINS: '["apoc","graph-data-science"]'
-        ports:
-          - 7474:7474
-          - 7687:7687
-        options: >-
-          --health-cmd="cypher-shell -u neo4j -p pleaseletmein 'RETURN 1'"
-          --health-interval=10s
-          --health-timeout=5s
-          --health-retries=5
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: cognee
-          POSTGRES_DB: cognee_db
-        ports:
-          - 5432:5432
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries=5
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "postgres"
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Temporal Graph with Neo4j (postgres + pgvector)
-        env:
-          ENV: dev
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.OPENAI_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.OPENAI_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-          GRAPH_DATABASE_PROVIDER: 'neo4j'
-          VECTOR_DB_PROVIDER: 'pgvector'
-          DB_PROVIDER: 'postgres'
-          GRAPH_DATABASE_URL: bolt://localhost:7687
-          GRAPH_DATABASE_USERNAME: neo4j
-          GRAPH_DATABASE_PASSWORD: pleaseletmein
-          DB_NAME: cognee_db
-          DB_HOST: 127.0.0.1
-          DB_PORT: 5432
-          DB_USERNAME: cognee
-          DB_PASSWORD: cognee
-        run: uv run python ./cognee/tests/test_temporal_graph.py

.github/workflows/test_chromadb.yml

@@ -0,0 +1,63 @@
+name: test | chromadb
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+  run_chromadb_integration_test:
+    name: chromadb test
+    runs-on: ubuntu-22.04
+    defaults:
+      run:
+        shell: bash
+    services:
+      chromadb:
+        image: chromadb/chroma:0.6.3
+        volumes:
+          - chroma-data:/chroma/chroma
+        ports:
+          - 3002:8000
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install --no-interaction
+
+      - name: Run chromadb test
+        env:
+          ENV: 'dev'
+          VECTOR_DB_PROVIDER: chromadb
+          VECTOR_DB_URL: http://localhost:3002
+          VECTOR_DB_KEY: test-token
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_chromadb.py

.github/workflows/test_code_graph_example.yml

@@ -0,0 +1,27 @@
+name: test | code graph example
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_simple_example_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./examples/python/code_graph_example.py
+        arguments: "--repo_path ./evals"
+      secrets:
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        EMBEDDING_PROVIDER: "fastembed"
+        EMBEDDING_MODEL: "sentence-transformers/all-MiniLM-L6-v2"
+        EMBEDDING_DIMENSIONS: 384
+        EMBEDDING_MAX_TOKENS: 256
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_cognee_llama_index_notebook.yml

@@ -0,0 +1,28 @@
+name: test | llama index notebook
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_notebook_test:
+      uses: ./.github/workflows/reusable_notebook.yml
+      with:
+        notebook-location: notebooks/cognee_llama_index.ipynb
+      secrets:
+        #LLM_MODEL: ${{ secrets.LLM_MODEL }}
+        #LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        #LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+        EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+        EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+        EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+        EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_cognee_multimedia_notebook.yml

@@ -0,0 +1,28 @@
+name: test | multimedia notebook
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_notebook_test:
+      uses: ./.github/workflows/reusable_notebook.yml
+      with:
+        notebook-location: notebooks/cognee_multimedia_demo.ipynb
+      secrets:
+        #LLM_MODEL: ${{ secrets.LLM_MODEL }}
+        #LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        #LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+        EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+        EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+        EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+        EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_cognee_server_start.yml

@@ -0,0 +1,78 @@
+name: test | test server start
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+  ENV: 'dev'
+
+jobs:
+
+  run_server:
+    name: Test cognee server start
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.12.x'
+
+      - name: Install Poetry
+        # https://github.com/snok/install-poetry#running-on-windows
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: |
+          poetry install --no-interaction
+
+      - name: Run cognee server
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: |
+          poetry run uvicorn cognee.api.client:app --host 0.0.0.0 --port 8000 &
+          echo $! > server.pid
+          sleep 10
+
+      - name: Check server process
+        run: |
+          if ! ps -p $(cat server.pid) > /dev/null; then
+            echo "::error::Server failed to start"
+            exit 1
+          fi
+
+      - name: Stop server
+        run: |
+          kill $(cat server.pid) || true
+
+      - name: Clean up disk space
+        run: |
+          sudo rm -rf ~/.cache
+          sudo rm -rf /tmp/*
+          sudo rm server.pid
+          df -h

.github/workflows/test_deduplication.yml

@@ -0,0 +1,68 @@
+name: test | deduplication
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+  run_deduplication_test:
+    name: test
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        shell: bash
+    services:
+      postgres:
+        image: pgvector/pgvector:pg17
+        env:
+          POSTGRES_USER: cognee
+          POSTGRES_PASSWORD: cognee
+          POSTGRES_DB: cognee_db
+        options: >-
+          --health-cmd pg_isready
+          --health-interval 10s
+          --health-timeout 5s
+          --health-retries 5
+        ports:
+          - 5432:5432
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E postgres --no-interaction
+
+      - name: Run deduplication test
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_deduplication.py

.github/workflows/test_descriptive_graph_metrics.yml

@@ -0,0 +1,22 @@
+name: test | descriptive graph metrics
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_networkx_metrics_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./cognee/tests/tasks/descriptive_metrics/networkx_metrics_test.py
+      secrets:
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_different_operating_systems.yml

@@ -1,252 +0,0 @@
-name: Tests to run on different Operating Systems
-
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-    inputs:
-      python-versions:
-        required: false
-        type: string
-        default: '["3.10.x", "3.12.x", "3.13.x"]'
-      os: 
-        required: false
-        type: string
-        default: '["ubuntu-22.04", "macos-15", "windows-latest"]'
-    secrets:
-      LLM_PROVIDER:
-        required: true
-      LLM_MODEL:
-        required: true
-      LLM_ENDPOINT:
-        required: true
-      LLM_API_KEY:
-        required: true
-      LLM_API_VERSION:
-        required: true
-      EMBEDDING_PROVIDER:
-        required: true
-      EMBEDDING_MODEL:
-        required: true
-      EMBEDDING_ENDPOINT:
-        required: true
-      EMBEDDING_API_KEY:
-        required: true
-      EMBEDDING_API_VERSION:
-        required: true
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs:
-  run-unit-tests:
-    name: Unit tests ${{ matrix.python-version }} on ${{ matrix.os }}
-    runs-on: ${{ matrix.os }}
-    timeout-minutes: 60
-    strategy:
-      matrix:
-        python-version: ${{ fromJSON(inputs.python-versions) }}
-        os: ${{ fromJSON(inputs.os) }}
-      fail-fast: false
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Run unit tests
-        shell: bash
-        run: uv run pytest cognee/tests/unit/
-        env:
-          PYTHONUTF8: 1
-          LLM_PROVIDER: openai
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-          EMBEDDING_PROVIDER: openai
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-
-  run-integration-tests:
-    name: Integration tests ${{ matrix.python-version }} on ${{ matrix.os }}
-    runs-on: ${{ matrix.os }}
-    timeout-minutes: 60
-    strategy:
-      matrix:
-        python-version: ${{ fromJSON(inputs.python-versions) }}
-        os: ${{ fromJSON(inputs.os) }}
-      fail-fast: false
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Run integration tests
-        shell: bash
-        run: uv run pytest cognee/tests/integration/
-        env:
-          PYTHONUTF8: 1
-          LLM_PROVIDER: openai
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-          EMBEDDING_PROVIDER: openai
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-
-  run-library-test:
-    name: Library test ${{ matrix.python-version }} on ${{ matrix.os }}
-    runs-on: ${{ matrix.os }}
-    timeout-minutes: 60
-    strategy:
-      matrix:
-        python-version: ${{ fromJSON(inputs.python-versions) }}
-        os: ${{ fromJSON(inputs.os) }}
-      fail-fast: false
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Run default basic pipeline
-        shell: bash
-        env:
-          PYTHONUTF8: 1
-          LLM_PROVIDER: openai
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-
-          EMBEDDING_PROVIDER: openai
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_library.py
-
-  run-build-test:
-    name: Build test ${{ matrix.python-version }} on ${{ matrix.os }}
-    runs-on: ${{ matrix.os }}
-    timeout-minutes: 60
-    strategy:
-      matrix:
-        python-version: ${{ fromJSON(inputs.python-versions) }}
-        os: ${{ fromJSON(inputs.os) }}
-      fail-fast: false
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Build with uv
-        shell: bash
-        run: uv build
-
-      - name: Install Package
-        if: ${{ !contains(matrix.os, 'windows-latest') }}
-        run: |
-          cd dist
-          pip install *.whl
-
-  run-soft-deletion-test:
-    name: Soft Delete test ${{ matrix.python-version }} on ${{ matrix.os }}
-    runs-on: ${{ matrix.os }}
-    timeout-minutes: 60
-    strategy:
-      matrix:
-        python-version: ${{ fromJSON(inputs.python-versions) }}
-        os: ${{ fromJSON(inputs.os) }}
-      fail-fast: false
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Path setup
-        if: ${{ matrix.os }} == 'windows-latest'
-        shell: bash
-        run: |
-          PATH=$(printf '%s' "$PATH" | tr ':' $'\n' | grep -vi '/git/usr/bin' | paste -sd: -)
-          export PATH
-
-      - name: Run Soft Deletion Tests
-        env:
-          ENV: 'dev'
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }} # Test needs OpenAI endpoint to handle multimedia
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_delete_soft.py
-
-  run-hard-deletion-test:
-    name: Hard Delete test ${{ matrix.python-version }} on ${{ matrix.os }}
-    runs-on: ${{ matrix.os }}
-    timeout-minutes: 60
-    strategy:
-      matrix:
-        python-version: ${{ fromJSON(inputs.python-versions) }}
-        os: ${{ fromJSON(inputs.os) }}
-      fail-fast: false
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Run Hard Deletion Test
-        env:
-          ENV: 'dev'
-          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }} # Test needs OpenAI endpoint to handle multimedia
-          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_delete_hard.py

.github/workflows/test_dynamic_steps_example.yml

@@ -0,0 +1,22 @@
+name: test | dynamic steps example
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_dynamic_steps_example_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./examples/python/dynamic_steps_example.py
+      secrets:
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_dynamic_steps_example_windows.yml

@@ -0,0 +1,49 @@
+name: test
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_notebook_test_windows:
+    name: windows-latest
+    runs-on: windows-latest
+    defaults:
+      run:
+        shell: bash
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        run: |
+          python -m pip install --upgrade pip
+          pip install poetry
+
+      - name: Install dependencies
+        run: |
+          poetry install --no-interaction --all-extras
+
+      - name: Execute Python Example
+        env:
+          ENV: 'dev'
+          PYTHONFAULTHANDLER: 1
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./examples/python/dynamic_steps_example.py

.github/workflows/test_eval_framework.yml

@@ -0,0 +1,22 @@
+name: test | eval_framework
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_eval_framework_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./cognee/eval_framework/run_eval.py
+      secrets:
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_gemini.yml

@@ -0,0 +1,33 @@
+name: test | gemini
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_simple_example_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./examples/python/simple_example.py
+      secrets:
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}
+        EMBEDDING_PROVIDER: "gemini"
+        EMBEDDING_API_KEY: ${{ secrets.GEMINI_API_KEY }}
+        EMBEDDING_MODEL: "gemini/text-embedding-004"
+        EMBEDDING_ENDPOINT: "https://generativelanguage.googleapis.com/v1beta/models/text-embedding-004"
+        EMBEDDING_API_VERSION: "v1beta"
+        EMBEDDING_DIMENSIONS: 768
+        EMBEDDING_MAX_TOKENS: 8076
+        LLM_PROVIDER: "gemini"
+        LLM_API_KEY: ${{ secrets.GEMINI_API_KEY }}
+        LLM_MODEL: "gemini/gemini-1.5-flash"
+        LLM_ENDPOINT: "https://generativelanguage.googleapis.com/"
+        LLM_API_VERSION: "v1beta"

.github/workflows/test_graphrag_vs_rag_notebook.yml

@@ -0,0 +1,25 @@
+name: test | graphrag vs rag notebook
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_notebook_test:
+      uses: ./.github/workflows/reusable_notebook.yml
+      with:
+        notebook-location: notebooks/graphrag_vs_rag.ipynb
+      secrets:
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+        EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+        EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+        EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_kuzu.yml

@@ -0,0 +1,54 @@
+name: test | kuzu
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+  run_kuzu_integration_test:
+    name: test
+    runs-on: ubuntu-22.04
+
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E kuzu --no-interaction
+
+      - name: Run Kuzu tests
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_kuzu.py

.github/workflows/test_llama_index_cognee_integration_notebook.yml

@@ -0,0 +1,59 @@
+name: test | llama index cognee integration notebook
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+  run_notebook_test:
+    name: test
+    runs-on: ubuntu-22.04
+    defaults:
+      run:
+        shell: bash
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: |
+          pip install jupyter
+          pip install llama-index-graph-rag-cognee==0.1.3
+
+      - name: Execute Jupyter Notebook
+        env:
+          ENV: 'dev'
+          LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+          GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+          GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}
+        run: |
+          poetry run jupyter nbconvert \
+          --to notebook \
+          --execute notebooks/llama_index_cognee_integration.ipynb \
+          --output executed_notebook.ipynb \
+          --ExecutePreprocessor.timeout=1200

.github/workflows/test_llms.yml

@@ -1,176 +0,0 @@
-name: LLM Test Suites
-
-permissions:
-  contents: read
-
-on:
-  workflow_call:
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs:
-  test-gemini:
-    name: Run Gemini Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Gemini Simple Example
-        env:
-          LLM_PROVIDER: "gemini"
-          LLM_API_KEY: ${{ secrets.GEMINI_API_KEY }}
-          LLM_MODEL: "gemini/gemini-2.0-flash"
-          EMBEDDING_PROVIDER: "gemini"
-          EMBEDDING_API_KEY: ${{ secrets.GEMINI_API_KEY }}
-          EMBEDDING_MODEL: "gemini/text-embedding-004"
-          EMBEDDING_DIMENSIONS: "768"
-          EMBEDDING_MAX_TOKENS: "8076"
-        run: uv run python ./examples/python/simple_example.py
-
-  test-fastembed:
-    name: Run Fastembed Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run Fastembed Simple Example
-        env:
-          LLM_PROVIDER: "openai"
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_PROVIDER: "fastembed"
-          EMBEDDING_MODEL: "sentence-transformers/all-MiniLM-L6-v2"
-          EMBEDDING_DIMENSIONS: "384"
-          EMBEDDING_MAX_TOKENS: "256"
-        run: uv run python ./examples/python/simple_example.py
-
-  test-openrouter:
-    name: Run OpenRouter Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-
-      - name: Run OpenRouter Simple Example
-        env:
-          LLM_PROVIDER: "custom"
-          LLM_API_KEY: ${{ secrets.OPENROUTER_API_KEY }}
-          LLM_MODEL: "openrouter/x-ai/grok-code-fast-1"
-          LLM_ENDPOINT: "https://openrouter.ai/api/v1"
-          EMBEDDING_PROVIDER: "openai"
-          EMBEDDING_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-          EMBEDDING_MODEL: "openai/text-embedding-3-large"
-          EMBEDDING_DIMENSIONS: "3072"
-          EMBEDDING_MAX_TOKENS: "8191"
-        run: uv run python ./examples/python/simple_example.py
-
-  test-bedrock-api-key:
-    name: Run Bedrock API Key Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "aws"
-
-      - name: Run Bedrock API Key Simple Example
-        env:
-          LLM_PROVIDER: "bedrock"
-          LLM_API_KEY: ${{ secrets.BEDROCK_API_KEY }}
-          LLM_MODEL: "eu.anthropic.claude-sonnet-4-5-20250929-v1:0"
-          LLM_MAX_TOKENS: "16384"
-          AWS_REGION_NAME: "eu-west-1"
-          EMBEDDING_PROVIDER: "bedrock"
-          EMBEDDING_API_KEY: ${{ secrets.BEDROCK_API_KEY }}
-          EMBEDDING_MODEL: "amazon.titan-embed-text-v2:0"
-          EMBEDDING_DIMENSIONS: "1024"
-          EMBEDDING_MAX_TOKENS: "8191"
-        run: uv run python ./examples/python/simple_example.py
-
-  test-bedrock-aws-credentials:
-    name: Run Bedrock AWS Credentials Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "aws"
-
-      - name: Run Bedrock AWS Credentials Simple Example
-        env:
-          LLM_PROVIDER: "bedrock"
-          LLM_MODEL: "eu.anthropic.claude-sonnet-4-5-20250929-v1:0"
-          LLM_MAX_TOKENS: "16384"
-          AWS_REGION_NAME: "eu-west-1"
-          AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
-          AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
-          EMBEDDING_PROVIDER: "bedrock"
-          EMBEDDING_API_KEY: ${{ secrets.BEDROCK_API_KEY }}
-          EMBEDDING_MODEL: "amazon.titan-embed-text-v2:0"
-          EMBEDDING_DIMENSIONS: "1024"
-          EMBEDDING_MAX_TOKENS: "8191"
-        run: uv run python ./examples/python/simple_example.py
-
-  test-bedrock-aws-profile:
-    name: Run Bedrock AWS Profile Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "aws"
-
-      - name: Configure AWS Profile
-        run: |
-          mkdir -p ~/.aws
-          cat > ~/.aws/credentials << EOF
-          [bedrock-test]
-          aws_access_key_id = ${{ secrets.AWS_ACCESS_KEY_ID }}
-          aws_secret_access_key = ${{ secrets.AWS_SECRET_ACCESS_KEY }}
-          EOF
-
-      - name: Run Bedrock AWS Profile Simple Example
-        env:
-          LLM_PROVIDER: "bedrock"
-          LLM_MODEL: "eu.anthropic.claude-sonnet-4-5-20250929-v1:0"
-          LLM_MAX_TOKENS: "16384"
-          AWS_PROFILE_NAME: "bedrock-test"
-          AWS_REGION_NAME: "eu-west-1"
-          EMBEDDING_PROVIDER: "bedrock"
-          EMBEDDING_MODEL: "amazon.titan-embed-text-v2:0"
-          EMBEDDING_DIMENSIONS: "1024"
-          EMBEDDING_MAX_TOKENS: "8191"
-        run: uv run python ./examples/python/simple_example.py

.github/workflows/test_mcp.yml

@@ -1,52 +0,0 @@
-name: test | mcp
-
-on:
-  workflow_call:
-
-jobs:
-  test-mcp:
-    name: Run MCP Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Set up Python
-        uses: actions/setup-python@v5
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Install UV
-        shell: bash
-        run: |
-          python -m pip install --upgrade pip
-          pip install uv
-
-      # This will install all dependencies along with Cognee version deployed on PIP
-      - name: Install dependencies
-        shell: bash
-        working-directory: cognee-mcp
-        run: uv sync
-
-      # NEW: swap in current local cognee branch version
-      - name: Override with cognee branch checkout
-        working-directory: cognee-mcp
-        run: |
-         # Remove Cognee wheel that came from PyPI
-         uv pip uninstall cognee
-         # Install of the freshly-checked-out Cognee branch
-         uv pip install --force-reinstall -e ../
-
-      - name: Run MCP test
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        working-directory: cognee-mcp
-        run: uv run --no-sync python ./src/test_client.py

.github/workflows/test_milvus.yml

@@ -0,0 +1,64 @@
+name: test | milvus
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+  ENV: 'dev'
+
+jobs:
+
+  run_milvus:
+    name: test
+    runs-on: ubuntu-22.04
+    strategy:
+      fail-fast: false
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version:  '3.11.x'
+
+      - name: Install Poetry
+        # https://github.com/snok/install-poetry#running-on-windows
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E milvus --no-interaction
+
+      - name: Run default basic pipeline
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_milvus.py
+
+      - name: Clean up disk space
+        run: |
+          sudo rm -rf ~/.cache
+          sudo rm -rf /tmp/*
+          df -h

.github/workflows/test_multimedia_example.yaml

@@ -0,0 +1,22 @@
+name: test | multimedia example
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_multimedia_example_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./examples/python/multimedia_example.py
+      secrets:
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_multimetric_qa_eval_run.yaml

@@ -0,0 +1,30 @@
+name: test | multimetric qa eval run
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_multimetric_qa_eval_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./evals/multimetric_qa_eval_run.py
+        arguments: "--params_file evals/qa_eval_parameters.json --out_dir dirname"
+      secrets:
+        LLM_MODEL: ${{ secrets.LLM_MODEL }}
+        LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+        LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+        LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }} # Until we add support for azure for DeepEval
+        EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+        EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+        EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+        EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_neo4j.yml

@@ -0,0 +1,57 @@
+name: test | neo4j
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+  run_neo4j_integration_test:
+    name: test
+    runs-on: ubuntu-22.04
+
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E neo4j --no-interaction
+
+      - name: Run default Neo4j
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+          GRAPH_DATABASE_URL: ${{ secrets.NEO4J_API_URL }}
+          GRAPH_DATABASE_PASSWORD: ${{ secrets.NEO4J_API_KEY }}
+          GRAPH_DATABASE_USERNAME: "neo4j"
+        run: poetry run python ./cognee/tests/test_neo4j.py

.github/workflows/test_notebook.yml

@@ -0,0 +1,29 @@
+name: test | notebook
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_notebook_test:
+      uses: ./.github/workflows/reusable_notebook.yml
+      with:
+        notebook-location: notebooks/cognee_demo.ipynb
+      secrets:
+        #LLM_MODEL: ${{ secrets.LLM_MODEL }}
+        #LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        #LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+        EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+        EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+        EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+        EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_ollama.yml

@@ -1,27 +1,50 @@
 name: test | ollama
 
 on:
-  workflow_call:
+  workflow_dispatch:
+  pull_request:
+    types: [ labeled, synchronize ]
 
 jobs:
 
-  run_ollama_test:
+  run_simple_example_test:
 
-    # needs 32 Gb RAM for phi4 in a container
-    runs-on: buildjet-8vcpu-ubuntu-2204
+    # needs 16 Gb RAM for phi4
+    runs-on: buildjet-4vcpu-ubuntu-2204
+#    services:
+#      ollama:
+#        image: ollama/ollama
+#        ports:
+#          - 11434:11434
 
     steps:
       - name: Checkout repository
         uses: actions/checkout@v4
 
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
+      - name: Setup Python
+        uses: actions/setup-python@v5
         with:
-          python-version: '3.11.x'
+          python-version: '3.12.x'
 
-      - name: Install torch dependency
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
         run: |
-          uv add torch
+          poetry install --no-interaction --all-extras
+          poetry add torch
+
+#      - name: Install ollama
+#        run: curl -fsSL https://ollama.com/install.sh | sh
+#      - name: Run ollama
+#        run: |
+#          ollama serve --openai &
+#          ollama pull llama3.2 &
+#          ollama pull avr/sfr-embedding-mistral:latest
 
       - name: Start Ollama container
         run: |
@@ -62,7 +85,7 @@ jobs:
                 { "role": "user", "content": "Whatever I say, answer with Yes." }
               ]
             }'
-          curl -X POST http://127.0.0.1:11434/api/embed \
+          curl -X POST http://127.0.0.1:11434/v1/embeddings \
             -H "Content-Type: application/json" \
              -d '{
               "model": "avr/sfr-embedding-mistral:latest",
@@ -78,6 +101,8 @@ jobs:
       - name: Run example test
         env:
           OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+          GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+          GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}
           PYTHONFAULTHANDLER: 1
           LLM_PROVIDER: "ollama"
           LLM_API_KEY: "ollama"
@@ -85,7 +110,7 @@ jobs:
           LLM_MODEL: "phi4"
           EMBEDDING_PROVIDER: "ollama"
           EMBEDDING_MODEL: "avr/sfr-embedding-mistral:latest"
-          EMBEDDING_ENDPOINT: "http://localhost:11434/api/embed"
+          EMBEDDING_ENDPOINT: "http://localhost:11434/v1/"
           EMBEDDING_DIMENSIONS: "4096"
           HUGGINGFACE_TOKENIZER: "Salesforce/SFR-Embedding-Mistral"
-        run: uv run python ./examples/python/simple_example.py
+        run: poetry run python ./examples/python/simple_example.py

.github/workflows/test_pgvector.yml

@@ -0,0 +1,69 @@
+name: test | pgvector
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+
+  run_pgvector_integration_test:
+    name: test
+    runs-on: ubuntu-22.04
+    defaults:
+      run:
+        shell: bash
+    services:
+      postgres:
+        image: pgvector/pgvector:pg17
+        env:
+          POSTGRES_USER: cognee
+          POSTGRES_PASSWORD: cognee
+          POSTGRES_DB: cognee_db
+        options: >-
+          --health-cmd pg_isready
+          --health-interval 10s
+          --health-timeout 5s
+          --health-retries 5
+        ports:
+          - 5432:5432
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E postgres --no-interaction
+
+      - name: Run default PGVector
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_pgvector.py

.github/workflows/test_python_3_10.yml

@@ -0,0 +1,87 @@
+name: test | python 3.10
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+  ENV: 'dev'
+
+jobs:
+  run_common:
+    name: Test on ${{ matrix.os }}
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        # These labels correspond to:
+        # - ubuntu-22.04: Linux
+        # - macos-13: macOS Intel
+        # - macos-15: macOS ARM (public preview)
+        os: [ubuntu-22.04, macos-13, macos-15]
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version:  '3.10.x'
+
+      - name: Install Poetry
+        # https://github.com/snok/install-poetry#running-on-windows
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install --no-interaction -E docs -E evals
+      - name: Download NLTK tokenizer data
+        run: |
+          poetry run python -m nltk.downloader punkt_tab averaged_perceptron_tagger_eng
+
+
+      - name: Run unit tests
+        run: poetry run pytest cognee/tests/unit/
+
+      - name: Run integration tests
+        run: poetry run pytest cognee/tests/integration/
+
+      - name: Run default basic pipeline
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_library.py
+
+      - name: Clean up disk space
+        run: |
+          sudo rm -rf ~/.cache
+          sudo rm -rf /tmp/*
+          df -h
+
+      - name: Build with Poetry
+        run: poetry build
+
+      - name: Install Package
+        run: |
+         cd dist
+         pip install *.whl

.github/workflows/test_python_3_11.yml

@@ -0,0 +1,89 @@
+name: test | python 3.11
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+  ENV: 'dev'
+
+jobs:
+
+  run_common:
+    name: Test on ${{ matrix.os }}
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        # These labels correspond to:
+        # - ubuntu-22.04: Linux
+        # - macos-13: macOS Intel
+        # - macos-15: macOS ARM (public preview)
+        os: [ubuntu-22.04, macos-13, macos-15]
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version:  '3.11.x'
+
+      - name: Install Poetry
+        # https://github.com/snok/install-poetry#running-on-windows
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install --no-interaction -E docs -E evals
+
+      - name: Download NLTK tokenizer data
+        run: |
+          poetry run python -m nltk.downloader punkt_tab averaged_perceptron_tagger_eng
+
+
+      - name: Run unit tests
+        run: poetry run pytest cognee/tests/unit/
+
+      - name: Run integration tests
+        run: poetry run pytest cognee/tests/integration/
+
+      - name: Run default basic pipeline
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_library.py
+
+      - name: Clean up disk space
+        run: |
+          sudo rm -rf ~/.cache
+          sudo rm -rf /tmp/*
+          df -h
+
+      - name: Build with Poetry
+        run: poetry build
+
+      - name: Install Package
+        run: |
+         cd dist
+         pip install *.whl

.github/workflows/test_python_3_12.yml

@@ -0,0 +1,87 @@
+name: test | python 3.12
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+  ENV: 'dev'
+
+jobs:
+
+  run_common:
+    name: Test on ${{ matrix.os }}
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        # These labels correspond to:
+        # - ubuntu-22.04: Linux
+        # - macos-13: macOS Intel
+        # - macos-15: macOS ARM (public preview)
+        os: [ubuntu-22.04, macos-13, macos-15]
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.12.x'
+
+      - name: Install Poetry
+        # https://github.com/snok/install-poetry#running-on-windows
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install --no-interaction -E docs -E evals
+      - name: Download NLTK tokenizer data
+        run: |
+          poetry run python -m nltk.downloader punkt_tab averaged_perceptron_tagger_eng
+
+      - name: Run unit tests
+        run: poetry run pytest cognee/tests/unit/
+
+      - name: Run integration tests
+        run: poetry run pytest cognee/tests/integration/
+
+      - name: Run default basic pipeline
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_library.py
+
+      - name: Clean up disk space
+        run: |
+          sudo rm -rf ~/.cache
+          sudo rm -rf /tmp/*
+          df -h
+
+      - name: Build with Poetry
+        run: poetry build
+
+      - name: Install Package
+        run: |
+         cd dist
+         pip install *.whl

.github/workflows/test_qdrant.yml

@@ -0,0 +1,57 @@
+name: test | qdrant
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+
+  run_qdrant_integration_test:
+    name: test
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E qdrant --no-interaction
+
+      - name: Run default Qdrant
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+          VECTOR_DB_URL: ${{ secrets.QDRANT_API_URL }}
+          VECTOR_DB_KEY: ${{ secrets.QDRANT_API_KEY }}
+        run: poetry run python ./cognee/tests/test_qdrant.py

.github/workflows/test_s3_file_storage.yml

@@ -1,44 +0,0 @@
-name: test | s3 file storage
-
-on:
-  workflow_call:
-
-permissions:
-  contents: read
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs:
-  test-s3-storage:
-    name: Run S3 File Storage Test
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11.x'
-          extra-dependencies: "aws"
-
-      - name: Run S3 File Storage Test
-        env:
-          STORAGE_BACKEND: s3
-          ENABLE_BACKEND_ACCESS_CONTROL: True
-          AWS_REGION: eu-west-1
-          AWS_ENDPOINT_URL: https://s3-eu-west-1.amazonaws.com
-          AWS_ACCESS_KEY_ID: ${{ secrets.AWS_S3_DEV_USER_KEY_ID }}
-          AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_S3_DEV_USER_SECRET_KEY }}
-          STORAGE_BUCKET_NAME: github-runner-cognee-tests
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_s3_file_storage.py

.github/workflows/test_simple_example.yml

@@ -0,0 +1,22 @@
+name: test | simple example
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  run_simple_example_test:
+      uses: ./.github/workflows/reusable_python_example.yml
+      with:
+        example-location: ./examples/python/simple_example.py
+      secrets:
+        LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+        GRAPHISTRY_USERNAME: ${{ secrets.GRAPHISTRY_USERNAME }}
+        GRAPHISTRY_PASSWORD: ${{ secrets.GRAPHISTRY_PASSWORD }}

.github/workflows/test_suites.yml

@@ -1,213 +0,0 @@
-name: Test Suites
-permissions:
-  contents: read
-
-on:
-  push:
-    branches: [ main, dev ]
-  pull_request:
-    branches: [ main, dev ]
-    types: [opened, synchronize, reopened, labeled]
-  workflow_dispatch:
-
-concurrency:
-  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
-  cancel-in-progress: true
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs: 
-  pre-test:
-    name: basic checks
-    uses: ./.github/workflows/pre_test.yml
-    
-  basic-tests:
-    name: Basic Tests
-    uses: ./.github/workflows/basic_tests.yml
-    needs: [ pre-test ]
-    secrets: inherit
-
-  e2e-tests:
-    name: End-to-End Tests
-    uses: ./.github/workflows/e2e_tests.yml
-    needs: [ pre-test ]
-    secrets: inherit
-
-  distributed-tests:
-    name: Distributed Cognee Test
-    needs: [ basic-tests, e2e-tests, graph-db-tests ]
-    uses: ./.github/workflows/distributed_test.yml
-    secrets: inherit
-
-  cli-tests:
-    name: CLI Tests
-    uses: ./.github/workflows/cli_tests.yml
-    secrets: inherit
-
-  docker-compose-test:
-    name: Docker Compose Test
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/docker_compose.yml
-    secrets: inherit
-
-  docker-ci-test:
-    name: Docker CI test
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/backend_docker_build_test.yml
-    secrets: inherit
-
-  graph-db-tests:
-    name: Graph Database Tests
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/graph_db_tests.yml
-    secrets: inherit
-
-  temporal-graph-tests:
-    name: Temporal Graph Test
-    needs: [ basic-tests, e2e-tests, graph-db-tests ]
-    uses: ./.github/workflows/temporal_graph_tests.yml
-    secrets: inherit
-
-  search-db-tests:
-    name: Search Test on Different DBs
-    needs: [basic-tests, e2e-tests, graph-db-tests]
-    uses: ./.github/workflows/search_db_tests.yml
-    secrets: inherit
-
-  relational-db-migration-tests:
-    name: Relational DB Migration Tests
-    needs: [basic-tests, e2e-tests, graph-db-tests]
-    uses: ./.github/workflows/relational_db_migration_tests.yml
-    secrets: inherit
-
-  notebook-tests:
-    name: Notebook Tests
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/notebooks_tests.yml
-    secrets: inherit
-
-  different-os-tests-basic:
-    name: OS and Python Tests Ubuntu
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/test_different_operating_systems.yml
-    with:
-      python-versions: '["3.10.x", "3.11.x", "3.12.x", "3.13.x"]'
-      os: '["ubuntu-22.04"]'
-    secrets: inherit
-
-  different-os-tests-extended:
-    name: OS and Python Tests Extended
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/test_different_operating_systems.yml
-    with:
-      python-versions: '["3.13.x"]'
-      os: '["macos-15", "windows-latest"]'
-    secrets: inherit
-
-  # Matrix-based vector database tests
-  vector-db-tests:
-    name: Vector DB Tests
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/vector_db_tests.yml
-    secrets: inherit
-
-  # Matrix-based example tests
-  example-tests:
-    name: Example Tests
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/examples_tests.yml
-    secrets: inherit
-
-  mcp-test:
-    name: MCP Tests
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/test_mcp.yml
-    secrets: inherit
-
-  db-examples-tests:
-    name: DB Examples Tests
-    needs: [vector-db-tests, graph-db-tests, relational-db-migration-tests, distributed-tests]
-    uses: ./.github/workflows/db_examples_tests.yml
-    secrets: inherit
-
-  s3-file-storage-test:
-    name: S3 File Storage Test
-    needs: [basic-tests, e2e-tests]
-    uses: ./.github/workflows/test_s3_file_storage.yml
-    secrets: inherit
-
-  # Additional LLM tests
-  llm-tests:
-    name: LLM Test Suite
-    needs: [ basic-tests, e2e-tests ]
-    uses: ./.github/workflows/test_llms.yml
-    secrets: inherit
-
-  # Ollama tests moved to the end
-  ollama-tests:
-    name: Ollama Tests
-    needs: [
-      basic-tests,
-      e2e-tests,
-      graph-db-tests,
-      notebook-tests,
-      different-os-tests-basic,
-      different-os-tests-extended,
-      vector-db-tests,
-      example-tests,
-      llm-tests,
-      mcp-test,
-      relational-db-migration-tests,
-      docker-compose-test,
-      docker-ci-test,
-    ]
-    uses: ./.github/workflows/test_ollama.yml
-    secrets: inherit
-
-  notify:
-    name: Test Completion Status
-    needs: [
-      basic-tests,
-      e2e-tests,
-      cli-tests,
-      graph-db-tests,
-      notebook-tests,
-      different-os-tests-basic,
-      different-os-tests-extended,
-      vector-db-tests,
-      example-tests,
-      db-examples-tests,
-      mcp-test,
-      llm-tests,
-      ollama-tests,
-      relational-db-migration-tests,
-      docker-compose-test,
-      docker-ci-test,
-    ]
-    runs-on: ubuntu-latest
-    if: always()
-    steps:
-      - name: Check Status
-        run: |
-          if [[ "${{ needs.basic-tests.result }}" == "success" &&
-                "${{ needs.e2e-tests.result }}" == "success" &&
-                "${{ needs.cli-tests.result }}" == "success" &&
-                "${{ needs.graph-db-tests.result }}" == "success" &&
-                "${{ needs.notebook-tests.result }}" == "success" &&
-                "${{ needs.different-os-tests-basic.result }}" == "success" &&
-                "${{ needs.different-os-tests-extended.result }}" == "success" &&
-                "${{ needs.vector-db-tests.result }}" == "success" &&
-                "${{ needs.example-tests.result }}" == "success" &&
-                "${{ needs.db-examples-tests.result }}" == "success" &&
-                "${{ needs.relational-db-migration-tests.result }}" == "success" &&
-                "${{ needs.llm-tests.result }}" == "success" &&
-                "${{ needs.docker-compose-test.result }}" == "success" &&
-                "${{ needs.docker-ci-test.result }}" == "success" &&
-                "${{ needs.ollama-tests.result }}" == "success" ]]; then
-            echo "All test suites completed successfully!"
-          else
-            echo "One or more test suites failed."
-            exit 1
-          fi

.github/workflows/test_telemetry.yml

@@ -0,0 +1,72 @@
+name: test | test telemetry
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+  ENV: 'local'
+
+jobs:
+
+  run_common:
+    name: Test on ${{ matrix.os }}
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        # These labels correspond to:
+        # - ubuntu-22.04: Linux
+        os: [ubuntu-22.04]
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.12.x'
+
+      - name: Install Poetry
+        # https://github.com/snok/install-poetry#running-on-windows
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install --no-interaction
+
+      - name: Add telemetry identifier
+        run: |
+          echo "test-machine" > .anon_id
+
+      - name: Run default basic pipeline
+        env:
+          ENV: 'local'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+        run: poetry run python ./cognee/tests/test_library.py
+
+      - name: Clean up disk space
+        run: |
+          sudo rm -rf ~/.cache
+          sudo rm -rf /tmp/*
+          df -h

.github/workflows/test_weaviate.yml

@@ -0,0 +1,57 @@
+name: test | weaviate
+
+on:
+  workflow_dispatch:
+  pull_request:
+    types: [labeled, synchronize]
+
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
+  cancel-in-progress: true
+
+env:
+  RUNTIME__LOG_LEVEL: ERROR
+
+jobs:
+
+  run_weaviate_integration_test:
+    name: test
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+      - name: Check out
+        uses: actions/checkout@master
+
+      - name: Setup Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11.x'
+
+      - name: Install Poetry
+        uses: snok/install-poetry@v1.4.1
+        with:
+          virtualenvs-create: true
+          virtualenvs-in-project: true
+          installer-parallel: true
+
+      - name: Install dependencies
+        run: poetry install -E weaviate --no-interaction
+
+      - name: Run default Weaviate
+        env:
+          ENV: 'dev'
+          LLM_MODEL: ${{ secrets.LLM_MODEL }}
+          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
+          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
+          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
+          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
+          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
+          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
+          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
+          VECTOR_DB_URL: ${{ secrets.WEAVIATE_API_URL }}
+          VECTOR_DB_KEY: ${{ secrets.WEAVIATE_API_KEY }}
+        run: poetry run python ./cognee/tests/test_weaviate.py

.github/workflows/vector_db_tests.yml

@@ -1,131 +0,0 @@
-name: Reusable Vector DB Tests
-
-on:
-  workflow_call:
-    inputs:
-      databases:
-        required: false
-        type: string
-        default: "all"
-        description: "Which vector databases to test (comma-separated list or 'all')"
-    secrets:
-
-      POSTGRES_PASSWORD:
-        required: false
-
-jobs:
-  # run-chromadb-tests:
-  #   name: ChromaDB Tests
-  #   runs-on: ubuntu-22.04
-  #   if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'chromadb') }}
-  #   services:
-  #     chromadb:
-  #       image: chromadb/chroma:0.6.3
-  #       env:
-  #         CHROMA_SERVER_AUTH_CREDENTIALS: "test-token"
-  #         CHROMA_SERVER_AUTH_CREDENTIALS_PROVIDER: "chromadb.auth.token.TokenAuthCredentialsProvider"
-  #         CHROMA_SERVER_AUTH_PROVIDER: "chromadb.auth.token.TokenAuthServerProvider"
-  #       ports:
-  #         - 3002:8000
-  #   steps:
-  #     - name: Check out
-  #       uses: actions/checkout@v4
-  #       with:
-  #         fetch-depth: 0
-
-  #     - name: Cognee Setup
-  #       uses: ./.github/actions/cognee_setup
-  #       with:
-  #         python-version: ${{ inputs.python-version }}
-
-  #     - name: Install specific db dependency
-  #       run: |
-  #         poetry install -E chromadb
-
-  #     - name: Run ChromaDB Tests
-  #       env:
-  #         ENV: 'dev'
-  #         VECTOR_DB_PROVIDER: chromadb
-  #         VECTOR_DB_URL: http://localhost:3002
-  #         VECTOR_DB_KEY: test-token
-  #         LLM_MODEL: ${{ secrets.LLM_MODEL }}
-  #         LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-  #         LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-  #         LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-  #         EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-  #         EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-  #         EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-  #         EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-  #       run: uv run python ./cognee/tests/test_chromadb.py
-
-
-  run-postgres-tests:
-    name: PostgreSQL Tests
-    runs-on: ubuntu-22.04
-    if: ${{ inputs.databases == 'all' || contains(inputs.databases, 'postgres') }}
-    services:
-      postgres:
-        image: pgvector/pgvector:pg17
-        env:
-          POSTGRES_USER: cognee
-          POSTGRES_PASSWORD: ${{ secrets.POSTGRES_PASSWORD }}
-          POSTGRES_DB: cognee_db
-        options: >-
-          --health-cmd pg_isready
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-        ports:
-          - 5432:5432
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-          extra-dependencies: "postgres"
-
-      - name: Run PGVector Tests
-        env:
-          ENV: 'dev'
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_pgvector.py
-
-  run-lancedb-tests:
-    name: LanceDB Tests
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ inputs.python-version }}
-
-      - name: Run LanceDB Tests
-        env:
-          ENV: 'dev'
-          LLM_MODEL: ${{ secrets.LLM_MODEL }}
-          LLM_ENDPOINT: ${{ secrets.LLM_ENDPOINT }}
-          LLM_API_KEY: ${{ secrets.LLM_API_KEY }}
-          LLM_API_VERSION: ${{ secrets.LLM_API_VERSION }}
-          EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-          EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-          EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-          EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-        run: uv run python ./cognee/tests/test_lancedb.py

.github/workflows/weighted_edges_tests.yml

@@ -1,168 +0,0 @@
-name: Weighted Edges Tests
-
-on:
-  push:
-    branches: [ main, dev, weighted_edges ]
-    paths:
-      - 'cognee/modules/graph/utils/get_graph_from_model.py'
-      - 'cognee/infrastructure/engine/models/Edge.py'
-      - 'cognee/tests/unit/interfaces/graph/test_weighted_edges.py'
-      - 'examples/python/weighted_edges_example.py'
-      - '.github/workflows/weighted_edges_tests.yml'
-  pull_request:
-    branches: [ main, dev ]
-    paths:
-      - 'cognee/modules/graph/utils/get_graph_from_model.py'
-      - 'cognee/infrastructure/engine/models/Edge.py'
-      - 'cognee/tests/unit/interfaces/graph/test_weighted_edges.py'
-      - 'examples/python/weighted_edges_example.py'
-      - '.github/workflows/weighted_edges_tests.yml'
-
-env:
-  RUNTIME__LOG_LEVEL: ERROR
-  ENV: 'dev'
-
-jobs:
-  test-weighted-edges-functionality:
-    name: Test Weighted Edges Core Functionality
-    runs-on: ubuntu-22.04
-    strategy:
-      matrix:
-        python-version: ['3.11', '3.12']
-    env:
-      LLM_PROVIDER: openai
-      LLM_MODEL: gpt-5-mini
-      LLM_API_KEY: ${{ secrets.OPENAI_API_KEY }}
-
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Run Weighted Edges Unit Tests
-        run: |
-          uv run pytest cognee/tests/unit/interfaces/graph/test_weighted_edges.py -v --tb=short
-
-      - name: Run Standard Graph Tests (Regression)
-        run: |
-          uv run pytest cognee/tests/unit/interfaces/graph/get_graph_from_model_unit_test.py -v --tb=short
-
-  test-with-different-databases:
-    name: Test Weighted Edges with Different Graph Databases
-    runs-on: ubuntu-22.04
-    strategy:
-      matrix:
-        database: ['kuzu', 'neo4j']
-        include:
-          - database: kuzu
-            graph_db_provider: "kuzu"
-          - database: neo4j
-            graph_db_provider: "neo4j"
-    env:
-      LLM_PROVIDER: openai
-      LLM_MODEL: gpt-5-mini
-      LLM_ENDPOINT: https://api.openai.com/v1
-      LLM_API_KEY: ${{ secrets.OPENAI_API_KEY  }}
-      LLM_API_VERSION: "2024-02-01"
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11'
-
-      - name: Setup Neo4j with GDS
-        uses: ./.github/actions/setup_neo4j
-        id: neo4j
-
-      - name: Dependencies already installed
-        run: echo "Dependencies already installed in setup"
-
-      - name: Run Weighted Edges Tests
-        env:
-          ENABLE_BACKEND_ACCESS_CONTROL: 'false'
-          GRAPH_DATABASE_PROVIDER: ${{ matrix.graph_db_provider }}
-          GRAPH_DATABASE_URL: ${{ matrix.graph_db_provider == 'neo4j' && steps.neo4j.outputs.neo4j-url || '' }}
-          GRAPH_DATABASE_USERNAME: ${{ matrix.graph_db_provider == 'neo4j' && steps.neo4j.outputs.neo4j-username || '' }}
-          GRAPH_DATABASE_PASSWORD: ${{ matrix.graph_db_provider == 'neo4j' && steps.neo4j.outputs.neo4j-password || '' }}
-        run: |
-          uv run pytest cognee/tests/unit/interfaces/graph/test_weighted_edges.py -v --tb=short
-
-  test-examples:
-    name: Test Weighted Edges Examples
-    runs-on: ubuntu-22.04
-    env:
-      LLM_PROVIDER: openai
-      LLM_MODEL: gpt-5-mini
-      LLM_ENDPOINT: https://api.openai.com/v1
-      LLM_API_KEY: ${{ secrets.OPENAI_API_KEY  }}
-      LLM_API_VERSION: "2024-02-01"
-      EMBEDDING_MODEL: ${{ secrets.EMBEDDING_MODEL }}
-      EMBEDDING_ENDPOINT: ${{ secrets.EMBEDDING_ENDPOINT }}
-      EMBEDDING_API_KEY: ${{ secrets.EMBEDDING_API_KEY }}
-      EMBEDDING_API_VERSION: ${{ secrets.EMBEDDING_API_VERSION }}
-
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11'
-
-      - name: Test Weighted Edges Example
-        run: |
-          uv run python examples/python/weighted_edges_example.py
-
-      - name: Verify Visualization File Created
-        run: |
-          if [ -f "examples/python/weighted_graph_visualization.html" ]; then
-            echo "✅ Visualization file created successfully"
-            ls -la examples/python/weighted_graph_visualization.html
-          else
-            echo "❌ Visualization file not found"
-            exit 1
-          fi
-
-
-
-  code-quality:
-    name: Code Quality for Weighted Edges
-    runs-on: ubuntu-22.04
-    steps:
-      - name: Check out repository
-        uses: actions/checkout@v4
-        with:
-          fetch-depth: 0
-
-      - name: Cognee Setup
-        uses: ./.github/actions/cognee_setup
-        with:
-          python-version: '3.11'
-
-      - name: Run Linting on Weighted Edges Files
-        uses: astral-sh/ruff-action@v2
-        with:
-          args: "check cognee/modules/graph/utils/get_graph_from_model.py cognee/tests/unit/interfaces/graph/test_weighted_edges.py examples/python/weighted_edges_example.py"
-
-      - name: Run Formatting Check on Weighted Edges Files
-        uses: astral-sh/ruff-action@v2
-        with:
-          args: "format --check cognee/modules/graph/utils/get_graph_from_model.py cognee/tests/unit/interfaces/graph/test_weighted_edges.py examples/python/weighted_edges_example.py"

.gitignore

@@ -36,8 +36,6 @@ share/python-wheels/
 *.egg-info/
 .installed.cfg
 *.egg
-.python-version
-cognee-mcp/.python-version
 MANIFEST
 
 # PyInstaller
@@ -75,11 +73,6 @@ local_settings.py
 db.sqlite3
 db.sqlite3-journal
 
-# Cognee logs directory - keep directory, ignore contents
-logs/*
-!logs/.gitkeep
-!logs/README.md
-
 # Flask stuff:
 instance/
 .webassets-cache
@@ -186,7 +179,6 @@ cognee/cache/
 # Default cognee system directory, used in development
 .cognee_system/
 .data_storage/
-.cognee_cache/
 .artifacts/
 .anon_id
 
@@ -196,4 +188,4 @@ node_modules/
 SWE-bench_testsample/
 
 # ChromaDB Data
-.chromadb_data/
+.chromadb_data/

.mergify.yml

@@ -1,9 +0,0 @@
-pull_request_rules:
-  - name: Backport to main when backport_main label is set
-    conditions:
-      - label=backport_main
-      - base=dev
-    actions:
-      backport:
-        branches:
-          - main

.python-version

@@ -0,0 +1 @@
+3.11

AGENTS.md

@@ -1,132 +0,0 @@
-## Repository Guidelines
-
-This document summarizes how to work with the cognee repository: how it’s organized, how to build, test, lint, and contribute. It mirrors our actual tooling and CI while providing quick commands for local development.
-
-## Project Structure & Module Organization
-
-- `cognee/`: Core Python library and API.
-  - `api/`: FastAPI application and versioned routers (add, cognify, memify, search, delete, users, datasets, responses, visualize, settings, sync, update, checks).
-  - `cli/`: CLI entry points and subcommands invoked via `cognee` / `cognee-cli`.
-  - `infrastructure/`: Databases, LLM providers, embeddings, loaders, and storage adapters.
-  - `modules/`: Domain logic (graph, retrieval, ontology, users, processing, observability, etc.).
-  - `tasks/`: Reusable tasks (e.g., code graph, web scraping, storage). Extend with new tasks here.
-  - `eval_framework/`: Evaluation utilities and adapters.
-  - `shared/`: Cross-cutting helpers (logging, settings, utils).
-  - `tests/`: Unit, integration, CLI, and end-to-end tests organized by feature.
-  - `__main__.py`: Entrypoint to route to CLI.
-- `cognee-mcp/`: Model Context Protocol server exposing cognee as MCP tools (SSE/HTTP/stdio). Contains its own README and Dockerfile.
-- `cognee-frontend/`: Next.js UI for local development and demos.
-- `distributed/`: Utilities for distributed execution (Modal, workers, queues).
-- `examples/`: Example scripts demonstrating the public APIs and features (graph, code graph, multimodal, permissions, etc.).
-- `notebooks/`: Jupyter notebooks for demos and tutorials.
-- `alembic/`: Database migrations for relational backends.
-
-Notes:
-- Co-locate feature-specific helpers under their respective package (`modules/`, `infrastructure/`, or `tasks/`).
-- Extend the system by adding new tasks, loaders, or retrievers rather than modifying core pipeline mechanisms.
-
-## Build, Test, and Development Commands
-
-Python (root) – requires Python >= 3.10 and < 3.14. We recommend `uv` for speed and reproducibility.
-
-- Create/refresh env and install dev deps:
-```bash
-uv sync --dev --all-extras --reinstall
-```
-
-- Run the CLI (examples):
-```bash
-uv run cognee-cli add "Cognee turns documents into AI memory."
-uv run cognee-cli cognify
-uv run cognee-cli search "What does cognee do?"
-uv run cognee-cli -ui   # Launches UI, backend API, and MCP server together
-```
-
-- Start the FastAPI server directly:
-```bash
-uv run python -m cognee.api.client
-```
-
-- Run tests (CI mirrors these commands):
-```bash
-uv run pytest cognee/tests/unit/ -v
-uv run pytest cognee/tests/integration/ -v
-```
-
-- Lint and format (ruff):
-```bash
-uv run ruff check .
-uv run ruff format .
-```
-
-- Optional static type checks (mypy):
-```bash
-uv run mypy cognee/
-```
-
-MCP Server (`cognee-mcp/`):
-
-- Install and run locally:
-```bash
-cd cognee-mcp
-uv sync --dev --all-extras --reinstall
-uv run python src/server.py               # stdio (default)
-uv run python src/server.py --transport sse
-uv run python src/server.py --transport http --host 127.0.0.1 --port 8000 --path /mcp
-```
-
-- API Mode (connect to a running Cognee API):
-```bash
-uv run python src/server.py --transport sse --api-url http://localhost:8000 --api-token YOUR_TOKEN
-```
-
-- Docker quickstart (examples): see `cognee-mcp/README.md` for full details
-```bash
-docker run -e TRANSPORT_MODE=http --env-file ./.env -p 8000:8000 --rm -it cognee/cognee-mcp:main
-```
-
-Frontend (`cognee-frontend/`):
-```bash
-cd cognee-frontend
-npm install
-npm run dev     # Next.js dev server
-npm run lint    # ESLint
-npm run build && npm start
-```
-
-## Coding Style & Naming Conventions
-
-Python:
-- 4-space indentation, modules and functions in `snake_case`, classes in `PascalCase`.
-- Public APIs should be type-annotated where practical.
-- Use `ruff format` before committing; `ruff check` enforces import hygiene and style (line-length 100 configured in `pyproject.toml`).
-- Prefer explicit, structured error handling. Use shared logging utilities in `cognee.shared.logging_utils`.
-
-MCP server and Frontend:
-- Follow the local `README.md` and ESLint/TypeScript configuration in `cognee-frontend/`.
-
-## Testing Guidelines
-
-- Place Python tests under `cognee/tests/`.
-  - Unit tests: `cognee/tests/unit/`
-  - Integration tests: `cognee/tests/integration/`
-  - CLI tests: `cognee/tests/cli_tests/`
-- Name test files `test_*.py`. Use `pytest.mark.asyncio` for async tests.
-- Avoid external state; rely on test fixtures and the CI-provided env vars when LLM/embedding providers are required. See CI workflows under `.github/workflows/` for expected environment variables.
-- When adding public APIs, provide/update targeted examples under `examples/python/`.
-
-## Commit & Pull Request Guidelines
-
-- Use clear, imperative subjects (≤ 72 chars) and conventional commit styling in PR titles. Our CI validates semantic PR titles (see `.github/workflows/pr_lint`). Examples:
-  - `feat(graph): add temporal edge weighting`
-  - `fix(api): handle missing auth cookie`
-  - `docs: update installation instructions`
-- Reference related issues/discussions in the PR body and provide brief context.
-- PRs should describe scope, list local test commands run, and mention any impacts on MCP server or UI if applicable.
-- Sign commits and affirm the DCO (see `CONTRIBUTING.md`).
-
-## CI Mirrors Local Commands
-
-Our GitHub Actions run the same ruff checks and pytest suites shown above (`.github/workflows/basic_tests.yml` and related workflows). Use the commands in this document locally to minimize CI surprises.
-
-

CONTRIBUTING.md

@@ -1,6 +1,3 @@
-> [!IMPORTANT]
-> **Note for contributors:** When branching out, create a new branch from the `dev` branch.
-
 # 🎉 Welcome to **cognee**! 
 
 We're excited that you're interested in contributing to our project! 
@@ -12,7 +9,6 @@ This guide will help you get started and ensure your contributions can be effici
 - [Code of Conduct](CODE_OF_CONDUCT.md)
 - [Discord Community](https://discord.gg/bcy8xFAtfd)  
 - [Issue Tracker](https://github.com/topoteretes/cognee/issues)
-- [Cognee Docs](https://docs.cognee.ai)
 
 ## 1. 🚀 Ways to Contribute
 
@@ -70,13 +66,6 @@ Looking for a place to start? Try filtering for [good first issues](https://gith
 git clone https://github.com/<your-github-username>/cognee.git
 cd cognee
 ```
-In case you are working on Vector and Graph Adapters
-1. Fork the [**cognee-community**](https://github.com/topoteretes/cognee-community) repository
-2. Clone your fork:
-```shell
-git clone https://github.com/<your-github-username>/cognee-community.git
-cd cognee-community
-```
 
 ### Create a Branch
 
@@ -97,26 +86,9 @@ git checkout -b feature/your-feature-name
 python cognee/cognee/tests/test_library.py
 ```
 
-### Running Simple Example
-
-Change .env.example into .env and provide your OPENAI_API_KEY as LLM_API_KEY
-
-Make sure to run ```shell uv sync ``` in the root cloned folder or set up a virtual environment to run cognee
-
-```shell
-python cognee/cognee/examples/python/simple_example.py
-```
-or 
-
-```shell
-uv run python cognee/cognee/examples/python/simple_example.py
-```
-
 ## 4. 📤 Submitting Changes
 
-1. Install ruff on your system
-2. Run ```ruff format .``` and ``` ruff check ``` and fix the issues
-3. Push your changes:
+1. Push your changes:
 ```shell
 git add .
 git commit -s -m "Description of your changes"
@@ -124,8 +96,8 @@ git push origin feature/your-feature-name
 ```
 
 2. Create a Pull Request:
-   - Go to the [**cognee** repository](https://github.com/topoteretes/cognee) or [cognee community repository](https://github.com/topoteretes/cognee-community)
-   - Click "Compare & Pull Request" and open a PR against dev branch
+   - Go to the [**cognee** repository](https://github.com/topoteretes/cognee)
+   - Click "Compare & Pull Request"
    - Fill in the PR template with details about your changes
 
 ## 5. 📜 Developer Certificate of Origin (DCO)

CONTRIBUTORS.md

@@ -1,12 +0,0 @@
-## 💫 Contributors
-
-Thanks to our amazing contributors! 💖
-
-<a href="https://github.com/topoteretes/cognee/graphs/contributors">
-  <img src="https://contrib.rocks/image?repo=topoteretes/cognee" />
-</a>
-
-## 🏆 Top Contributors
-
-| Rank | Contributor | Contributions |
-|------|------------|---------------|

Dockerfile

@@ -1,69 +1,57 @@
-# Use a Python image with uv pre-installed
-FROM ghcr.io/astral-sh/uv:python3.12-bookworm-slim AS uv
+FROM python:3.11-slim
 
-# Install the project into `/app`
-WORKDIR /app
-
-# Enable bytecode compilation
-# ENV UV_COMPILE_BYTECODE=1
-
-# Copy from the cache instead of linking since it's a mounted volume
-ENV UV_LINK_MODE=copy
+# Define Poetry extras to install
+ARG POETRY_EXTRAS="\
+# Storage & Databases \
+filesystem postgres weaviate qdrant neo4j falkordb milvus kuzu \
+# Notebooks & Interactive Environments \
+notebook \
+# LLM & AI Frameworks \
+langchain llama-index gemini huggingface ollama mistral groq \
+# Evaluation & Monitoring \
+deepeval evals posthog \
+# Graph Processing & Code Analysis \
+codegraph graphiti \
+# Document Processing \
+docs"
 
 # Set build argument
 ARG DEBUG
 
 # Set environment variable based on the build argument
 ENV DEBUG=${DEBUG}
+ENV PIP_NO_CACHE_DIR=true
+ENV PATH="${PATH}:/root/.poetry/bin"
 
-# Install system dependencies
-RUN apt-get update && apt-get install -y \
-    gcc \
-    libpq-dev \
-    git \
-    curl \
-    cmake \
-    clang \
-    build-essential \
-    && rm -rf /var/lib/apt/lists/*
+RUN apt-get update && apt-get install
 
-# Copy pyproject.toml and lockfile first for better caching
-COPY README.md pyproject.toml uv.lock entrypoint.sh ./
+RUN apt-get install -y \
+  gcc \
+  libpq-dev
 
-# Install the project's dependencies using the lockfile and settings
-RUN --mount=type=cache,target=/root/.cache/uv \
-    uv sync --extra debug --extra api --extra postgres --extra neo4j --extra llama-index --extra ollama --extra mistral --extra groq --extra anthropic --frozen --no-install-project --no-dev --no-editable
+WORKDIR /app
+COPY pyproject.toml poetry.lock /app/
+
+RUN pip install poetry
+
+# Don't create virtualenv since Docker is already isolated
+RUN poetry config virtualenvs.create false
+
+# Install the dependencies using the defined extras
+RUN poetry install --extras "${POETRY_EXTRAS}" --no-root --without dev
+
+# Set the PYTHONPATH environment variable to include the /app directory
+ENV PYTHONPATH=/app
+
+COPY cognee/ /app/cognee
 
 # Copy Alembic configuration
 COPY alembic.ini /app/alembic.ini
 COPY alembic/ /app/alembic
 
-# Then, add the rest of the project source code and install it
-# Installing separately from its dependencies allows optimal layer caching
-COPY ./cognee /app/cognee
-COPY ./distributed /app/distributed
-RUN --mount=type=cache,target=/root/.cache/uv \
-uv sync --extra debug --extra api --extra postgres --extra neo4j --extra llama-index --extra ollama --extra mistral --extra groq --extra anthropic --frozen --no-dev --no-editable
-
-FROM python:3.12-slim-bookworm
-
-RUN apt-get update && apt-get install -y \
-    libpq5 \
-    && rm -rf /var/lib/apt/lists/*
-
-WORKDIR /app
-
-COPY --from=uv /app /app
-# COPY --from=uv /app/.venv /app/.venv
-# COPY --from=uv /root/.local /root/.local
-
+COPY entrypoint.sh /app/entrypoint.sh
 RUN chmod +x /app/entrypoint.sh
 
-# Place executables in the environment at the front of the path
-ENV PATH="/app/.venv/bin:$PATH"
-
-ENV PYTHONPATH=/app
-# ENV LOG_LEVEL=ERROR
-ENV PYTHONUNBUFFERED=1
+RUN sed -i 's/\r$//' /app/entrypoint.sh
 
 ENTRYPOINT ["/app/entrypoint.sh"]

Dockerfile_modal

@@ -4,6 +4,7 @@ FROM python:3.11-slim
 ENV PIP_NO_CACHE_DIR=true
 ENV PATH="${PATH}:/root/.poetry/bin"
 ENV PYTHONPATH=/app
+ENV RUN_MODE=modal
 ENV SKIP_MIGRATIONS=true
 
 # System dependencies
@@ -17,13 +18,15 @@ RUN apt-get update && apt-get install -y \
 
 WORKDIR /app
 
-COPY pyproject.toml poetry.lock README.md /app/
+
+ENV PYTHONPATH=/app
+WORKDIR /app
+COPY pyproject.toml poetry.lock /app/
+
 
 RUN pip install poetry
 
-RUN poetry config virtualenvs.create false
-
-RUN poetry install --extras distributed --extras evals --extras deepeval --no-root
+RUN poetry install --all-extras --no-root --without dev
 
 COPY cognee/ /app/cognee
-COPY distributed/ /app/distributed
+COPY README.md /app/README.md

README.md

@@ -5,208 +5,173 @@
 
   <br />
 
-  Cognee - Accurate and Persistent AI Memory
+  cognee - memory layer for AI apps and Agents
 
   <p align="center">
   <a href="https://www.youtube.com/watch?v=1bezuvLwJmw&t=2s">Demo</a>
   .
-  <a href="https://docs.cognee.ai/">Docs</a>
-  .
-  <a href="https://cognee.ai">Learn More</a>
+  <a href="https://cognee.ai">Learn more</a>
   ·
   <a href="https://discord.gg/NQPKmU5CCg">Join Discord</a>
-  ·
-  <a href="https://www.reddit.com/r/AIMemory/">Join r/AIMemory</a>
-  .
-  <a href="https://github.com/topoteretes/cognee-community">Community Plugins & Add-ons</a>
   </p>
 
 
   [![GitHub forks](https://img.shields.io/github/forks/topoteretes/cognee.svg?style=social&label=Fork&maxAge=2592000)](https://GitHub.com/topoteretes/cognee/network/)
   [![GitHub stars](https://img.shields.io/github/stars/topoteretes/cognee.svg?style=social&label=Star&maxAge=2592000)](https://GitHub.com/topoteretes/cognee/stargazers/)
   [![GitHub commits](https://badgen.net/github/commits/topoteretes/cognee)](https://GitHub.com/topoteretes/cognee/commit/)
-  [![GitHub tag](https://badgen.net/github/tag/topoteretes/cognee)](https://github.com/topoteretes/cognee/tags/)
+  [![Github tag](https://badgen.net/github/tag/topoteretes/cognee)](https://github.com/topoteretes/cognee/tags/)
   [![Downloads](https://static.pepy.tech/badge/cognee)](https://pepy.tech/project/cognee)
   [![License](https://img.shields.io/github/license/topoteretes/cognee?colorA=00C586&colorB=000000)](https://github.com/topoteretes/cognee/blob/main/LICENSE)
   [![Contributors](https://img.shields.io/github/contributors/topoteretes/cognee?colorA=00C586&colorB=000000)](https://github.com/topoteretes/cognee/graphs/contributors)
-  <a href="https://github.com/sponsors/topoteretes"><img src="https://img.shields.io/badge/Sponsor-❤️-ff69b4.svg" alt="Sponsor"></a>
 
-<p>
-  <a href="https://www.producthunt.com/posts/cognee?embed=true&utm_source=badge-top-post-badge&utm_medium=badge&utm_souce=badge-cognee" target="_blank" style="display:inline-block; margin-right:10px;">
-    <img src="https://api.producthunt.com/widgets/embed-image/v1/top-post-badge.svg?post_id=946346&theme=light&period=daily&t=1744472480704" alt="cognee - Memory&#0032;for&#0032;AI&#0032;Agents&#0032;&#0032;in&#0032;5&#0032;lines&#0032;of&#0032;code | Product Hunt" width="250" height="54" />
-  </a>
+  AI Agent responses you can rely on.
 
-  <a href="https://trendshift.io/repositories/13955" target="_blank" style="display:inline-block;">
-    <img src="https://trendshift.io/api/badge/repositories/13955" alt="topoteretes%2Fcognee | Trendshift" width="250" height="55" />
-  </a>
-</p>
 
-Use your data to build personalized and dynamic memory for AI Agents. Cognee lets you replace RAG with scalable and modular ECL (Extract, Cognify, Load) pipelines.
 
-  <p align="center">
-  🌐 Available Languages
-  :
-  <!-- Keep these links. Translations will automatically update with the README. -->
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=de">Deutsch</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=es">Español</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=fr">Français</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=ja">日本語</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=ko">한국어</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=pt">Português</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=ru">Русский</a> |
-  <a href="https://www.readme-i18n.com/topoteretes/cognee?lang=zh">中文</a>
-  </p>
+Build dynamic Agent memory using scalable, modular ECL (Extract, Cognify, Load) pipelines.
 
+More on [use-cases](https://docs.cognee.ai/use_cases).
 
 <div style="text-align: center">
-  <img src="https://raw.githubusercontent.com/topoteretes/cognee/refs/heads/main/assets/cognee_benefits.png" alt="Why cognee?" width="50%" />
-</div>
+  <img src="https://raw.githubusercontent.com/topoteretes/cognee/refs/heads/dev/assets/cognee_benefits.png" alt="Why cognee?" width="100%" />
 </div>
 
-## About Cognee
-
-Cognee is an open-source tool and platform that transforms your raw data into persistent and dynamic AI memory for Agents. It combines vector search with graph databases to make your documents both searchable by meaning and connected by relationships. 
-Cognee offers default memory creation and search which we describe bellow. But with Cognee you can build your own!
+</div>
 
 
-### Cognee Open Source:
-
-- Interconnects any type of data — including past conversations, files, images, and audio transcriptions
-- Replaces traditional RAG systems with a unified memory layer built on graphs and vectors
-- Reduces developer effort and infrastructure cost while improving quality and precision
-- Provides Pythonic data pipelines for ingestion from 30+ data sources
-- Offers high customizability through user-defined tasks, modular pipelines, and built-in search endpoints
 
 
-## Basic Usage & Feature Guide
+## Features
 
-To learn more, [check out this short, end-to-end Colab walkthrough](https://colab.research.google.com/drive/12Vi9zID-M3fpKpKiaqDBvkk98ElkRPWy?usp=sharing) of Cognee's core features.
+- Interconnect and retrieve your past conversations, documents, images and audio transcriptions
+- Reduce hallucinations, developer effort, and cost.
+- Load data to graph and vector databases using only Pydantic
+- Manipulate your data while ingesting from 30+ data sources
 
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/12Vi9zID-M3fpKpKiaqDBvkk98ElkRPWy?usp=sharing)
+## Get Started
 
-## Quickstart
+Get started quickly with a Google Colab  <a href="https://colab.research.google.com/drive/1g-Qnx6l_ecHZi0IOw23rg0qC4TYvEvWZ?usp=sharing">notebook</a>  or  <a href="https://github.com/topoteretes/cognee-starter">starter repo</a>
 
-Let’s try Cognee in just a few lines of code. For detailed setup and configuration, see the [Cognee Docs](https://docs.cognee.ai/getting-started/installation#environment-configuration).
+## Contributing
+Your contributions are at the core of making this a true open source project. Any contributions you make are **greatly appreciated**. See [`CONTRIBUTING.md`](CONTRIBUTING.md) for more information.
 
-### Prerequisites
 
-- Python 3.10 to 3.13
 
-### Step 1: Install Cognee
 
-You can install Cognee with **pip**, **poetry**, **uv**, or your preferred Python package manager.
+
+## 📦 Installation
+
+You can install Cognee using either **pip**, **poetry**, **uv** or any other python package manager.
+
+### With pip
 
 ```bash
-uv pip install cognee
+pip install cognee
 ```
 
-### Step 2: Configure the LLM
-```python
+## 💻 Basic Usage
+
+### Setup
+
+```
 import os
 os.environ["LLM_API_KEY"] = "YOUR OPENAI_API_KEY"
+
 ```
-Alternatively, create a `.env` file using our [template](https://github.com/topoteretes/cognee/blob/main/.env.template).
 
-To integrate other LLM providers, see our [LLM Provider Documentation](https://docs.cognee.ai/setup-configuration/llm-providers).
+You can also set the variables by creating .env file, using our <a href="https://github.com/topoteretes/cognee/blob/main/.env.template">template.</a>
+To use different LLM providers, for more info check out our <a href="https://docs.cognee.ai">documentation</a>
 
-### Step 3: Run the Pipeline
 
-Cognee will take your documents, generate a knowledge graph from them and then query the graph based on combined relationships. 
+### Simple example
 
-Now, run a minimal pipeline:
+Add LLM_API_KEY to .env using the command bellow.
+```
+echo "LLM_API_KEY=YOUR_OPENAI_API_KEY" > .env
+```
+You can see available env variables in the repository `.env.template` file. If you don't specify it otherwise, like in this example, SQLite (relational database), LanceDB (vector database) and NetworkX (graph store) will be used as default components.
+
+This script will run the default pipeline:
 
 ```python
 import cognee
 import asyncio
-from pprint import pprint
-
+from cognee.modules.search.types import SearchType
 
 async def main():
-    # Add text to cognee
-    await cognee.add("Cognee turns documents into AI memory.")
+    # Create a clean slate for cognee -- reset data and system state
+    await cognee.prune.prune_data()
+    await cognee.prune.prune_system(metadata=True)
+    # cognee knowledge graph will be created based on this text
+    text = """
+    Natural language processing (NLP) is an interdisciplinary
+    subfield of computer science and information retrieval.
+    """
 
-    # Generate the knowledge graph
+    print("Adding text to cognee:")
+    print(text.strip())
+    # Add the text, and make it available for cognify
+    await cognee.add(text)
+
+    # Use LLMs and cognee to create knowledge graph
     await cognee.cognify()
+    print("Cognify process complete.\n")
 
-    # Add memory algorithms to the graph
-    await cognee.memify()
 
-    # Query the knowledge graph
-    results = await cognee.search("What does Cognee do?")
+    query_text = "Tell me about NLP"
+    print(f"Searching cognee for insights with query: '{query_text}'")
+    # Query cognee for insights on the added text
+    search_results = await cognee.search(
+        query_text=query_text, query_type=SearchType.INSIGHTS
+    )
 
-    # Display the results
-    for result in results:
-        pprint(result)
+    print("Search results:")
+    # Display results
+    for result_text in search_results:
+        print(result_text)
 
+    # Example output:
+       # ({'id': UUID('bc338a39-64d6-549a-acec-da60846dd90d'), 'updated_at': datetime.datetime(2024, 11, 21, 12, 23, 1, 211808, tzinfo=datetime.timezone.utc), 'name': 'natural language processing', 'description': 'An interdisciplinary subfield of computer science and information retrieval.'}, {'relationship_name': 'is_a_subfield_of', 'source_node_id': UUID('bc338a39-64d6-549a-acec-da60846dd90d'), 'target_node_id': UUID('6218dbab-eb6a-5759-a864-b3419755ffe0'), 'updated_at': datetime.datetime(2024, 11, 21, 12, 23, 15, 473137, tzinfo=datetime.timezone.utc)}, {'id': UUID('6218dbab-eb6a-5759-a864-b3419755ffe0'), 'updated_at': datetime.datetime(2024, 11, 21, 12, 23, 1, 211808, tzinfo=datetime.timezone.utc), 'name': 'computer science', 'description': 'The study of computation and information processing.'})
+       # (...)
+        #
+        # It represents nodes and relationships in the knowledge graph:
+        # - The first element is the source node (e.g., 'natural language processing').
+        # - The second element is the relationship between nodes (e.g., 'is_a_subfield_of').
+        # - The third element is the target node (e.g., 'computer science').
 
 if __name__ == '__main__':
     asyncio.run(main())
 
 ```
-
-As you can see, the output is generated from the document we previously stored in Cognee:
-
-```bash
-  Cognee turns documents into AI memory.
-```
-
-### Use the Cognee CLI 
-
-As an alternative, you can get started with these essential commands:
-
-```bash
-cognee-cli add "Cognee turns documents into AI memory."
-
-cognee-cli cognify
-
-cognee-cli search "What does Cognee do?"
-cognee-cli delete --all
-
-```
-
-To open the local UI, run:
-```bash
-cognee-cli -ui
-```
-
-## Demos & Examples
-
-See Cognee in action:
-
-### Persistent Agent Memory
-
-[Cognee Memory for LangGraph Agents](https://github.com/user-attachments/assets/e113b628-7212-4a2b-b288-0be39a93a1c3)
-
-### Simple GraphRAG
-
-[Watch Demo](https://github.com/user-attachments/assets/f2186b2e-305a-42b0-9c2d-9f4473f15df8)
-
-### Cognee with Ollama
-
-[Watch Demo](https://github.com/user-attachments/assets/39672858-f774-4136-b957-1e2de67b8981)
+For more advanced usage, have a look at our <a href="https://docs.cognee.ai"> documentation</a>.
 
 
-## Community & Support
+## Understand our architecture
 
-### Contributing
-We welcome contributions from the community! Your input helps make Cognee better for everyone. See [`CONTRIBUTING.md`](CONTRIBUTING.md) to get started.
+<div style="text-align: center">
+  <img src="assets/cognee_diagram.png" alt="cognee concept diagram" width="100%" />
+</div>
 
-### Code of Conduct
 
-We're committed to fostering an inclusive and respectful community. Read our [Code of Conduct](https://github.com/topoteretes/cognee/blob/main/CODE_OF_CONDUCT.md) for guidelines.
 
-## Research & Citation
+## Demos
 
-We recently published a research paper on optimizing knowledge graphs for LLM reasoning:
+What is AI memory:
 
-```bibtex
-@misc{markovic2025optimizinginterfaceknowledgegraphs,
-      title={Optimizing the Interface Between Knowledge Graphs and LLMs for Complex Reasoning},
-      author={Vasilije Markovic and Lazar Obradovic and Laszlo Hajdu and Jovan Pavlovic},
-      year={2025},
-      eprint={2505.24478},
-      archivePrefix={arXiv},
-      primaryClass={cs.AI},
-      url={https://arxiv.org/abs/2505.24478},
-}
-```
+[Learn about cognee](https://github.com/user-attachments/assets/8b2a0050-5ec4-424c-b417-8269971503f0)
+
+
+## Code of Conduct
+
+We are committed to making open source an enjoyable and respectful experience for our community. See <a href="https://github.com/topoteretes/cognee/blob/main/CODE_OF_CONDUCT.md"><code>CODE_OF_CONDUCT</code></a> for more information.
+
+## 💫 Contributors
+
+<a href="https://github.com/topoteretes/cognee/graphs/contributors">
+  <img alt="contributors" src="https://contrib.rocks/image?repo=topoteretes/cognee"/>
+</a>
+
+
+## Star History
+
+[![Star History Chart](https://api.star-history.com/svg?repos=topoteretes/cognee&type=Date)](https://star-history.com/#topoteretes/cognee&Date)

SECURITY.md

@@ -1,6 +0,0 @@
-# Reporting Security Issues
-The Cognee team takes security issues seriously. We appreciate your efforts to responsibly disclose your findings, and will make every effort to acknowledge your contributions.
-
-To report a security issue, email [info@topoteretes.com](mailto:info@topoteretes.com) and include the word "SECURITY" in the subject line.
-
-We'll endeavor to respond quickly, and will keep you updated throughout the process.

alembic.ini

@@ -102,7 +102,7 @@ handlers =
 qualname = sqlalchemy.engine
 
 [logger_alembic]
-level = WARN
+level = INFO
 handlers =
 qualname = alembic
 

alembic/env.py

@@ -1,11 +1,12 @@
 import asyncio
-from alembic import context
 from logging.config import fileConfig
+
 from sqlalchemy import pool
 from sqlalchemy.engine import Connection
 from sqlalchemy.ext.asyncio import async_engine_from_config
-
-from cognee.infrastructure.databases.relational import get_relational_engine, Base
+from cognee.infrastructure.databases.relational import Base
+from alembic import context
+from cognee.infrastructure.databases.relational import get_relational_engine, get_relational_config
 
 # this is the Alembic Config object, which provides
 # access to the values within the .ini file in use.
@@ -85,6 +86,12 @@ def run_migrations_online() -> None:
 
 db_engine = get_relational_engine()
 
+if db_engine.engine.dialect.name == "sqlite":
+    from cognee.infrastructure.files.storage import LocalStorage
+
+    db_config = get_relational_config()
+    LocalStorage.ensure_directory_exists(db_config.db_path)
+
 print("Using database:", db_engine.db_uri)
 
 config.set_section_option(

alembic/versions/1d0bb7fede17_add_pipeline_run_status.py

@@ -1,33 +0,0 @@
-"""Add pipeline run status
-
-Revision ID: 1d0bb7fede17
-Revises: 482cd6517ce4
-Create Date: 2025-05-19 10:58:15.993314
-"""
-
-from typing import Sequence, Union
-
-from alembic import op
-
-from cognee.infrastructure.databases.relational.get_relational_engine import get_relational_engine
-from cognee.modules.pipelines.models.PipelineRun import PipelineRun, PipelineRunStatus
-
-
-# revision identifiers, used by Alembic.
-revision: str = "1d0bb7fede17"
-down_revision: Union[str, None] = "482cd6517ce4"
-branch_labels: Union[str, Sequence[str], None] = None
-depends_on: Union[str, Sequence[str], None] = "482cd6517ce4"
-
-
-def upgrade() -> None:
-    db_engine = get_relational_engine()
-
-    if db_engine.engine.dialect.name == "postgresql":
-        op.execute(
-            "ALTER TYPE pipelinerunstatus ADD VALUE IF NOT EXISTS 'DATASET_PROCESSING_INITIATED'"
-        )
-
-
-def downgrade() -> None:
-    pass

alembic/versions/1daae0df1866_incremental_loading.py

@@ -1,48 +0,0 @@
-"""incremental_loading
-
-Revision ID: 1daae0df1866
-Revises: b9274c27a25a
-Create Date: 2025-08-12 13:14:12.515935
-
-"""
-
-from typing import Sequence, Union
-
-from alembic import op
-import sqlalchemy as sa
-from sqlalchemy.ext.mutable import MutableDict
-
-# revision identifiers, used by Alembic.
-revision: str = "1daae0df1866"
-down_revision: Union[str, None] = "b9274c27a25a"
-branch_labels: Union[str, Sequence[str], None] = None
-depends_on: Union[str, Sequence[str], None] = None
-
-
-def _get_column(inspector, table, name, schema=None):
-    for col in inspector.get_columns(table, schema=schema):
-        if col["name"] == name:
-            return col
-    return None
-
-
-def upgrade() -> None:
-    conn = op.get_bind()
-    insp = sa.inspect(conn)
-
-    # If column already exists skip migration
-    pipeline_status_column = _get_column(insp, "data", "pipeline_status")
-    if not pipeline_status_column:
-        op.add_column(
-            "data",
-            sa.Column(
-                "pipeline_status",
-                MutableDict.as_mutable(sa.JSON),
-                nullable=False,
-                server_default=sa.text("'{}'"),
-            ),
-        )
-
-
-def downgrade() -> None:
-    op.drop_column("data", "pipeline_status")

alembic/versions/211ab850ef3d_add_sync_operations_table.py

@@ -1,118 +0,0 @@
-"""Add sync_operations table
-
-Revision ID: 211ab850ef3d
-Revises: 9e7a3cb85175
-Create Date: 2025-09-10 20:11:13.534829
-
-"""
-
-from typing import Sequence, Union
-
-from alembic import op
-import sqlalchemy as sa
-from sqlalchemy.dialects import postgresql
-
-
-# revision identifiers, used by Alembic.
-revision: str = "211ab850ef3d"
-down_revision: Union[str, None] = "45957f0a9849"
-branch_labels: Union[str, Sequence[str], None] = None
-depends_on: Union[str, Sequence[str], None] = None
-
-
-def upgrade() -> None:
-    # ### commands auto generated by Alembic - please adjust! ###
-
-    # Check if table already exists (it might be created by Base.metadata.create_all() in initial migration)
-    connection = op.get_bind()
-    inspector = sa.inspect(connection)
-
-    if op.get_context().dialect.name == "postgresql":
-        syncstatus_enum = postgresql.ENUM(
-            "STARTED", "IN_PROGRESS", "COMPLETED", "FAILED", "CANCELLED", name="syncstatus"
-        )
-        syncstatus_enum.create(op.get_bind(), checkfirst=True)
-
-    if "sync_operations" not in inspector.get_table_names():
-        if op.get_context().dialect.name == "postgresql":
-            syncstatus = postgresql.ENUM(
-                "STARTED",
-                "IN_PROGRESS",
-                "COMPLETED",
-                "FAILED",
-                "CANCELLED",
-                name="syncstatus",
-                create_type=False,
-            )
-        else:
-            syncstatus = sa.Enum(
-                "STARTED",
-                "IN_PROGRESS",
-                "COMPLETED",
-                "FAILED",
-                "CANCELLED",
-                name="syncstatus",
-                create_type=False,
-            )
-
-        # Table doesn't exist, create it normally
-        op.create_table(
-            "sync_operations",
-            sa.Column("id", sa.UUID(), nullable=False),
-            sa.Column("run_id", sa.Text(), nullable=True),
-            sa.Column(
-                "status",
-                syncstatus,
-                nullable=True,
-            ),
-            sa.Column("progress_percentage", sa.Integer(), nullable=True),
-            sa.Column("dataset_ids", sa.JSON(), nullable=True),
-            sa.Column("dataset_names", sa.JSON(), nullable=True),
-            sa.Column("user_id", sa.UUID(), nullable=True),
-            sa.Column("created_at", sa.DateTime(timezone=True), nullable=True),
-            sa.Column("started_at", sa.DateTime(timezone=True), nullable=True),
-            sa.Column("completed_at", sa.DateTime(timezone=True), nullable=True),
-            sa.Column("total_records_to_sync", sa.Integer(), nullable=True),
-            sa.Column("total_records_to_download", sa.Integer(), nullable=True),
-            sa.Column("total_records_to_upload", sa.Integer(), nullable=True),
-            sa.Column("records_downloaded", sa.Integer(), nullable=True),
-            sa.Column("records_uploaded", sa.Integer(), nullable=True),
-            sa.Column("bytes_downloaded", sa.Integer(), nullable=True),
-            sa.Column("bytes_uploaded", sa.Integer(), nullable=True),
-            sa.Column("dataset_sync_hashes", sa.JSON(), nullable=True),
-            sa.Column("error_message", sa.Text(), nullable=True),
-            sa.Column("retry_count", sa.Integer(), nullable=True),
-            sa.PrimaryKeyConstraint("id"),
-        )
-        op.create_index(
-            op.f("ix_sync_operations_run_id"), "sync_operations", ["run_id"], unique=True
-        )
-        op.create_index(
-            op.f("ix_sync_operations_user_id"), "sync_operations", ["user_id"], unique=False
-        )
-    else:
-        # Table already exists, but we might need to add missing columns or indexes
-        # For now, just log that the table already exists
-        print("sync_operations table already exists, skipping creation")
-
-    # ### end Alembic commands ###
-
-
-def downgrade() -> None:
-    # ### commands auto generated by Alembic - please adjust! ###
-
-    # Only drop if table exists (might have been created by Base.metadata.create_all())
-    connection = op.get_bind()
-    inspector = sa.inspect(connection)
-
-    if "sync_operations" in inspector.get_table_names():
-        op.drop_index(op.f("ix_sync_operations_user_id"), table_name="sync_operations")
-        op.drop_index(op.f("ix_sync_operations_run_id"), table_name="sync_operations")
-        op.drop_table("sync_operations")
-
-        # Drop the enum type that was created (only if no other tables are using it)
-        sa.Enum(name="syncstatus").drop(op.get_bind(), checkfirst=True)
-    else:
-        print("sync_operations table doesn't exist, skipping downgrade")
-
-    # ### end Alembic commands ###

alembic/versions/45957f0a9849_add_notebook_table.py

@@ -1,46 +0,0 @@
-"""Add notebook table
-
-Revision ID: 45957f0a9849
-Revises: 9e7a3cb85175
-Create Date: 2025-09-10 17:47:58.201319
-
-"""
-
-from datetime import datetime, timezone
-from uuid import uuid4
-from typing import Sequence, Union
-
-from alembic import op
-import sqlalchemy as sa
-
-
-# revision identifiers, used by Alembic.
-revision: str = "45957f0a9849"
-down_revision: Union[str, None] = "9e7a3cb85175"
-branch_labels: Union[str, Sequence[str], None] = None
-depends_on: Union[str, Sequence[str], None] = None
-
-
-def upgrade() -> None:
-    bind = op.get_bind()
-    inspector = sa.inspect(bind)
-
-    if "notebooks" not in inspector.get_table_names():
-        # Define table with all necessary columns including primary key
-        op.create_table(
-            "notebooks",
-            sa.Column("id", sa.UUID, primary_key=True, default=uuid4),  # Critical for SQLite
-            sa.Column("owner_id", sa.UUID, index=True),
-            sa.Column("name", sa.String(), nullable=False),
-            sa.Column("cells", sa.JSON(), nullable=False),
-            sa.Column("deletable", sa.Boolean(), default=True),
-            sa.Column("created_at", sa.DateTime(), default=lambda: datetime.now(timezone.utc)),
-        )
-
-
-def downgrade() -> None:
-    bind = op.get_bind()
-    inspector = sa.inspect(bind)
-
-    if "notebooks" in inspector.get_table_names():
-        op.drop_table("notebooks")

alembic/versions/46a6ce2bd2b2_expand_dataset_database_with_json_.py

@@ -1,333 +0,0 @@
-"""Expand dataset database with json connection field
-
-Revision ID: 46a6ce2bd2b2
-Revises: 76625596c5c3
-Create Date: 2025-11-25 17:56:28.938931
-
-"""
-
-from typing import Sequence, Union
-
-from alembic import op
-import sqlalchemy as sa
-
-
-# revision identifiers, used by Alembic.
-revision: str = "46a6ce2bd2b2"
-down_revision: Union[str, None] = "76625596c5c3"
-branch_labels: Union[str, Sequence[str], None] = None
-depends_on: Union[str, Sequence[str], None] = None
-
-graph_constraint_name = "dataset_database_graph_database_name_key"
-vector_constraint_name = "dataset_database_vector_database_name_key"
-TABLE_NAME = "dataset_database"
-
-
-def _get_column(inspector, table, name, schema=None):
-    for col in inspector.get_columns(table, schema=schema):
-        if col["name"] == name:
-            return col
-    return None
-
-
-def _recreate_table_without_unique_constraint_sqlite(op, insp):
-    """
-    SQLite cannot drop unique constraints on individual columns. We must:
-    1. Create a new table without the unique constraints.
-    2. Copy data from the old table.
-    3. Drop the old table.
-    4. Rename the new table.
-    """
-    conn = op.get_bind()
-
-    # Create new table definition (without unique constraints)
-    op.create_table(
-        f"{TABLE_NAME}_new",
-        sa.Column("owner_id", sa.UUID()),
-        sa.Column("dataset_id", sa.UUID(), primary_key=True, nullable=False),
-        sa.Column("vector_database_name", sa.String(), nullable=False),
-        sa.Column("graph_database_name", sa.String(), nullable=False),
-        sa.Column("vector_database_provider", sa.String(), nullable=False),
-        sa.Column("graph_database_provider", sa.String(), nullable=False),
-        sa.Column(
-            "vector_dataset_database_handler",
-            sa.String(),
-            unique=False,
-            nullable=False,
-            server_default="lancedb",
-        ),
-        sa.Column(
-            "graph_dataset_database_handler",
-            sa.String(),
-            unique=False,
-            nullable=False,
-            server_default="kuzu",
-        ),
-        sa.Column("vector_database_url", sa.String()),
-        sa.Column("graph_database_url", sa.String()),
-        sa.Column("vector_database_key", sa.String()),
-        sa.Column("graph_database_key", sa.String()),
-        sa.Column(
-            "graph_database_connection_info",
-            sa.JSON(),
-            nullable=False,
-            server_default=sa.text("'{}'"),
-        ),
-        sa.Column(
-            "vector_database_connection_info",
-            sa.JSON(),
-            nullable=False,
-            server_default=sa.text("'{}'"),
-        ),
-        sa.Column("created_at", sa.DateTime()),
-        sa.Column("updated_at", sa.DateTime()),
-        sa.ForeignKeyConstraint(["dataset_id"], ["datasets.id"], ondelete="CASCADE"),
-        sa.ForeignKeyConstraint(["owner_id"], ["principals.id"], ondelete="CASCADE"),
-    )
-
-    # Copy data into new table
-    conn.execute(
-        sa.text(f"""
-        INSERT INTO {TABLE_NAME}_new
-        SELECT
-            owner_id,
-            dataset_id,
-            vector_database_name,
-            graph_database_name,
-            vector_database_provider,
-            graph_database_provider,
-            vector_dataset_database_handler,
-            graph_dataset_database_handler,
-            vector_database_url,
-            graph_database_url,
-            vector_database_key,
-            graph_database_key,
-            COALESCE(graph_database_connection_info, '{{}}'),
-            COALESCE(vector_database_connection_info, '{{}}'),
-            created_at,
-            updated_at
-        FROM {TABLE_NAME}
-    """)
-    )
-
-    # Drop old table
-    op.drop_table(TABLE_NAME)
-
-    # Rename new table
-    op.rename_table(f"{TABLE_NAME}_new", TABLE_NAME)
-
-
-def _recreate_table_with_unique_constraint_sqlite(op, insp):
-    """
-    SQLite cannot drop unique constraints on individual columns. We must:
-    1. Create a new table without the unique constraints.
-    2. Copy data from the old table.
-    3. Drop the old table.
-    4. Rename the new table.
-    """
-    conn = op.get_bind()
-
-    # Create new table definition (without unique constraints)
-    op.create_table(
-        f"{TABLE_NAME}_new",
-        sa.Column("owner_id", sa.UUID()),
-        sa.Column("dataset_id", sa.UUID(), primary_key=True, nullable=False),
-        sa.Column("vector_database_name", sa.String(), nullable=False, unique=True),
-        sa.Column("graph_database_name", sa.String(), nullable=False, unique=True),
-        sa.Column("vector_database_provider", sa.String(), nullable=False),
-        sa.Column("graph_database_provider", sa.String(), nullable=False),
-        sa.Column(
-            "vector_dataset_database_handler",
-            sa.String(),
-            unique=False,
-            nullable=False,
-            server_default="lancedb",
-        ),
-        sa.Column(
-            "graph_dataset_database_handler",
-            sa.String(),
-            unique=False,
-            nullable=False,
-            server_default="kuzu",
-        ),
-        sa.Column("vector_database_url", sa.String()),
-        sa.Column("graph_database_url", sa.String()),
-        sa.Column("vector_database_key", sa.String()),
-        sa.Column("graph_database_key", sa.String()),
-        sa.Column(
-            "graph_database_connection_info",
-            sa.JSON(),
-            nullable=False,
-            server_default=sa.text("'{}'"),
-        ),
-        sa.Column(
-            "vector_database_connection_info",
-            sa.JSON(),
-            nullable=False,
-            server_default=sa.text("'{}'"),
-        ),
-        sa.Column("created_at", sa.DateTime()),
-        sa.Column("updated_at", sa.DateTime()),
-        sa.ForeignKeyConstraint(["dataset_id"], ["datasets.id"], ondelete="CASCADE"),
-        sa.ForeignKeyConstraint(["owner_id"], ["principals.id"], ondelete="CASCADE"),
-    )
-
-    # Copy data into new table
-    conn.execute(
-        sa.text(f"""
-        INSERT INTO {TABLE_NAME}_new
-        SELECT
-            owner_id,
-            dataset_id,
-            vector_database_name,
-            graph_database_name,
-            vector_database_provider,
-            graph_database_provider,
-            vector_dataset_database_handler,
-            graph_dataset_database_handler,
-            vector_database_url,
-            graph_database_url,
-            vector_database_key,
-            graph_database_key,
-            COALESCE(graph_database_connection_info, '{{}}'),
-            COALESCE(vector_database_connection_info, '{{}}'),
-            created_at,
-            updated_at
-        FROM {TABLE_NAME}
-    """)
-    )
-
-    # Drop old table
-    op.drop_table(TABLE_NAME)
-
-    # Rename new table
-    op.rename_table(f"{TABLE_NAME}_new", TABLE_NAME)
-
-
-def upgrade() -> None:
-    conn = op.get_bind()
-    insp = sa.inspect(conn)
-
-    unique_constraints = insp.get_unique_constraints(TABLE_NAME)
-
-    vector_database_connection_info_column = _get_column(
-        insp, "dataset_database", "vector_database_connection_info"
-    )
-    if not vector_database_connection_info_column:
-        op.add_column(
-            "dataset_database",
-            sa.Column(
-                "vector_database_connection_info",
-                sa.JSON(),
-                unique=False,
-                nullable=False,
-                server_default=sa.text("'{}'"),
-            ),
-        )
-
-    vector_dataset_database_handler = _get_column(
-        insp, "dataset_database", "vector_dataset_database_handler"
-    )
-    if not vector_dataset_database_handler:
-        # Add LanceDB as the default graph dataset database handler
-        op.add_column(
-            "dataset_database",
-            sa.Column(
-                "vector_dataset_database_handler",
-                sa.String(),
-                unique=False,
-                nullable=False,
-                server_default="lancedb",
-            ),
-        )
-
-    graph_database_connection_info_column = _get_column(
-        insp, "dataset_database", "graph_database_connection_info"
-    )
-    if not graph_database_connection_info_column:
-        op.add_column(
-            "dataset_database",
-            sa.Column(
-                "graph_database_connection_info",
-                sa.JSON(),
-                unique=False,
-                nullable=False,
-                server_default=sa.text("'{}'"),
-            ),
-        )
-
-    graph_dataset_database_handler = _get_column(
-        insp, "dataset_database", "graph_dataset_database_handler"
-    )
-    if not graph_dataset_database_handler:
-        # Add Kuzu as the default graph dataset database handler
-        op.add_column(
-            "dataset_database",
-            sa.Column(
-                "graph_dataset_database_handler",
-                sa.String(),
-                unique=False,
-                nullable=False,
-                server_default="kuzu",
-            ),
-        )
-
-    with op.batch_alter_table("dataset_database", schema=None) as batch_op:
-        # Drop the unique constraint to make unique=False
-        graph_constraint_to_drop = None
-        for uc in unique_constraints:
-            # Check if the constraint covers ONLY the target column
-            if uc["name"] == graph_constraint_name:
-                graph_constraint_to_drop = uc["name"]
-                break
-
-        vector_constraint_to_drop = None
-        for uc in unique_constraints:
-            # Check if the constraint covers ONLY the target column
-            if uc["name"] == vector_constraint_name:
-                vector_constraint_to_drop = uc["name"]
-                break
-
-        if (
-            vector_constraint_to_drop
-            and graph_constraint_to_drop
-            and op.get_context().dialect.name == "postgresql"
-        ):
-            # PostgreSQL
-            batch_op.drop_constraint(graph_constraint_name, type_="unique")
-            batch_op.drop_constraint(vector_constraint_name, type_="unique")
-
-        if op.get_context().dialect.name == "sqlite":
-            conn = op.get_bind()
-            # Fun fact: SQLite has hidden auto indexes for unique constraints that can't be dropped or accessed directly
-            #           So we need to check for them and drop them by recreating the table (altering column also won't work)
-            result = conn.execute(sa.text("PRAGMA index_list('dataset_database')"))
-            rows = result.fetchall()
-            unique_auto_indexes = [row for row in rows if row[3] == "u"]
-            for row in unique_auto_indexes:
-                result = conn.execute(sa.text(f"PRAGMA index_info('{row[1]}')"))
-                index_info = result.fetchall()
-                if index_info[0][2] == "vector_database_name":
-                    # In case a unique index exists on vector_database_name, drop it and the graph_database_name one
-                    _recreate_table_without_unique_constraint_sqlite(op, insp)
-
-
-def downgrade() -> None:
-    conn = op.get_bind()
-    insp = sa.inspect(conn)
-
-    if op.get_context().dialect.name == "sqlite":
-        _recreate_table_with_unique_constraint_sqlite(op, insp)
-    elif op.get_context().dialect.name == "postgresql":
-        with op.batch_alter_table("dataset_database", schema=None) as batch_op:
-            # Re-add the unique constraint to return to unique=True
-            batch_op.create_unique_constraint(graph_constraint_name, ["graph_database_name"])
-
-        with op.batch_alter_table("dataset_database", schema=None) as batch_op:
-            # Re-add the unique constraint to return to unique=True
-            batch_op.create_unique_constraint(vector_constraint_name, ["vector_database_name"])
-
-    op.drop_column("dataset_database", "vector_database_connection_info")
-    op.drop_column("dataset_database", "graph_database_connection_info")
-    op.drop_column("dataset_database", "vector_dataset_database_handler")
-    op.drop_column("dataset_database", "graph_dataset_database_handler")