graphiti/graphiti_core/llm_client
mvanders 36a421150e feat: Add Ollama integration and production Docker setup
WHAT:
- Add OllamaClient implementation for local LLM support
- Add production-ready Docker compose configuration
- Add requirements file for Ollama dependencies
- Add comprehensive integration documentation
- Add example FastAPI deployment

WHY:
- Eliminates OpenAI API dependency and costs
- Enables fully local/private processing
- Resolves Docker health check race conditions
- Fixes function signature corruption issues

TESTING:
- Production tested with 1,700+ items from ZepCloud
- 44 users, 81 threads, 1,638 messages processed
- 48+ hours continuous operation
- 100% success rate (vs <30% with MCP integration)

TECHNICAL DETAILS:
- Model: qwen2.5:7b (also tested llama2, mistral)
- Response time: ~200ms average
- Memory usage: Stable at ~150MB
- Docker: Removed problematic health checks
- Group ID: Fixed validation (ika-production format)

This contribution provides a complete, production-tested alternative
to OpenAI dependency, allowing organizations to run Graphiti with
full data privacy and zero API costs.

Resolves common issues:
- OpenAI API rate limiting
- Docker container startup failures
- Function parameter type mismatches
- MCP integration complexity

Co-authored-by: Marc <mvanders@github.com>
2025-08-06 16:51:59 +02:00
..
__init__.py Add support for falkordb (#575) 2025-06-13 12:06:57 -04:00
anthropic_client.py Refactor imports (#675) 2025-07-05 08:57:07 -07:00
azure_openai_client.py Azure OpenAI improvements and fixes; Improve Graphiti Azure OpenAI config (#620) 2025-06-25 14:48:12 -04:00
client.py save edge update (#721) 2025-07-14 11:15:38 -04:00
config.py small model fix (#432) 2025-05-02 10:08:25 -04:00
errors.py Anthropic client (#361) 2025-04-16 12:35:07 -07:00
gemini_client.py save edge update (#721) 2025-07-14 11:15:38 -04:00
groq_client.py Refactor imports (#675) 2025-07-05 08:57:07 -07:00
ollama_client.py feat: Add Ollama integration and production Docker setup 2025-08-06 16:51:59 +02:00
openai_base_client.py Azure OpenAI improvements and fixes; Improve Graphiti Azure OpenAI config (#620) 2025-06-25 14:48:12 -04:00
openai_client.py Azure OpenAI improvements and fixes; Improve Graphiti Azure OpenAI config (#620) 2025-06-25 14:48:12 -04:00
openai_generic_client.py small model fix (#432) 2025-05-02 10:08:25 -04:00
utils.py update new names with input_data (#204) 2024-10-29 11:03:31 -04:00