LightRAG/lightrag/evaluation
clssck 59e89772de refactor: consolidate to PostgreSQL-only backend and modernize stack
Remove legacy storage implementations and deprecated examples:
- Delete FAISS, JSON, Memgraph, Milvus, MongoDB, Nano Vector DB, Neo4j, NetworkX, Qdrant, Redis storage backends
- Remove Kubernetes deployment manifests and installation scripts
- Delete unofficial examples for deprecated backends and offline deployment docs
Streamline core infrastructure:
- Consolidate storage layer to PostgreSQL-only implementation
- Add full-text search caching with FTS cache module
- Implement metrics collection and monitoring pipeline
- Add explain and metrics API routes
Modernize frontend and tooling:
- Switch web UI to Bun with bun.lock, remove npm and pnpm lockfiles
- Update Dockerfile for PostgreSQL-only deployment
- Add Makefile for common development tasks
- Update environment and configuration examples
Enhance evaluation and testing capabilities:
- Add prompt optimization with DSPy and auto-tuning
- Implement ground truth regeneration and variant testing
- Add prompt debugging and response comparison utilities
- Expand test coverage with new integration scenarios
Simplify dependencies and configuration:
- Remove offline-specific requirement files
- Update pyproject.toml with streamlined dependencies
- Add Python version pinning with .python-version
- Create project guidelines in CLAUDE.md and AGENTS.md
2025-12-12 16:28:49 +01:00
..
sample_documents refactor: remove legacy storage implementations and k8s deployment 2025-12-09 14:02:00 +01:00
wiki_documents chore(lightrag): add wikipedia test dataset for evaluation 2025-11-30 20:14:52 +01:00
__init__.py refactor: remove legacy storage implementations and k8s deployment 2025-12-09 14:02:00 +01:00
auto_optimize_prompt.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
compare_results.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
debug_prompt_responses.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
download_wikipedia.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
e2e_test_harness.py test(lightrag,api): add comprehensive test coverage and S3 support 2025-12-05 23:13:39 +01:00
eval_rag_quality.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
ingest_test_docs.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
optimize_prompt_dspy.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
pharma_test_dataset.json refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
pharma_test_dataset_original.json refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
populate_test_data.sh chore(docker-compose, lightrag): optimize test infrastructure and add evaluation tools 2025-11-29 10:39:20 +01:00
README_EVALUASTION_RAGAS.md Update LLM cache migration docs and improve UX prompts 2025-11-08 23:48:19 +08:00
regenerate_ground_truths.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
sample_dataset.json refactor: remove legacy storage implementations and k8s deployment 2025-12-09 14:02:00 +01:00
test_prompt_variants.py refactor: consolidate to PostgreSQL-only backend and modernize stack 2025-12-12 16:28:49 +01:00
wiki_test_dataset.json test(lightrag,examples,api): comprehensive ruff formatting and type hints 2025-12-05 15:17:06 +01:00