59e89772de
Remove legacy storage implementations and deprecated examples: - Delete FAISS, JSON, Memgraph, Milvus, MongoDB, Nano Vector DB, Neo4j, NetworkX, Qdrant, Redis storage backends - Remove Kubernetes deployment manifests and installation scripts - Delete unofficial examples for deprecated backends and offline deployment docs Streamline core infrastructure: - Consolidate storage layer to PostgreSQL-only implementation - Add full-text search caching with FTS cache module - Implement metrics collection and monitoring pipeline - Add explain and metrics API routes Modernize frontend and tooling: - Switch web UI to Bun with bun.lock, remove npm and pnpm lockfiles - Update Dockerfile for PostgreSQL-only deployment - Add Makefile for common development tasks - Update environment and configuration examples Enhance evaluation and testing capabilities: - Add prompt optimization with DSPy and auto-tuning - Implement ground truth regeneration and variant testing - Add prompt debugging and response comparison utilities - Expand test coverage with new integration scenarios Simplify dependencies and configuration: - Remove offline-specific requirement files - Update pyproject.toml with streamlined dependencies - Add Python version pinning with .python-version - Create project guidelines in CLAUDE.md and AGENTS.md
25 lines
No EOL
660 B
JSON
25 lines
No EOL
660 B
JSON
{
|
|
"iteration": 0,
|
|
"timestamp": "2025-12-10T19:47:26.739228",
|
|
"best_score": 0.9471279504205024,
|
|
"variants": [
|
|
{
|
|
"variant_name": "baseline",
|
|
"source": "baseline",
|
|
"faithfulness": 0.9819819819819819,
|
|
"relevance": 0.8702819723911401,
|
|
"ragas_score": 0.9373019781456453,
|
|
"total_latency_ms": 16064.685415942222,
|
|
"query_count": 3
|
|
},
|
|
{
|
|
"variant_name": "llm_mutation",
|
|
"source": "llm_mutation",
|
|
"faithfulness": 0.9920634920634921,
|
|
"relevance": 0.8797246379560179,
|
|
"ragas_score": 0.9471279504205024,
|
|
"total_latency_ms": 19022.37187407445,
|
|
"query_count": 3
|
|
}
|
|
]
|
|
} |