59e89772de
Remove legacy storage implementations and deprecated examples: - Delete FAISS, JSON, Memgraph, Milvus, MongoDB, Nano Vector DB, Neo4j, NetworkX, Qdrant, Redis storage backends - Remove Kubernetes deployment manifests and installation scripts - Delete unofficial examples for deprecated backends and offline deployment docs Streamline core infrastructure: - Consolidate storage layer to PostgreSQL-only implementation - Add full-text search caching with FTS cache module - Implement metrics collection and monitoring pipeline - Add explain and metrics API routes Modernize frontend and tooling: - Switch web UI to Bun with bun.lock, remove npm and pnpm lockfiles - Update Dockerfile for PostgreSQL-only deployment - Add Makefile for common development tasks - Update environment and configuration examples Enhance evaluation and testing capabilities: - Add prompt optimization with DSPy and auto-tuning - Implement ground truth regeneration and variant testing - Add prompt debugging and response comparison utilities - Expand test coverage with new integration scenarios Simplify dependencies and configuration: - Remove offline-specific requirement files - Update pyproject.toml with streamlined dependencies - Add Python version pinning with .python-version - Create project guidelines in CLAUDE.md and AGENTS.md
25 lines
No EOL
647 B
JSON
25 lines
No EOL
647 B
JSON
{
|
|
"iteration": 0,
|
|
"timestamp": "2025-12-10T20:00:37.208371",
|
|
"best_score": 0.7623097058142511,
|
|
"variants": [
|
|
{
|
|
"variant_name": "baseline",
|
|
"source": "baseline",
|
|
"faithfulness": 1.0,
|
|
"relevance": 0.40577426453562776,
|
|
"ragas_score": 0.7623097058142511,
|
|
"total_latency_ms": 14127.708915038966,
|
|
"query_count": 3
|
|
},
|
|
{
|
|
"variant_name": "llm_mutation",
|
|
"source": "llm_mutation",
|
|
"faithfulness": 0.8333333333333334,
|
|
"relevance": 0.5762601799883212,
|
|
"ragas_score": 0.7305040719953285,
|
|
"total_latency_ms": 11546.667083050124,
|
|
"query_count": 3
|
|
}
|
|
]
|
|
} |