59e89772de
Remove legacy storage implementations and deprecated examples: - Delete FAISS, JSON, Memgraph, Milvus, MongoDB, Nano Vector DB, Neo4j, NetworkX, Qdrant, Redis storage backends - Remove Kubernetes deployment manifests and installation scripts - Delete unofficial examples for deprecated backends and offline deployment docs Streamline core infrastructure: - Consolidate storage layer to PostgreSQL-only implementation - Add full-text search caching with FTS cache module - Implement metrics collection and monitoring pipeline - Add explain and metrics API routes Modernize frontend and tooling: - Switch web UI to Bun with bun.lock, remove npm and pnpm lockfiles - Update Dockerfile for PostgreSQL-only deployment - Add Makefile for common development tasks - Update environment and configuration examples Enhance evaluation and testing capabilities: - Add prompt optimization with DSPy and auto-tuning - Implement ground truth regeneration and variant testing - Add prompt debugging and response comparison utilities - Expand test coverage with new integration scenarios Simplify dependencies and configuration: - Remove offline-specific requirement files - Update pyproject.toml with streamlined dependencies - Add Python version pinning with .python-version - Create project guidelines in CLAUDE.md and AGENTS.md
25 lines
No EOL
599 B
JSON
25 lines
No EOL
599 B
JSON
{
|
|
"iteration": 0,
|
|
"timestamp": "2025-12-10T18:37:29.560296",
|
|
"best_score": 0.9127154492283065,
|
|
"variants": [
|
|
{
|
|
"variant_name": "baseline",
|
|
"source": "baseline",
|
|
"faithfulness": 0.0,
|
|
"relevance": 0.0,
|
|
"ragas_score": 0.0,
|
|
"total_latency_ms": 0.0,
|
|
"query_count": 0
|
|
},
|
|
{
|
|
"variant_name": "llm_mutation",
|
|
"source": "llm_mutation",
|
|
"faithfulness": 0.991869918699187,
|
|
"relevance": 0.7939837450219857,
|
|
"ragas_score": 0.9127154492283065,
|
|
"total_latency_ms": 68376.39791611582,
|
|
"query_count": 3
|
|
}
|
|
]
|
|
} |