Commit graph

  • 7eef0159c9
    Merge a8bc957610 into 9562a974d2 dependabot[bot] 2025-12-14 18:09:21 +00:00
  • a8bc957610
    Bump the github-actions group with 3 updates dependabot/github_actions/github-actions-35b2a8182b dependabot[bot] 2025-12-14 18:09:18 +00:00
  • b46516b5ae
    Merge 310f8eef69 into 9562a974d2 NazimRiyadh 2025-12-14 10:25:01 +00:00
  • 310f8eef69 Fix: KeyError 'history_messages' in apipeline_process_enqueue_documents NazimRiyadh 2025-12-14 16:23:59 +06:00
  • abb44eccb1 feat(lightrag): improve entity extraction prompts and rerank chunking clssck 2025-12-12 16:43:09 +01:00
  • 59e89772de refactor: consolidate to PostgreSQL-only backend and modernize stack Remove legacy storage implementations and deprecated examples: - Delete FAISS, JSON, Memgraph, Milvus, MongoDB, Nano Vector DB, Neo4j, NetworkX, Qdrant, Redis storage backends - Remove Kubernetes deployment manifests and installation scripts - Delete unofficial examples for deprecated backends and offline deployment docs Streamline core infrastructure: - Consolidate storage layer to PostgreSQL-only implementation - Add full-text search caching with FTS cache module - Implement metrics collection and monitoring pipeline - Add explain and metrics API routes Modernize frontend and tooling: - Switch web UI to Bun with bun.lock, remove npm and pnpm lockfiles - Update Dockerfile for PostgreSQL-only deployment - Add Makefile for common development tasks - Update environment and configuration examples Enhance evaluation and testing capabilities: - Add prompt optimization with DSPy and auto-tuning - Implement ground truth regeneration and variant testing - Add prompt debugging and response comparison utilities - Expand test coverage with new integration scenarios Simplify dependencies and configuration: - Remove offline-specific requirement files - Update pyproject.toml with streamlined dependencies - Add Python version pinning with .python-version - Create project guidelines in CLAUDE.md and AGENTS.md clssck 2025-12-12 16:28:49 +01:00
  • 9fd0bf4de5
    Merge 2752b01f12 into 9562a974d2 Dawid Laszuk 2025-12-12 06:38:16 -08:00
  • 2752b01f12 chore/support-voyageai-embed-directly: chore: resolve comments Dawid Laszuk 2025-12-12 06:37:29 -08:00
  • 55a4626ac0
    Merge 06750e1989 into 9562a974d2 positiveandnegativeoffset 2025-12-12 11:40:50 +08:00
  • ab5bb68c0d
    Merge a27774a3a4 into 9562a974d2 Naseem Ali 2025-12-12 10:42:23 +08:00
  • 778b9443d3
    Merge 02bd7fd0ac into 9562a974d2 FloretKu 2025-12-12 10:42:23 +08:00
  • 7d72476a6a
    Merge a8e0d5ffe0 into 9562a974d2 Paul 2025-12-12 10:42:23 +08:00
  • 33bde4161a
    Merge 4945faf021 into 9562a974d2 Alexander Belikov 2025-12-12 10:42:23 +08:00
  • a68466581e
    Merge 598de90d93 into 9562a974d2 Yasiru 2025-12-12 10:42:23 +08:00
  • b8a9ee9b52
    Merge 293ddbc326 into 9562a974d2 palanisd 2025-12-12 10:42:23 +08:00
  • b4008eb461
    Merge f18bb102d6 into 9562a974d2 palanisd 2025-12-12 10:42:23 +08:00
  • 4e5351de63
    Merge cf68cdfe3a into 9562a974d2 Bukely_ 2025-12-12 10:18:32 +08:00
  • cc70c1d9fb
    Merge 14b648e10f into 9562a974d2 Safi 2025-12-12 10:15:33 +08:00
  • 9562a974d2 Bump API version to 0260 main yangdx 2025-12-12 10:13:34 +08:00
  • f254ccae8e Merge branch 'fix/missing-langue-in-keywords-extraction-prompt' yangdx 2025-12-12 10:11:56 +08:00
  • 90984c6061 Merge branch 'fix/openai-prompt-caching-optimization-2355' yangdx 2025-12-12 06:13:49 +08:00
  • 834778eb01 Reorganize entity extraction prompt for better clarity yangdx 2025-12-12 06:12:47 +08:00
  • 14b648e10f fix: remove debug instrumentation and finalize logic fixes captainmirk 2025-12-11 15:58:11 +00:00
  • d8cd48f43b fix(cache): include language parameter in keywords extraction cache key José Carlos 2025-12-11 12:43:42 -03:00
  • 4fd3914194 Merge branch 'main' into fix/openai-prompt-caching-optimization-2355 yangdx 2025-12-11 19:12:42 +08:00
  • 294f75438e Restructure entity extraction prompt format for consistency yangdx 2025-12-11 19:12:34 +08:00
  • 06750e1989 start-of-triples Jiate Liu 2025-12-11 21:02:10 +11:00
  • 8002936946
    Merge pull request #2480 from johuellm/main Daniel.y 2025-12-11 10:44:40 +08:00
  • 0ca58e54c7 Merge branch 'update_react_to_19.2.1' yangdx 2025-12-11 10:38:59 +08:00
  • 2cbf5c6a68 Merge branch 'main' into update_react_to_19.2.1 yangdx 2025-12-11 10:34:47 +08:00
  • 643f85ed51
    Merge pull request #2483 from HKUDS/dependabot/bun/lightrag_webui/frontend-minor-patch-3792b58b53 Daniel.y 2025-12-11 10:21:20 +08:00
  • 739bd980d9
    Merge pull request #2482 from HKUDS/dependabot/bun/lightrag_webui/build-tools-56af6c91fd Daniel.y 2025-12-11 10:20:30 +08:00
  • e28c9be1fb
    Merge pull request #2481 from HKUDS/dependabot/bun/lightrag_webui/ui-components-e5d9180762 Daniel.y 2025-12-11 10:19:52 +08:00
  • da9070ecf7 refactor: remove legacy storage implementations and k8s deployment Remove deprecated storage backends and Kubernetes deployment configuration: - Delete unused storage implementations: FAISS, JSON, Memgraph, Milvus, MongoDB, Nano Vector DB, Neo4j, NetworkX, Qdrant, Redis - Remove Kubernetes deployment manifests and installation scripts - Delete legacy examples for deprecated backends - Consolidate to PostgreSQL-only storage backend Streamline dependencies and add new capabilities: - Remove deprecated code documentation and migration guides - Add full-text search caching layer with FTS cache module - Implement metrics collection and monitoring pipeline - Add explain and metrics API routes - Simplify configuration with PostgreSQL-focused setup Update documentation and configuration: - Rewrite README to focus on supported features - Update environment and configuration examples - Remove Kubernetes-specific documentation - Add new utility scripts for PDF uploads and pipeline monitoring clssck 2025-12-09 14:02:00 +01:00
  • 28183dfd58 update top react 19.2.1 Mark P. McCahill 2025-12-08 23:18:49 +00:00
  • b2736517df docs(readme): rewrite README to highlight specialized fork features, S3 integration, and modern UI clssck 2025-12-08 20:52:57 +01:00
  • 95c83abcf8 feat(lightrag,lightrag_webui): add S3 storage integration and UI Add S3 storage client and API routes for document management: - Implement s3_routes.py with file upload, download, delete endpoints - Enhance s3_client.py with improved error handling and operations - Add S3 browser UI component with file viewing and management - Implement FileViewer and PDFViewer components for storage preview - Add Resizable and Sheet UI components for layout control Update backend infrastructure: - Add bulk operations and parameterized queries to postgres_impl.py - Enhance document routes with improved type hints - Update API server registration for new S3 routes - Refine upload routes and utility functions Modernize web UI: - Integrate S3 browser into main application layout - Update localization files for storage UI strings - Add storage settings to application configuration - Sync package dependencies and lock files Remove obsolete reproduction script: - Delete reproduce_citation.py (replaced by test suite) Update configuration: - Enhance pyrightconfig.json for stricter type checking clssck 2025-12-07 11:04:38 +01:00
  • fd2ff358bf fix(prompt): use language parameter in keywords_extraction prompt José Carlos 2025-12-06 09:50:12 -03:00
  • 701980015a feat(redis): add TTL support for Redis KV storage José Carlos 2025-12-06 09:28:04 -03:00
  • 082a5a8fad test(lightrag,api): add comprehensive test coverage and S3 support Add extensive test suites for API routes and utilities: - Implement test_search_routes.py (406 lines) for search endpoint validation - Implement test_upload_routes.py (724 lines) for document upload workflows - Implement test_s3_client.py (618 lines) for S3 storage operations - Implement test_citation_utils.py (352 lines) for citation extraction - Implement test_chunking.py (216 lines) for text chunking validation Add S3 storage client implementation: - Create lightrag/storage/s3_client.py with S3 operations - Add storage module initialization with exports - Integrate S3 client with document upload handling Enhance API routes and core functionality: - Add search_routes.py with full-text and graph search endpoints - Add upload_routes.py with multipart document upload support - Update operate.py with bulk operations and health checks - Enhance postgres_impl.py with bulk upsert and parameterized queries - Update lightrag_server.py to register new API routes - Improve utils.py with citation and formatting utilities Update dependencies and configuration: - Add S3 and test dependencies to pyproject.toml - Update docker-compose.test.yml for testing environment - Sync uv.lock with new dependencies Apply code quality improvements across all modified files: - Add type hints to function signatures - Update imports and router initialization - Fix logging and error handling clssck 2025-12-05 23:13:39 +01:00
  • 65d2cd16b1 feat(examples, lightrag): fix logging and code improvements Fix logging output in evaluation test harness and examples: - Replace print() statements with logger calls in e2e_test_harness.py - Update copy_llm_cache_to_another_storage.py to use logger instead of print - Remove redundant logging configuration in copy_llm_cache_to_another_storage.py Fix path handling and typos: - Correct makedirs() call in lightrag_openai_demo.py to create log_dir directly - Update constants.py comments to clarify SOURCE_IDS_LIMIT_METHOD options - Remove duplicate return statement in utils.py normalize_extracted_info() - Fix error string formatting in chroma_impl.py with !s conversion - Remove unused pipmaster import from chroma_impl.py clssck 2025-12-05 18:10:19 +01:00
  • dd1413f3eb test(lightrag,examples): add prompt accuracy and quality tests Add comprehensive test suites for prompt evaluation: - test_prompt_accuracy.py: 365 lines testing prompt extraction accuracy - test_prompt_quality_deep.py: 672 lines for deep quality analysis - Refactor prompt.py to consolidate optimized variants (removed prompt_optimized.py) - Apply ruff formatting and type hints across 30 files - Update pyrightconfig.json for static type checking - Modernize reproduce scripts and examples with improved type annotations - Sync uv.lock dependencies clssck 2025-12-05 16:39:52 +01:00
  • 9afc59956f
    Merge branch 'main' into chore/support-voyageai-embed-directly Dawid Laszuk 2025-12-05 06:43:22 -08:00
  • 69358d830d test(lightrag,examples,api): comprehensive ruff formatting and type hints Format entire codebase with ruff and add type hints across all modules: - Apply ruff formatting to all Python files (121 files, 17K insertions) - Add type hints to function signatures throughout lightrag core and API - Update test suite with improved type annotations and docstrings - Add pyrightconfig.json for static type checking configuration - Create prompt_optimized.py and test_extraction_prompt_ab.py test files - Update ruff.toml and .gitignore for improved linting configuration - Standardize code style across examples, reproduce scripts, and utilities clssck 2025-12-05 15:17:06 +01:00
  • 18c5623993 docs: add multi-tenant storage backend audit report with implementation details and test coverage Raphaël MANSUY 2025-12-05 16:09:28 +08:00
  • 3905d40b37 chore: clean PR for upstream integration Raphaël MANSUY 2025-12-05 15:28:34 +08:00
  • 9c10f628df docs: add comprehensive PR audit report for HKUDS upstream integration Raphaël MANSUY 2025-12-05 15:09:44 +08:00
  • de909827ed fix(tests): update test mocks and skip unimplemented feature tests Raphaël MANSUY 2025-12-05 15:08:03 +08:00
  • 3f845d122d Fix: make config parsing import-safe (parse_known_args) and add gpt5 kwargs normalization helper Raphaël MANSUY 2025-12-05 14:44:31 +08:00
  • ad1d357b0d chore(logs): normalize trailing whitespace and EOF for CI lint Raphaël MANSUY 2025-12-05 14:35:11 +08:00
  • cf75f71291 ci: fix lint/pre-commit issues and apply autoformat Raphaël MANSUY 2025-12-05 14:31:13 +08:00
  • 83e7f6a236 logs: add multi-tenant audit & document count bugfix log (2025-01-06) Raphaël MANSUY 2025-12-05 14:15:50 +08:00
  • 30787c0d2d auth: treat configured super-admin users as admin at login (assign admin role) Raphaël MANSUY 2025-12-05 13:27:29 +08:00
  • 61fb783f8f Makefile: add seed-demo-tenants target (non-destructive API seeder) Raphaël MANSUY 2025-12-05 13:18:24 +08:00
  • b69214e21b Makefile: add reset-demo-tenants-dry-run (preview non-destructive workflow) Raphaël MANSUY 2025-12-05 13:15:35 +08:00
  • afde907a5c Makefile: add reset-demo-tenants target (non-interactive DB reset + demo tenant seed) Raphaël MANSUY 2025-12-05 13:12:29 +08:00
  • 0f7b8ff0a3 Fix: reset document status endpoint (dict access) and add UI 'Reset to Pending' + error handler improvements and translations Raphaël MANSUY 2025-12-05 13:07:44 +08:00
  • 37f34fb12d chore/support-voyageai-embed-directly: fix: revert uv.lock changes Dawid Laszuk 2025-12-04 16:24:19 -08:00
  • 45700cdf76 chore/support-voyageai-embed-directly: feat: voyageai embed support Dawid Laszuk 2025-12-04 16:18:44 -08:00
  • de3aeca300
    Bump the frontend-minor-patch group in /lightrag_webui with 10 updates dependabot[bot] 2025-12-04 18:08:07 +00:00
  • d169ec5840
    Bump the build-tools group in /lightrag_webui with 3 updates dependabot[bot] 2025-12-04 18:07:13 +00:00
  • e83d5307f3
    Bump lucide-react in /lightrag_webui in the ui-components group dependabot[bot] 2025-12-04 18:06:42 +00:00
  • e4962dd2a5 feat: Enhance multi-tenant support by allowing unauthenticated access and updating document routes to use tenant-specific RAG instances Raphaël MANSUY 2025-12-05 00:55:09 +08:00
  • 730c406749 feat: Implement multi-tenant support across graph and query routes Raphaël MANSUY 2025-12-05 00:04:29 +08:00
  • 8f1ff985d0 Fix links in README.md and README-zh.md Joschka Hüllmann 2025-12-04 15:49:20 +01:00
  • 359f7d15f2
    Create docker-compose-del4800.yml sergeiknysh 2025-12-04 14:29:03 +01:00
  • a6aa073d70 feat(webui): Add single-tenant/multi-tenant mode support Raphaël MANSUY 2025-12-04 20:37:06 +08:00
  • 5b0a40b7b2 docs: add integration test and merge review log Raphaël MANSUY 2025-12-04 19:36:38 +08:00
  • da7df549ee docs: add merge readiness review document Raphaël MANSUY 2025-12-04 19:36:07 +08:00
  • b1b58d1f8d fix: add retry config keys to postgres integration test fixture Raphaël MANSUY 2025-12-04 19:33:32 +08:00
  • 78a5f8a9d6 docs: add test completion log Raphaël MANSUY 2025-12-04 19:30:57 +08:00
  • 2053af15a4 fix: correct test mock paths for rerank chunking tests Raphaël MANSUY 2025-12-04 19:28:50 +08:00
  • 4621ee216e fix: sync document_routes.py from upstream to resolve conflict markers Raphaël MANSUY 2025-12-04 19:26:41 +08:00
  • d8c80243a4 fix: sync base.py from upstream to remove orphaned abstract methods Raphaël MANSUY 2025-12-04 19:26:25 +08:00
  • ccd2f82174 fix: sync all kg modules from upstream Raphaël MANSUY 2025-12-04 19:22:13 +08:00
  • 09d0721cab fix: sync postgres and shared_storage from upstream Raphaël MANSUY 2025-12-04 19:22:01 +08:00
  • 46eee7273a docs: add premerge completion summary Raphaël MANSUY 2025-12-04 19:21:09 +08:00
  • 0eb9ad689d docs: add premerge completion summary Raphaël MANSUY 2025-12-04 19:21:05 +08:00
  • d1262e999d fix: sync core modules from upstream Raphaël MANSUY 2025-12-04 19:20:28 +08:00
  • f6f3ed93d3 fix: sync openai.py from upstream Raphaël MANSUY 2025-12-04 19:20:11 +08:00
  • 253cc3b9e4 fix: sync pyproject.toml from upstream Raphaël MANSUY 2025-12-04 19:20:01 +08:00
  • e09569527f cherry-pick 5c964267 Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • ff257ec5c1 cherry-pick babbcb56 Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • e9bbea733f cherry-pick 37178462 Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • 042e19ec7c cherry-pick 3c85e488 Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • 8b305b47b7 cherry-pick c12bc372 Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • 3f70dd04da cherry-pick 831e658e Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • 7a9ebbedb7 cherry-pick f490622b Raphaël MANSUY 2025-12-04 19:19:24 +08:00
  • 7eda6d0a4e cherry-pick d36be1f4 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 248c389fda cherry-pick a73314a4 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 921e15fb87 cherry-pick 2823f92f Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 6b0fe03dcf cherry-pick 06b91d00 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 7aa4af900a cherry-pick d4b8a229 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • aba1c65d7f cherry-pick c358f405 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 730c4030f7 cherry-pick 4e4b8d7e Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • d761d8e6be cherry-pick 41c26a36 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 4af5f6c759 cherry-pick 36694eb9 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 7ce259fbb4 cherry-pick 0b5e3f9d Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • eef3178064 cherry-pick 026bca00 Raphaël MANSUY 2025-12-04 19:19:23 +08:00
  • 4b18e6b3e4 cherry-pick 1ad0bf82 Raphaël MANSUY 2025-12-04 19:19:22 +08:00