Commit graph

678 commits

Author SHA1 Message Date
DavIvek
08eb68b8ed run pre-commit 2025-07-08 20:21:20 +02:00
DavIvek
4438897b6b add changes based on review 2025-07-08 16:28:06 +02:00
yangdx
2670f8dc98 Merge branch 'main' into add-Memgraph-graph-db 2025-07-08 00:31:46 +08:00
yangdx
ef79088f60 Move max_graph_nodes to global config 2025-07-07 21:53:57 +08:00
yangdx
7a7a01b68b Fix linting 2025-07-07 04:44:06 +08:00
yangdx
9e823de74e Exit program on vector index creation failure for MongoDB 2025-07-07 04:43:46 +08:00
yangdx
809f839c07 Merge branch 'main' into add-Memgraph-graph-db 2025-07-07 04:29:12 +08:00
yangdx
4632adb355 Add NEO4J_WORKSPACE env var override support
- Allow workspace override via NEO4J_WORKSPACE
- Update env.example with new config option
2025-07-07 04:16:44 +08:00
yangdx
da8655002a Add composite indexes for workspace+id columns for PostgreSQL 2025-07-07 03:36:49 +08:00
yangdx
907f2313cd Improve MongoDB vector index handling with workspace support
- Add workspace-specific index naming
- Store index name as instance variable
2025-07-07 03:19:41 +08:00
yangdx
033098c1bc Feat: Add WORKSPACE support to all storage types 2025-07-07 00:57:21 +08:00
yangdx
a567601da2 Merge branch 'main' into add-Memgraph-graph-db 2025-07-05 13:14:39 +08:00
yangdx
86a00ed333 Remove deprecated storage type 2025-07-05 13:11:32 +08:00
yangdx
bdfd2d53c7 Fix linting 2025-07-05 11:43:45 +08:00
yangdx
2e2b9f3b48 Refactor setup.py to utilize pyproject.toml for project installation. 2025-07-05 11:19:00 +08:00
yangdx
99bb25a282 Update logger message 2025-07-05 08:21:54 +08:00
yangdx
8ce2223e58 Merge branch 'main' into add-Memgraph-graph-db 2025-07-05 07:56:14 +08:00
yangdx
2d78d74055 Fix milvus compatible check error 2025-07-05 07:55:36 +08:00
yangdx
fb979be9ff Fix linting 2025-07-05 07:09:33 +08:00
yangdx
b842a80aab Fix linting 2025-07-05 07:09:01 +08:00
yangdx
9878dc7f51 fix: ensure Milvus collections are loaded before operations
- Resolves "collection not loaded" MilvusException errors
2025-07-05 00:40:25 +08:00
yangdx
2f7cef968d fix: ensure Milvus collections are loaded before operations
- Resolves "collection not loaded" MilvusException errors
2025-07-05 00:32:55 +08:00
yangdx
4ea38456f0 Improve graph query robustness and error handling 2025-07-05 00:31:52 +08:00
yangdx
a69194c079 Merge branch 'main' into add-Memgraph-graph-db 2025-07-04 23:53:07 +08:00
yangdx
7ec4ba5f9a Fix: recover faiss_impl.py 2025-07-04 23:50:27 +08:00
yangdx
951ea3b851 Remvoe deprecated storage type 2025-07-04 21:48:18 +08:00
yangdx
6201c7fb56 Refactoring Milvus implementation 2025-07-04 21:42:10 +08:00
yangdx
810676d54c Fix faisss import error 2025-07-04 19:12:23 +08:00
yangdx
531502677e fix: Use create_time when update_time is 0 in PGKVStorage queries 2025-07-03 23:38:53 +08:00
yangdx
3355a0ce95 Fix create_time conflict in MongoKVStorage updates 2025-07-03 22:58:08 +08:00
yangdx
6c2ae40d7d Refac: Enhance KG rebuild stability by incorporating create_time into the LLM cache 2025-07-03 17:08:29 +08:00
yangdx
70e154b0aa Fix linting 2025-07-03 12:26:05 +08:00
yangdx
ff1b1c61c7 Implemented storage types: PostgreSQL and MongoDB 2025-07-03 11:46:24 +08:00
yangdx
e56734cb8b Refac: Optimize document deletion performance
- Adding chunks_list to  dock_status
- Adding  llm_cache_list to text_chunks
- Implemented storage types: JsonKV and  Redis
2025-07-03 04:18:25 +08:00
yangdx
86c9a0cda2 Fix linting 2025-07-02 16:29:43 +08:00
yangdx
271722405f feat: Flatten LLM cache structure for improved recall efficiency
Refactored the LLM cache to a flat Key-Value (KV) structure, replacing the previous nested format. The old structure used the 'mode' as a key and stored specific cache content as JSON nested under it. This change significantly enhances cache recall efficiency.
2025-07-02 16:11:53 +08:00
yangdx
4c2b4b4b6b Revert "Fix LLM cache handling for Redis to address document deletion scenarios."
This reverts commit 14cda93988.
2025-06-29 22:35:40 +08:00
yangdx
10cd9c90e7 Revert "Fix linting"
This reverts commit abd9de2a63.
2025-06-29 22:35:26 +08:00
yangdx
abd9de2a63 Fix linting 2025-06-29 15:15:49 +08:00
yangdx
14cda93988 Fix LLM cache handling for Redis to address document deletion scenarios.
- Implements bulk scan for "extract" cache entries
- Maintains backward compatibility for normal IDs
2025-06-29 15:13:42 +08:00
yangdx
e2824b721e Fix LLM cache handling for MongoKVStorage to address document deletion scenarios.
- Support fetching all "default_" prefixed documents
- Maintain original behavior for other IDs
- Return dictionary of documents for "default"
- Keep backward compatibility
2025-06-29 15:03:57 +08:00
yangdx
37bf341a69 Fix LLM cache handling for PGKVStorage to address document deletion scenarios.
- Add dynamic cache_type field
- Support mode parameter for LLM cache
- Maintain backward compatibility
2025-06-29 14:39:50 +08:00
yangdx
6d5e73a251 Merge branch 'kenspirit/main' 2025-06-29 00:30:58 +08:00
yangdx
28aedd8b3c Update comments 2025-06-29 00:30:39 +08:00
Ken Chen
4a953d6829 As Graph edges should be treated undirectional, fix incorrect upsert_edge method in MongoDBGraph 2025-06-28 21:03:54 +08:00
Ken Chen
5116d61eaa As Graph edges should be treated undirectional, fix incorrect has_edge method in MongoDBGraph 2025-06-28 20:48:30 +08:00
Ken Chen
73cc86662a Add two BFS subgraph search support for MongoDBGraph 2025-06-28 20:00:13 +08:00
Ken Chen
5739f52d29 Rewrite get_knowledge_graph with label * by degree 2025-06-28 17:10:39 +08:00
Ken Chen
d0f4eee404 Fix accidentally hardcoded edge collection name in searching upstream nodes 2025-06-28 16:25:44 +08:00
yangdx
b7f8c20e61 fix(postgres): use correct table for vector queries
Change SQL templates from LIGHTRAG_DOC_CHUNKS to LIGHTRAG_VDB_CHUNKS
to fix "content_vector does not exist" error in vector operations.
2025-06-28 15:36:54 +08:00