gmakstutis/LightRAG
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2929 commits 5 branches 72 tags 705 MiB
Commit graph

437 commits

Author SHA1 Message Date
Alex Z
d0d246bef8 Fix 'TOO MANY OPEN FILE' problem while using redis vector DB: 
Enhance RedisKVStorage: Implement connection pooling and error handling. Refactor async methods to use context managers for Redis operations, improving resource management and error logging. Batch processing added for key operations to optimize performance.
 2025-04-02 21:06:49 -07:00
yangdx
922fc914be Change empty pipeline job name 2025-03-26 17:48:00 +08:00
yangdx
c4335f5dd0 Merge branch 'main' into add-temperature 2025-03-25 13:53:16 +08:00
zrguo
56fa051917 fix lint 2025-03-25 13:24:52 +08:00
yangdx
15e060f854 Fix share storage update status handling problem of in memeory storage 2025-03-25 10:48:15 +08:00
yangdx
ff9cb2138d Ensure thread safety in storage update callbacks 
- Added storage lock in index_done_callback
- Fixed potential race conditions
 2025-03-24 02:11:59 +08:00
Gardel
69322e198f
fix: add missing file_path for mongo impl 2025-03-22 23:43:21 +08:00
yangdx
53396e4d82 Fixlinting 2025-03-21 16:56:47 +08:00
yangdx
20d65ae554 feat(shared_storage): prevent event loop blocking in multiprocess mode 
Add auxiliary async locks in multiprocess mode to prevent event loop blocking
 2025-03-21 16:08:23 +08:00
zrguo
aa66ddea41
Merge pull request #1120 from Howe829/fix/chunk_ids 
fix: correct chunk_ids as array type and remove incorrect filepath type conversion
 2025-03-20 21:48:17 +08:00
jofoks
7e53d94526 Implemented simple PSQL doc-status get_by_ids method 2025-03-19 15:24:25 -07:00
HowardChan
0c39ff00a8 fix: resolve SQL type mismatch and conflict handling in LIGHTRAG_VDB_ENTITY insert query 2025-03-19 13:01:07 +08:00
HowardChan
1530798fb6 fix: ensure chunk_ids are correctly handled as VARCHAR array 2025-03-19 12:59:44 +08:00
yangdx
20de4ded30 Add default file_path for missing document paths 
- Set file_path to "no-file-path" if missing
- Ensure consistent document data structure
 2025-03-18 20:06:18 +08:00
Daniel.y
79b32026ec
Merge branch 'HKUDS:main' into main 2025-03-18 18:07:46 +08:00
zrguo
a3de421b14
Merge pull request #1108 from HKUDS/webui-node-expansion 
Added camera rotation to graph panel and merge login feature
 2025-03-18 17:50:38 +08:00
yangdx
b46f2ff871 Merge branch 'fix--psql-return-type' 2025-03-18 17:15:29 +08:00
jofoks
54e4a31aa6 Fixed get_by_id type error in PSQL impl 2025-03-17 17:32:54 -07:00
yangdx
c641a6290c Ensure unique edge IDs for NetworkX 2025-03-18 00:00:56 +08:00
zrguo
dfd19b8d27 fix postgres support 2025-03-17 23:59:47 +08:00
zrguo
e7395a2c8d
Merge branch 'main' into main 2025-03-17 17:23:41 +08:00
zrguo
3df20ae787 fix lint 2025-03-17 15:59:54 +08:00
zrguo
5956f22612
Merge branch 'main' into fix--postgres-impl 2025-03-17 15:42:09 +08:00
zrguo
901760ab98
Merge branch 'main' into postgres-improve-entities-relation-save-process 2025-03-17 15:39:40 +08:00
pengjunfeng11
4e58c7d7da
Update postgres_impl.py 
There is aBUG. When lighttrag uses the postgres@15 version, there will be an error.The BUG detail as follow:
PostgreSQL database, error:subquery in FROM must have an alias
HINT:  For example, FROM (SELECT ...) [AS] foo.
It roughly means that there is an error in SQL template, and you need to use the alias alias to declare the content of the subquery.
 2025-03-17 10:47:17 +08:00
Daniel.y
0277c94a61
Merge pull request #1091 from JoramMillenaar/quickfix--small-db-fields 
Updated PSQL's chunk_id field to be a TEXT field
 2025-03-16 22:48:54 +08:00
Daniel.y
9d971e5889
Merge pull request #1062 from ericshao/fix-postgres 
Fix PGDocStatusStorage content extraction for DocProcessingStatus
 2025-03-16 15:47:32 +08:00
jofoks
912e70feb1 Updated chunk_id field to be a TEXT field 2025-03-14 11:03:28 -07:00
jofoks
af88561713 Merge branch 'main' into fix--postgres-impl 2025-03-13 16:16:25 -07:00
jofoks
edc95126de Fixed some query parsing issues 2025-03-13 11:30:52 -07:00
Mykola Chaban
ceae2eb92d fixed issue with convert the age query to the dictionary; 
refactored solution of storing chunk ids;
 2025-03-13 13:45:09 +02:00
yangdx
5b70d34822 Fix get single node subgrap problem 
- Replaced MATCH with OPTIONAL MATCH
- Add memory-bank directory for Cline to .gitignore
 2025-03-13 02:14:02 +08:00
yangdx
3cd574f6a8 Merge branch 'main' into fix-neo4j-duplicate-nodes 2025-03-12 12:35:36 +08:00
yangdx
8f633c89fd Remove duplicate retry decorator in Neo4JStorage class. 2025-03-12 09:12:06 +08:00
Eric Shao
01f60d5a4d 修复 PGDocStatusStorage 中的内容提取错误 2025-03-12 07:47:21 +08:00
ArindamRoy23
49dd5f936e
Merge branch 'HKUDS:main' into main 2025-03-11 20:53:00 +05:30
Roy
8aa9d0e6ca Add optional ids filter to vector database query methods 
- Updated query method signatures across multiple vector database implementations
- Added optional `ids` parameter to filter search results
- Consistent implementation across ChromaDB, Faiss, Milvus, MongoDB, NanoVectorDB, Oracle, Qdrant, and TiDB vector storage classes
 2025-03-11 15:22:17 +00:00
yangdx
cbacb615f3 Use COALESCE to handle null degree counts in Neo4J queries. 
- Ensures degree count defaults to 0
- Prevents null-related errors in queries
 2025-03-11 18:33:26 +08:00
yangdx
bedad9a6d9 Merge branch 'main' into fix-neo4j-duplicate-nodes 2025-03-11 18:05:58 +08:00
zrguo
c26cb3a9ea fix merge bugs 2025-03-11 16:05:04 +08:00
yangdx
30310c2845 Fix relation info in kownledge graph UI 2025-03-11 15:36:38 +08:00
zrguo
91f96f2a8b
Merge pull request #1032 from ArindamRoy23/main 
Filter by ID during Query for Postgres VDB
 2025-03-11 15:26:59 +08:00
yangdx
7fddabb441 Fix linting 2025-03-11 10:28:25 +08:00
yangdx
aefd596990 Refactor Neo4JStorage to use entity_id for node identification, use entity_type for node label 2025-03-11 09:59:42 +08:00
Roy
92ae895713 Refactor requirements and code formatting 
- Simplified requirements.txt by removing specific version constraints
- Added comment about extra library installation using pipmaster
- Improved code formatting in base.py, operate.py, and postgres_impl.py
- Cleaned up SQL templates and query method signatures with consistent formatting
 2025-03-10 15:39:18 +00:00
yangdx
5d64f3b0a0 Improved auto-scan task initialization and status tracking. 
- Added autoscan status tracking in pipeline
- Ensured auto-scan runs only once per startup
 2025-03-10 17:14:14 +08:00
yangdx
57a41eedb8 Fix linting 2025-03-10 15:41:46 +08:00
yangdx
46610682ce Fix data persistence issue in single-process mode 
In single-process mode, data updates and persistence were not working properly because the update flags were not being correctly handled between different objects.
 2025-03-10 15:41:00 +08:00
yangdx
adca27fae9 Merge branch 'main' into neo4j-add-min-degree 2025-03-10 02:13:49 +08:00
yangdx
4065a7df92 Fix linting 2025-03-10 02:07:19 +08:00