yangdx
95e1fb1612
Remove final_namespace attribute for in-memory storage and use namespace in clean_llm_query_cache.py
2025-11-17 12:54:33 +08:00
yangdx
d54d0d55d9
Standardize empty workspace handling from "_" to "" across storage
...
* Unify empty workspace behavior by changing workspace from "_" to ""
* Fixed incorrect empty workspace detection in get_all_update_flags_status()
2025-11-17 12:54:33 +08:00
yangdx
fd486bc922
Refactor storage classes to use namespace instead of final_namespace
2025-11-17 12:54:33 +08:00
yangdx
926960e957
Refactor workspace handling to use default workspace and namespace locks
...
- Remove DB-specific workspace configs
- Add default workspace auto-setting
- Replace global locks with namespace locks
- Simplify pipeline status management
- Remove redundant graph DB locking
2025-11-17 12:54:33 +08:00
yangdx
807d2461d3
Remove unused chunk-based node/edge retrieval methods
2025-11-06 18:17:10 +08:00
Aleks Vujić
dd8f44e621
Fixed typo in log message when creating new graph file
2025-10-07 14:30:05 +02:00
yangdx
f99c4a3738
Fix graph truncation logic for depth-limited traversals
...
• Only set truncated flag for node limit
• Keep depth limit info logging
• Improve log message clarity
• Fix false truncation detection
2025-09-24 18:03:11 +08:00
yangdx
9330ccb14e
Fix graph truncation logging to correctly identify truncation cause
2025-09-20 13:33:19 +08:00
yangdx
1dd164a122
Fix graph truncation detection for depth-limited BFS
...
- Track unexplored neighbors at max depth
- Improve truncation flag accuracy
2025-09-20 13:12:25 +08:00
yangdx
9db8f2fce5
feat: Add popular labels and search APIs with history management
...
- Add popular/search label endpoints
- Implement SearchHistoryManager utility
- Replace client-side with server search
- Add graph data version tracking
- Update UI for better label discovery
2025-09-20 02:03:47 +08:00
yangdx
f19cce16be
Fix incorrect variable name in NetworkXStorage file path
...
- Fix working_dir -> workspace_dir typo
- Correct GraphML file path generation
2025-09-04 18:31:53 +08:00
yangdx
d9c1f935f5
Fix: Resolve workspace isolation issues in in-memory database with multiple LightRAG instances
2025-08-12 01:26:09 +08:00
yangdx
091f2b42c3
feat(performance): Optimize document deletion with entity/relation index
...
- Introduces an index mapping documents to their corresponding entities and relations. This significantly speeds up `adelete_by_doc_id` by replacing slow graph traversal with a fast key-value lookup.
- Refactors the ingestion pipeline (`merge_nodes_and_edges`) to populate this new index. Adds a one-time data migration script to backfill the index for existing data.
2025-08-03 09:19:02 +08:00
yangdx
44b7ce222e
feat: add default storage dependencies and optimize imports
...
- Add nano-vectordb and networkx to pyproject.toml dependencies
- Replace dynamic imports with direct imports for 4 default storage implementations
- Improve startup performance while maintaining backward compatibility
2025-07-24 16:14:26 +08:00
yangdx
ef79088f60
Move max_graph_nodes to global config
2025-07-07 21:53:57 +08:00
yangdx
033098c1bc
Feat: Add WORKSPACE support to all storage types
2025-07-07 00:57:21 +08:00
yangdx
44daf51501
Fix edge_degree to handle non-existent nodes
2025-06-27 01:37:10 +08:00
yangdx
6e1ca8f461
Merge branch 'patch-1'
2025-06-26 18:45:23 +08:00
yangdx
da46b341dc
feat: Optimize document deletion performance
...
- To enhance performance during document deletion, new batch-get methods, `get_nodes_by_chunk_ids` and `get_edges_by_chunk_ids`, have been added to the graph storage layer (`BaseGraphStorage` and its implementations). The [`adelete_by_doc_id`](lightrag/lightrag.py:1681) function now leverages these methods to avoid unnecessary iteration over the entire knowledge graph, significantly improving efficiency.
- Graph storage updated: Networkx, Neo4j, Postgres AGE
2025-06-25 12:37:57 +08:00
pablo-statsig
4a8202138c
Remove graspologic pip installation that no longer seems to be used
...
As far as I can tell this is no longer actually used and its usage was removed in this commit:
83353ab9a6 (diff-a346bcfb05aab0cc0c0baa6018976f4efab339e8cade9f6f8fb658fcbd54ae2e)
Our systems are flagging this package as having a dependency on a package with a less permissive license so I would appreciate if it can be removed if its no longer needed. Let me know if that is not the case.
2025-06-05 18:01:00 -07:00
yangdx
9ec7f5c8b3
Fix degree sorting problem in BFS
2025-04-25 11:25:29 +08:00
yangdx
bd11bcae32
Fix linting
2025-04-25 09:43:18 +08:00
yangdx
c620f9c4f2
Prioritize high-degree neighbors in BFS traversal for NetoworkX storage
2025-04-25 09:22:53 +08:00
yangdx
d4c4a40c53
Fix M.env AX_GRAPH_NODES not working problem
2025-04-17 01:28:22 +08:00
yangdx
745301ea13
Deleted node2vec implementation
2025-04-11 18:41:45 +08:00
yangdx
83353ab9a6
Remove unused node embedding functionality from graph storage
...
- Deleted embed_nodes() method implementations
2025-04-11 18:34:48 +08:00
yangdx
ad087073aa
Optimize logger for storage
2025-04-10 01:07:06 +08:00
yangdx
84d6dee34d
Fix linting
2025-04-03 00:14:33 +08:00
yangdx
6d942da338
Fix BFS depth control in NetworkX graph traversal
2025-04-02 23:59:19 +08:00
yangdx
72132ee1d6
Added info logs when graph is truncated
2025-04-02 23:19:41 +08:00
yangdx
82c4baba70
Add is_truncated to graph query for NetworkX graph db
2025-04-02 22:12:20 +08:00
yangdx
4ceafb7cbc
Optimize NetworkX subgraph query
2025-04-02 21:41:24 +08:00
yangdx
95a8ee27ed
Fix linting
2025-03-31 23:22:27 +08:00
yangdx
1772e7a887
Add delete support to all storage implementation
2025-03-31 16:21:20 +08:00
yangdx
1df4b777d7
Add drop funtions to storage implementations
2025-03-30 15:17:57 +08:00
yangdx
15e060f854
Fix share storage update status handling problem of in memeory storage
2025-03-25 10:48:15 +08:00
yangdx
ff9cb2138d
Ensure thread safety in storage update callbacks
...
- Added storage lock in index_done_callback
- Fixed potential race conditions
2025-03-24 02:11:59 +08:00
yangdx
c641a6290c
Ensure unique edge IDs for NetworkX
2025-03-18 00:00:56 +08:00
yangdx
6d5c04d561
Reduce max_depth and update edge type in NetworkXStorage.
...
- Decreased max_depth from 5 to 3
- Changed edge type from "RELATED" to "DIRECTED"
2025-03-06 20:54:02 +08:00
yangdx
5b29e760f0
Add dynamic parameter handling for storage
2025-03-06 14:29:48 +08:00
yangdx
0ca7c0e230
Fix linting
2025-03-05 15:07:11 +08:00
yangdx
4e2a9b1994
Apply min_degree filter for full graph query
2025-03-05 13:21:17 +08:00
yangdx
ca9e958cad
Fix subgraph filtering bugs
2025-03-05 13:13:46 +08:00
yangdx
5f12aa3ee4
Fix linting
2025-03-05 12:32:23 +08:00
yangdx
5e40e4107d
Added min_degree exception for connected nodes
2025-03-05 11:48:04 +08:00
yangdx
1fddc8552e
Added minimum degree filter for graph queries
...
- Introduced min_degree parameter in graph query
- Updated UI to include minimum degree setting
- Modified API to handle min_degree parameter
- Updated graph query logic in LightRAG
2025-03-05 11:37:55 +08:00
yangdx
002948d342
Added search mode and min degree filtering for NetworkX
...
- Implemented exact and inclusive search modes
- Added min degree filtering for nodes
- Updated API to parse label for search options
2025-03-04 16:08:05 +08:00
yangdx
11fdb60fe5
Remove Chinese comments
2025-03-03 01:30:41 +08:00
yangdx
465737efed
Fix linting
2025-03-02 17:32:25 +08:00
yangdx
68bf02abb6
refactor: improve graph querying with label substring matching and security fixes
2025-03-02 16:20:37 +08:00