Commit graph

90 commits

Author SHA1 Message Date
yangdx
95e1fb1612 Remove final_namespace attribute for in-memory storage and use namespace in clean_llm_query_cache.py 2025-11-17 12:54:33 +08:00
yangdx
d54d0d55d9 Standardize empty workspace handling from "_" to "" across storage
* Unify empty workspace behavior by changing workspace from "_" to ""
* Fixed incorrect empty workspace detection in get_all_update_flags_status()
2025-11-17 12:54:33 +08:00
yangdx
fd486bc922 Refactor storage classes to use namespace instead of final_namespace 2025-11-17 12:54:33 +08:00
yangdx
926960e957 Refactor workspace handling to use default workspace and namespace locks
- Remove DB-specific workspace configs
- Add default workspace auto-setting
- Replace global locks with namespace locks
- Simplify pipeline status management
- Remove redundant graph DB locking
2025-11-17 12:54:33 +08:00
yangdx
807d2461d3 Remove unused chunk-based node/edge retrieval methods 2025-11-06 18:17:10 +08:00
Aleks Vujić
dd8f44e621
Fixed typo in log message when creating new graph file 2025-10-07 14:30:05 +02:00
yangdx
f99c4a3738 Fix graph truncation logic for depth-limited traversals
• Only set truncated flag for node limit
• Keep depth limit info logging
• Improve log message clarity
• Fix false truncation detection
2025-09-24 18:03:11 +08:00
yangdx
9330ccb14e Fix graph truncation logging to correctly identify truncation cause 2025-09-20 13:33:19 +08:00
yangdx
1dd164a122 Fix graph truncation detection for depth-limited BFS
- Track unexplored neighbors at max depth
- Improve truncation flag accuracy
2025-09-20 13:12:25 +08:00
yangdx
9db8f2fce5 feat: Add popular labels and search APIs with history management
- Add popular/search label endpoints
- Implement SearchHistoryManager utility
- Replace client-side with server search
- Add graph data version tracking
- Update UI for better label discovery
2025-09-20 02:03:47 +08:00
yangdx
f19cce16be Fix incorrect variable name in NetworkXStorage file path
- Fix working_dir -> workspace_dir typo
- Correct GraphML file path generation
2025-09-04 18:31:53 +08:00
yangdx
d9c1f935f5 Fix: Resolve workspace isolation issues in in-memory database with multiple LightRAG instances 2025-08-12 01:26:09 +08:00
yangdx
091f2b42c3 feat(performance): Optimize document deletion with entity/relation index
- Introduces an index mapping documents to their corresponding entities and relations. This significantly speeds up `adelete_by_doc_id` by replacing slow graph traversal with a fast key-value lookup.
- Refactors the ingestion pipeline (`merge_nodes_and_edges`) to populate this new index. Adds a one-time data migration script to backfill the index for existing data.
2025-08-03 09:19:02 +08:00
yangdx
44b7ce222e feat: add default storage dependencies and optimize imports
- Add nano-vectordb and networkx to pyproject.toml dependencies
- Replace dynamic imports with direct imports for 4 default storage implementations
- Improve startup performance while maintaining backward compatibility
2025-07-24 16:14:26 +08:00
yangdx
ef79088f60 Move max_graph_nodes to global config 2025-07-07 21:53:57 +08:00
yangdx
033098c1bc Feat: Add WORKSPACE support to all storage types 2025-07-07 00:57:21 +08:00
yangdx
44daf51501 Fix edge_degree to handle non-existent nodes 2025-06-27 01:37:10 +08:00
yangdx
6e1ca8f461 Merge branch 'patch-1' 2025-06-26 18:45:23 +08:00
yangdx
da46b341dc feat: Optimize document deletion performance
- To enhance performance during document deletion, new batch-get methods, `get_nodes_by_chunk_ids` and `get_edges_by_chunk_ids`, have been added to the graph storage layer (`BaseGraphStorage` and its implementations). The [`adelete_by_doc_id`](lightrag/lightrag.py:1681) function now leverages these methods to avoid unnecessary iteration over the entire knowledge graph, significantly improving efficiency.
- Graph storage updated: Networkx, Neo4j, Postgres AGE
2025-06-25 12:37:57 +08:00
pablo-statsig
4a8202138c
Remove graspologic pip installation that no longer seems to be used
As far as I can tell this is no longer actually used and its usage was removed in this commit:
83353ab9a6 (diff-a346bcfb05aab0cc0c0baa6018976f4efab339e8cade9f6f8fb658fcbd54ae2e)

Our systems are flagging this package as having a dependency on a package with a less permissive license so I would appreciate if it can be removed if its no longer needed.  Let me know if that is not the case.
2025-06-05 18:01:00 -07:00
yangdx
9ec7f5c8b3 Fix degree sorting problem in BFS 2025-04-25 11:25:29 +08:00
yangdx
bd11bcae32 Fix linting 2025-04-25 09:43:18 +08:00
yangdx
c620f9c4f2 Prioritize high-degree neighbors in BFS traversal for NetoworkX storage 2025-04-25 09:22:53 +08:00
yangdx
d4c4a40c53 Fix M.env AX_GRAPH_NODES not working problem 2025-04-17 01:28:22 +08:00
yangdx
745301ea13 Deleted node2vec implementation 2025-04-11 18:41:45 +08:00
yangdx
83353ab9a6 Remove unused node embedding functionality from graph storage
- Deleted embed_nodes() method implementations
2025-04-11 18:34:48 +08:00
yangdx
ad087073aa Optimize logger for storage 2025-04-10 01:07:06 +08:00
yangdx
84d6dee34d Fix linting 2025-04-03 00:14:33 +08:00
yangdx
6d942da338 Fix BFS depth control in NetworkX graph traversal 2025-04-02 23:59:19 +08:00
yangdx
72132ee1d6 Added info logs when graph is truncated 2025-04-02 23:19:41 +08:00
yangdx
82c4baba70 Add is_truncated to graph query for NetworkX graph db 2025-04-02 22:12:20 +08:00
yangdx
4ceafb7cbc Optimize NetworkX subgraph query 2025-04-02 21:41:24 +08:00
yangdx
95a8ee27ed Fix linting 2025-03-31 23:22:27 +08:00
yangdx
1772e7a887 Add delete support to all storage implementation 2025-03-31 16:21:20 +08:00
yangdx
1df4b777d7 Add drop funtions to storage implementations 2025-03-30 15:17:57 +08:00
yangdx
15e060f854 Fix share storage update status handling problem of in memeory storage 2025-03-25 10:48:15 +08:00
yangdx
ff9cb2138d Ensure thread safety in storage update callbacks
- Added storage lock in index_done_callback
- Fixed potential race conditions
2025-03-24 02:11:59 +08:00
yangdx
c641a6290c Ensure unique edge IDs for NetworkX 2025-03-18 00:00:56 +08:00
yangdx
6d5c04d561 Reduce max_depth and update edge type in NetworkXStorage.
- Decreased max_depth from 5 to 3
- Changed edge type from "RELATED" to "DIRECTED"
2025-03-06 20:54:02 +08:00
yangdx
5b29e760f0 Add dynamic parameter handling for storage 2025-03-06 14:29:48 +08:00
yangdx
0ca7c0e230 Fix linting 2025-03-05 15:07:11 +08:00
yangdx
4e2a9b1994 Apply min_degree filter for full graph query 2025-03-05 13:21:17 +08:00
yangdx
ca9e958cad Fix subgraph filtering bugs 2025-03-05 13:13:46 +08:00
yangdx
5f12aa3ee4 Fix linting 2025-03-05 12:32:23 +08:00
yangdx
5e40e4107d Added min_degree exception for connected nodes 2025-03-05 11:48:04 +08:00
yangdx
1fddc8552e Added minimum degree filter for graph queries
- Introduced min_degree parameter in graph query
- Updated UI to include minimum degree setting
- Modified API to handle min_degree parameter
- Updated graph query logic in LightRAG
2025-03-05 11:37:55 +08:00
yangdx
002948d342 Added search mode and min degree filtering for NetworkX
- Implemented exact and inclusive search modes
- Added min degree filtering for nodes
- Updated API to parse label for search options
2025-03-04 16:08:05 +08:00
yangdx
11fdb60fe5 Remove Chinese comments 2025-03-03 01:30:41 +08:00
yangdx
465737efed Fix linting 2025-03-02 17:32:25 +08:00
yangdx
68bf02abb6 refactor: improve graph querying with label substring matching and security fixes 2025-03-02 16:20:37 +08:00