Commit graph

4295 commits

Author SHA1 Message Date
yangdx
4d8eda5ce3 Merge branch 'find_text_unit' 2025-07-19 21:09:50 +08:00
yangdx
7e3914052d Optimize text chunk retrieval with batch fetching
- Replace individual chunk fetches with batch get
- Simplify deduplication logic
- Improve error handling for missing data
2025-07-19 21:01:03 +08:00
xuewei
7acca59dfb Improve query for find_text_unit 2025-07-19 17:27:28 +08:00
yangdx
8d8f9e411e Bump core verion to 1.4.4 and api version to 0187 2025-07-19 13:28:39 +08:00
yangdx
2c7d2b3f5f Increase Neo4j connection pool size and timeouts
- Bump default connection pool size to 100
- Add new Neo4j timeout env variables to env.example
2025-07-19 13:27:34 +08:00
Daniel.y
0171e0ce20
Merge pull request #1811 from danielaskdd/fix-keyed-lock
Fix: implemented entity-keyed locks for edge merging operations to ensure robust race condition protection
2025-07-19 12:22:49 +08:00
yangdx
cba97c62fe Merge branch 'fix-memgraph' into fix-keyed-lock 2025-07-19 11:55:24 +08:00
Daniel.y
66967c3802
Merge pull request #1810 from danielaskdd/fix-memgraph
Fix: add retry mechanism for Memgraph transient errors
2025-07-19 11:54:34 +08:00
Daniel.y
678da3e398
Merge pull request #1809 from danielaskdd/fix-redis
Enhance Redis connection handling with retries and timeouts
2025-07-19 11:52:25 +08:00
yangdx
2d3a530ce8 Fix: Implemented entity-keyed locks for edge merging operations to ensure robust race condition protection
- Replacing string concatenation with direct list passing for lock keys
- Eliminating deadlock risks by removing the lock around node insertion within the edge merge
2025-07-19 11:48:19 +08:00
yangdx
9f5399c2f1 Replace tenacity retries with manual Memgraph transaction retries
- Implement manual retry logic
- Add exponential backoff with jitter
- Improve error handling for transient errors
2025-07-19 11:31:21 +08:00
yangdx
99e58ac752 fix: add retry mechanism for Memgraph transient errors
- Implement exponential backoff retry for transaction conflicts
- Add tenacity-based retry decorator with 5 attempts
- Handle TransientError in upsert_node and upsert_edge operations
- Resolve "Cannot resolve conflicting transactions" errors
- Improve system reliability under concurrent load
2025-07-19 10:34:35 +08:00
yangdx
aea18d7b80 Merge branch 'fix-redis' into fix-keyed-lock 2025-07-19 10:26:08 +08:00
yangdx
6e1657a771 Improve thread safety for relationship rebuilding
- Sort src and tgt for consistent lock keys
- Maintain order-independent locking
2025-07-19 10:25:48 +08:00
yangdx
96b94acc83 Enhance Redis connection handling with retries and timeouts
- Added Redis connection timeout configurations
- Implemented retry logic for Redis operations
- Updated error handling for timeout cases
- Improved connection pool management
- Added environment variable support
2025-07-19 10:15:26 +08:00
yangdx
05bc5cfb64 Improve task execution with early failure detection
- Add early failure detection for async tasks
- Cancel pending tasks on first exception
2025-07-19 10:14:22 +08:00
yangdx
12d4f12e57 fix: sort edge_key components in _locked_process_edges for consistent locking
- Ensures bidirectional relationships use same lock key
- Maintains thread safety for knowledge graph edge operations
2025-07-19 07:36:50 +08:00
Daniel.y
801bdc520e
Merge pull request #1801 from Chida82/main
fix Azure deployment
2025-07-18 16:00:09 +08:00
Daniel.y
1c870454f1
Merge pull request #1802 from danielaskdd/fix-agtype-parsing
fix(postgres): improve AGE agtype parsing and simplify error logging
2025-07-18 08:52:59 +08:00
yangdx
f033fd6f87 fix(postgres): improve AGE agtype parsing and simplify error logging
- Fix JSON parsing errors caused by :: characters in data content
- Implement precise agtype string parsing using rfind() to separate JSON content from type identifiers
- Add robust error handling for malformed JSON in graph data
2025-07-18 08:50:47 +08:00
Dario Chini
5b28233903 fix Azure deployment 2025-07-17 23:11:07 +02:00
Daniel.y
83c8691221
Merge pull request #1799 from danielaskdd/remove-requirements
Remove separate requirements.txt and update Dockerfile to use pip install
2025-07-18 02:11:39 +08:00
yangdx
488028b9e2 Remove separate requirements.txt and update Dockerfile to use pip install 2025-07-18 01:58:46 +08:00
Daniel.y
03cd40d00d
Merge pull request #1797 from danielaskdd/defaul-query-mode
feat: change default query mode from hybrid to mix
2025-07-17 19:23:24 +08:00
yangdx
99527027de feat: change default query mode from hybrid to mix
- Update default mode for Ollama chat endpoint
- Update default mode for query endpoint of LightRAG
2025-07-17 19:21:15 +08:00
yangdx
e828539b24 Update README 2025-07-17 19:05:34 +08:00
Daniel.y
dae6190a85
Merge pull request #1796 from danielaskdd/fix-filepath-join
Fix file path handling in graph operations
2025-07-17 18:41:39 +08:00
yangdx
be2d938c84 Fix file path handling in graph operations
- Filter out empty file paths
- Handle missing file_path fields
2025-07-17 18:33:14 +08:00
yangdx
b321afefaa Bump core version to 1.4.3 and api version to 0186 2025-07-17 16:58:57 +08:00
yangdx
f3c0dab7ce Bump core version to 1.4.2 and api version to 0185 2025-07-17 12:26:10 +08:00
yangdx
56d91d6d3e Merge branch 'milvus-for-nullable' 2025-07-17 12:22:47 +08:00
yangdx
25a7408b31 Merge branch 'fix-milvus' into milvus-for-nullable 2025-07-17 12:15:11 +08:00
okxuewei
e6a7dc94f3
Rollback the update 2025-07-17 12:09:16 +08:00
yangdx
14d9fe49b0 refactor(milvus): remove entity_type and weight fields from schema
- Remove entity_type field from entities collections
- Remove weight field from relationships collections
- Update schema definitions and index creation logic
- Maintain backward compatibility with existing data via dynamic fields
2025-07-17 12:08:35 +08:00
okxuewei
a896e78969
Remove "entity_type" and "weight" from the schema 2025-07-17 12:06:49 +08:00
okxuewei
fc60b902e5
Merge branch 'main' into milvus-for-nullable 2025-07-17 11:55:47 +08:00
Daniel.y
30e5aac6f6
Merge pull request #1794 from danielaskdd/weight-default
fix: change default edge weight from 0.0 to 1.0 in entity extraction and graph storage
2025-07-17 11:42:31 +08:00
yangdx
7184c7b3ab fix: change default edge weight from 0.0 to 1.0 in entity extraction and graph storage
- Update extract_entities function in operate.py to use 1.0 as default weight
- Fix Neo4j implementation to use 1.0 instead of 0.0 for missing edge weights
- Fix Memgraph implementation to use 1.0 instead of 0.0 for missing edge weights
- Ensures consistent non-zero default weights across all graph storage backends
2025-07-17 11:30:49 +08:00
Daniel.y
946139a97a
Merge pull request #1790 from danielaskdd/fix-pg-migration
Hotfix for PostgreSQL migration problem
2025-07-16 22:24:00 +08:00
yangdx
57c8c19628 Add datetime format migration for doc status table 2025-07-16 22:21:51 +08:00
xuewei
77a42a37ca Fix Milvus DataNotMatchException lint-and-format 2025-07-16 22:07:39 +08:00
xuewei
e0bb6093b0 Fix Milvus DataNotMatchException 2025-07-16 21:59:17 +08:00
yangdx
910c6973f3 Limit file deletion to current directory only after document cleaning 2025-07-16 20:35:24 +08:00
yangdx
c7b566f6d5 Fix cache migration MD5 error for PostgreSQL 2025-07-16 19:24:57 +08:00
yangdx
80f7e37168 Fix default workspace name for PostgreSQL AGE graph storage 2025-07-16 19:16:22 +08:00
yangdx
bab2803953 Optimize PostgreSQL database migrations for LLM cache
- Combine column migration into single operation
- Optimize LLM cache key migration query
- Improve migration error handling
- Add conflict detection for cache migration
2025-07-16 17:32:53 +08:00
yangdx
bd340fece6 Fix timestamp column migration comment typos
- Correct timezone-related comments
- Fix typo in debug log message
- Update migration success message
- Maintain same migration logic
2025-07-16 14:27:52 +08:00
yangdx
7f9b15dcf3 Fix linting 2025-07-16 11:11:30 +08:00
yangdx
1c53c5c764 Update README.md 2025-07-16 11:10:56 +08:00
yangdx
2bf0d397ed Update webui assets 2025-07-16 10:18:51 +08:00