Commit graph

5429 commits

Author SHA1 Message Date
zumeramarketingadmin
fde872a5f2
Add GitHub Actions workflow for Python package
This workflow installs Python dependencies, runs linting and tests across multiple Python versions.
2025-10-28 16:09:16 +01:00
Daniel.y
4bf41abe89
Merge pull request #2272 from HKUDS/dependabot/pip/redis-gte-5.0.0-and-lt-8.0.0
Update redis requirement from <7.0.0,>=5.0.0 to >=5.0.0,<8.0.0
2025-10-28 02:44:48 +08:00
Daniel.y
d0be68c8f8
Merge pull request #2273 from danielaskdd/static-docs
Refact: Add offline Swagger UI support with custom static file serving
2025-10-28 02:44:34 +08:00
Daniel.y
af6aff33d2
Merge pull request #2266 from danielaskdd/merge-entity
Refactor: Enhanced Entity Merging with Chunk Tracking
2025-10-28 02:40:58 +08:00
dependabot[bot]
f81dd4e778
Update redis requirement from <7.0.0,>=5.0.0 to >=5.0.0,<8.0.0
Updates the requirements on [redis](https://github.com/redis/redis-py) to permit the latest version.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v5.0.0...v7.0.1)

---
updated-dependencies:
- dependency-name: redis
  dependency-version: 7.0.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-10-27 18:39:04 +00:00
yangdx
88d12beae2 Add offline Swagger UI support with custom static file serving
- Disable default docs URL
- Add custom /docs endpoint
- Mount static Swagger UI files
- Include OAuth2 redirect handler
- Support offline documentation access
2025-10-28 02:23:08 +08:00
yangdx
b32b2e8b9e Refactor merge dialog and improve search history sync
- Extract MergeDialog to separate component
- Update search history on entity rename
- Add dropdown refresh trigger mechanism
- Sync query label with entity changes
- Force graph re-render after updates
2025-10-28 01:52:49 +08:00
yangdx
ea006bd386 Fix entity update logic to handle renaming operations
- Add is_renaming condition check
- Ensure updates when entity renamed
2025-10-28 00:12:23 +08:00
yangdx
5155edd8d2 feat: Improve entity merge and edit UX
- **API:** The `graph/entity/edit` endpoint now returns a detailed `operation_summary` for better client-side handling of update, rename, and merge outcomes.
- **Web UI:** Added an "auto-merge on rename" option. The UI now gracefully handles merge success, partial failures (update OK, merge fail), and other errors with specific user feedback.
2025-10-27 23:42:08 +08:00
yangdx
97034f06e3 Add allow_merge parameter to entity update API endpoint 2025-10-27 14:30:27 +08:00
yangdx
11a1631d76 Refactor entity edit and merge functions to support merge-on-rename
• Extract internal implementation helpers
• Add allow_merge parameter to aedit_entity
• Support merging when renaming to existing name
• Improve code reusability and modularity
• Maintain backward compatibility
2025-10-27 14:23:51 +08:00
yangdx
411e92e6b9 Fix vector deletion logging to show actual deleted count 2025-10-27 14:22:16 +08:00
yangdx
94f24a66f2 Bump API version to 0246 2025-10-27 12:28:46 +08:00
yangdx
25f829ef48 Enable editing of entity_type field in node properties 2025-10-27 12:27:57 +08:00
yangdx
8dfd3bf428 Replace global graph DB lock with fine-grained keyed locking
• Use entity/relation-specific locks
• Lock multiple entities when needed
2025-10-27 02:55:58 +08:00
yangdx
2c09adb8d3 Add chunk tracking support to entity merge functionality
- Pass chunk storages to merge function
- Merge relation chunk tracking data
- Merge entity chunk tracking data
- Delete old chunk tracking records
- Persist chunk storage updates
2025-10-27 02:06:21 +08:00
yangdx
a25003c336 Fix relation deduplication logic and standardize log message prefixes 2025-10-27 00:52:56 +08:00
yangdx
ab32456a79 Refactor entity merging with unified attribute merge function
• Update GRAPH_FIELD_SEP comment clarity
• Deprecate merge_strategy parameter
• Unify entity/relation merge logic
• Add join_unique_comma strategy
2025-10-27 00:04:17 +08:00
yangdx
38559373b3 Fix entity merging to include target entity relationships
* Include target entity in collection
* Merge all relevant relationships
* Prevent relationship loss
* Fix merge completeness
2025-10-26 23:13:50 +08:00
Daniel.y
69b4cda242
Merge pull request #2265 from danielaskdd/edit-kg-new
Refactor: Enhance KG Editing with Chunk Tracking
2025-10-26 22:45:38 +08:00
yangdx
6015e8bc68 Refactor graph utils to use unified persistence callback
- Add _persist_graph_updates function
- Remove duplicate callback functions
2025-10-26 20:20:16 +08:00
yangdx
a3370b024d Add chunk tracking cleanup to entity/relation deletion and creation
• Clean up chunk storage on delete
• Track chunks in create operations
• Normalize relation keys consistently
2025-10-26 17:06:16 +08:00
yangdx
bf1897a67e Normalize entity order for undirected graph consistency
• Normalize entity pairs for storage
• Update API docs for undirected edges
2025-10-26 15:53:31 +08:00
yangdx
3fbd704bf9 Enhance entity/relation editing with chunk tracking synchronization
• Add chunk storage sync to edit ops
• Implement incremental chunk ID updates
• Support entity renaming migrations
• Normalize relation keys consistently
• Preserve chunk references on edits
2025-10-26 14:34:56 +08:00
Daniel.y
11f1f3664b
Merge pull request #2262 from danielaskdd/sort-edge
Fix: Ensure Storage Consistency When Creating Implicit Nodes from Relationships
2025-10-25 23:56:20 +08:00
Daniel.y
3ad4f12f6a
Merge pull request #2259 from danielaskdd/data-migration-problem
Fix: PostgreSQL Data Migration Performance Problem
2025-10-25 23:56:05 +08:00
yangdx
29bf593663 Fix entity and relation chunk cleanup in deletion pipeline
• Delete from entity_chunks storage
• Delete from relation_chunks storage
2025-10-25 22:32:27 +08:00
yangdx
5ee9a2f8c6 Fix entity consistency in knowledge graph rebuilding and merging
• Sort src/tgt for consistent ordering
• Create missing nodes before edges
• Update entity chunks storage
• Pass entity_vdb to rebuild function
• Ensure entities exist in all storages
2025-10-25 21:37:03 +08:00
yangdx
a97e5dad4c Optimize PostgreSQL graph queries to avoid Cypher overhead and complexity
• Replace Cypher with native SQL queries
• Fix O(N²) to O(E) performance issue
• Add error handling for parse failures
• Use direct table access pattern
• Eliminate Cartesian product joins
2025-10-25 14:37:18 +08:00
yangdx
a9bc348446 Remove enable_logging parameter from data init lock call 2025-10-25 11:48:14 +08:00
Daniel.y
c82485d94d
Merge pull request #2253 from Mobious/main
Allow users to provide keywords with QueryRequest
2025-10-25 11:26:54 +08:00
yangdx
97a2ee4ef1 Rename rebuild function name and improve relationship logging format 2025-10-25 11:17:43 +08:00
yangdx
083b163c1f Improve lock logging with consistent messaging and debug levels 2025-10-25 11:04:21 +08:00
Daniel.y
e2ec1cdcd4
Merge pull request #2258 from danielaskdd/pipeline-cancelllation
Feat: Add Pipeline Cancellation Feature with Enhanced Reliability
2025-10-25 04:26:39 +08:00
yangdx
3eb3a07544 Bump core version to 1.4.9.5 and API version to 0245 2025-10-25 04:23:57 +08:00
yangdx
9ed19695bb Remove separate retry button and merge functionality into scan button 2025-10-25 04:12:44 +08:00
yangdx
81e3496aa4 Add confirmation dialog for pipeline cancellation 2025-10-25 03:55:00 +08:00
yangdx
2476d6b7f8 Simplify pipeline status dialog by consolidating message sections
• Remove separate latest message section
• Combine into single pipeline messages area
• Add overflow-x-hidden for better display
• Change break-words to break-all
• Update translations across all locales
2025-10-25 03:34:54 +08:00
yangdx
a9ec15e669 Resolve lock leakage issue during user cancellation handling
• Change default log level to INFO
• Force enable error logging output
• Add lock cleanup rollback protection
• Handle LLM cache persistence errors
• Fix async task exception handling
2025-10-25 03:06:45 +08:00
yangdx
77336e50b6 Improve error handling and add cancellation checks in pipeline 2025-10-24 17:54:17 +08:00
yangdx
f89b5ab101 Add pipeline cancellation feature with UI and i18n support
- Add cancelPipeline API endpoint
- Add cancel button to status dialog
- Update status response type
- Add cancellation UI translations
- Handle cancellation request states
2025-10-24 15:30:27 +08:00
yangdx
78ad8873b8 Add cancellation check in delete loop 2025-10-24 14:47:20 +08:00
yangdx
743aefc655 Add pipeline cancellation feature for graceful processing termination
• Add cancel_pipeline API endpoint
• Implement PipelineCancelledException
• Add cancellation checks in main loop
• Handle task cancellation gracefully
• Mark cancelled docs as FAILED
2025-10-24 14:08:12 +08:00
Mobious
f24a261613 Allow users to provide keywords with QueryRequest 2025-10-23 12:53:19 -10:00
yangdx
6a29b5daa0 Update Docker deployment comments for LLM and embedding hosts 2025-10-23 13:53:26 +08:00
yangdx
fdf0fe048b Bump API version to 0244 2025-10-22 23:39:02 +08:00
yangdx
0fa9a2eee3 Fix dimension type comparison in Milvus vector field validation
• Convert dimensions to int for comparison
• Handle string vs int type mismatches
2025-10-22 23:37:49 +08:00
Daniel.y
06533fdb58
Merge pull request #2248 from danielaskdd/preprocess-rayanything
Refact: Add Multimodal Processing Status Support to DocProcessingStatus
2025-10-22 20:18:23 +08:00
yangdx
8dc23eeff2 Fix RayAnything compatible problem
• Use "preprocessed" to indicate multimodal processing is required
• Update DocProcessingStatus to process status convertion automatically
• Remove multimodal_processed from DocStatus enum value
• Update UI filter logic
2025-10-22 20:15:29 +08:00
yangdx
00aa5e53a7 Improve entity identifier truncation warning message format 2025-10-22 15:56:19 +08:00