Commit graph

5359 commits

Author SHA1 Message Date
yangdx
88a45523e2 Increase default max file paths from 30 to 100 and improve documentation
- Bump DEFAULT_MAX_FILE_PATHS to 100
- Add clarifying comment about display
2025-10-21 17:33:00 +08:00
yangdx
e5e16b7bd1 Fix Redis data migration error
• Use proper Redis connection context
• Fix namespace pattern for key scanning
• Propagate storage check exceptions
• Remove defensive error swallowing
2025-10-21 16:27:04 +08:00
yangdx
3ed2abd82c Improve logging to show source ID ratios when skipping entities/edges 2025-10-21 16:20:34 +08:00
yangdx
3ad616be4f Change default source IDs limit method from KEEP to FIFO 2025-10-21 16:12:11 +08:00
yangdx
80668aae22 Improve file path truncation labels and UI consistency
• Standardize FIFO/KEEP truncation labels
• Update UI truncation text format
2025-10-21 15:39:31 +08:00
yangdx
be3d274a0b Refactor node and edge merging logic with improved code structure
• Add numbered steps for clarity
• Improve early return handling
• Enhance file path limiting logic
2025-10-21 15:16:47 +08:00
yangdx
a5253244f9 Simplify skip logging and reduce pipeline status updates 2025-10-21 06:33:34 +08:00
yangdx
1248b3ab04 Increase default limits for source IDs and file paths in metadata
• Entity source IDs: 3 → 300
• Relation source IDs: 3 → 300
• File paths: 2 → 30
2025-10-21 05:30:09 +08:00
yangdx
cd1c48beaf Standardize placeholder format to use colon separator consistently 2025-10-21 05:03:57 +08:00
yangdx
019dff5248 Update truncation message format in properties tooltip 2025-10-21 04:46:07 +08:00
yangdx
1154c5683f Refactor deduplication calculation and remove unused variables 2025-10-21 04:41:15 +08:00
yangdx
665f60b90f Refactor entity/relation merge to consolidate VDB operations within functions
• Move VDB upserts into merge functions
• Fix early return data structure issues
• Update status messages (IGNORE_NEW → KEEP)
• Consolidate error handling paths
• Improve relationship content format
2025-10-21 03:19:34 +08:00
yangdx
e01c998ee9 Track placeholders in file paths for accurate source count display
• Add has_placeholder tracking variable
• Detect placeholder patterns in paths
• Show + sign for truncated counts
2025-10-20 23:48:04 +08:00
yangdx
637b850ec5 Add truncation indicator and update property labels in graph view
• Add truncate tooltip to source_id field
• Add visual truncation indicator (†)
• Bump API version to 0242
2025-10-20 23:03:01 +08:00
yangdx
e0fd31a60d Fix logging message formatting 2025-10-20 22:09:09 +08:00
yangdx
a9fec26798 Add file path limit configuration for entities and relations
• Add MAX_FILE_PATHS env variable
• Implement file path count limiting
• Support KEEP/FIFO strategies
• Add truncation placeholder
• Remove old build_file_path function
2025-10-20 20:12:53 +08:00
yangdx
dc62c78f98 Add entity/relation chunk tracking with configurable source ID limits
- Add entity_chunks & relation_chunks storage
- Implement KEEP/FIFO limit strategies
- Update env.example with new settings
- Add migration for chunk tracking data
- Support all KV storage
2025-10-20 15:24:15 +08:00
yangdx
bdadaa6750 Merge branch 'main' into limit-vdb-metadata-size 2025-10-18 11:47:10 +08:00
yangdx
c0f69395c7 Merge branch 'security/fix-sql-injection-postgres' 2025-10-18 11:45:13 +08:00
yangdx
813f4af9d7 Fix linting 2025-10-18 11:44:48 +08:00
yangdx
012aaada22 Update Swagger API key status description text 2025-10-18 09:40:44 +08:00
Lucky Verma
917e41aa78 Refactor SQL queries and improve input handling in PGKVStorage and PGDocStatusStorage 2025-10-17 15:40:32 -05:00
yangdx
03333d63f3 Merge branch 'main' into limit-vdb-metadata-size 2025-10-17 21:36:06 +08:00
yangdx
6b37d3ca4b Merge branch 'feat-entity-size-caps' into limit-vdb-metadata-size 2025-10-17 21:35:46 +08:00
Daniel.y
8070d0cf32
Merge pull request #2234 from danielaskdd/fix-webui
Refact: Frontend UI Fixes and Performance Improvements
2025-10-17 21:27:45 +08:00
yangdx
7bf9d1e8dc Bump API version to 0241 2025-10-17 21:19:03 +08:00
yangdx
dab1c35834 Optimize chat performance by reducing animations in inactive tabs
• Add isTabActive prop to ChatMessage
• Disable spinner in inactive tabs
• Reduce opacity for inactive content
• Hide loading indicator when inactive
• Pass tab state from RetrievalTesting
2025-10-17 21:17:01 +08:00
yangdx
04d2367147 Fix redoc access problem in front-end dev mode
- Add /redoc endpoint to proxy config
- Remove root path from API endpoints
- Add .env.development to git reopo
- Update sample environment files
- Refine .gitignore patterns for env files
2025-10-17 20:36:15 +08:00
yangdx
4c3ab58473 Improve AsyncSelect layout and text overflow handling
- Add responsive width container
- Improve text truncation with tooltips
2025-10-17 19:10:36 +08:00
yangdx
f555824064 Fix tuple delimiter corruption handling in regex patterns 2025-10-17 18:43:45 +08:00
DivinesLight
17c2a929d2 Get max source Id config from .env and lightRAG init 2025-10-17 14:37:40 +05:00
haseebuchiha
4e740af79b Import from env and use default if none and removed useless import 2025-10-17 14:37:40 +05:00
DivinesLight
7871600d8a Quick fix to limit source_id ballooning while inserting nodes 2025-10-17 14:37:40 +05:00
yangdx
46ac5dac53 Improve API description formatting and add ReDoc link 2025-10-17 16:24:01 +08:00
yangdx
9f49e56a44 Merge branch 'main' into feat-entity-size-caps 2025-10-17 15:59:44 +08:00
yangdx
c0a87ca7a3 Merge branch 'remove-dotenv' 2025-10-17 15:10:11 +08:00
yangdx
1642710fd4 Remove dotenv dependency from project 2025-10-17 15:09:29 +08:00
yangdx
06ed2d06a9 Merge branch 'main' into remove-dotenv 2025-10-17 15:06:34 +08:00
yangdx
c18762e34a Simplify Docker deployment documentation and improve clarity 2025-10-17 15:00:53 +08:00
yangdx
f45dce347a Fix cache control error of index.html
• Retrun no-cache for all HTML responses not just .html files
• Prevent force browser refresh action after front-end rebuild
2025-10-17 12:43:04 +08:00
Won-Kyu Park
532400412e
remove deprecated dotenv package. 2025-10-17 01:34:05 +09:00
yangdx
35cd567c9e Allow related chunks missing in knowledge graph queries 2025-10-17 00:19:30 +08:00
yangdx
0e0b4a94dc Improve Docker build workflow with automated multi-arch script and docs 2025-10-16 23:34:10 +08:00
yangdx
efd50064d1 docs: improve Docker build documentation with clearer notes 2025-10-16 17:17:41 +08:00
yangdx
daeca17f38 Change default docker image to offline version
• Add lite verion docker image with tiktoken cache
• Update docs and build scripts
2025-10-16 16:52:01 +08:00
yangdx
c61b7bd4f8 Remove torch and transformers from offline dependency groups 2025-10-16 15:14:25 +08:00
yangdx
8e3497dcbf Update comments 2025-10-16 14:24:51 +08:00
yangdx
ef6ed429ed Optimize Docker builds with layer caching and add pip for runtime installs
• Split deps and source code layers
• Add --no-editable flag to uv sync
• Install pip for runtime packages
• Improve build cache efficiency
2025-10-16 13:16:22 +08:00
yangdx
8cc8bbf486 Change Docker build cache mode from max to min
• Reduce cache storage usage
• Try to fix GithHub Action failure
2025-10-16 12:24:51 +08:00
yangdx
e6332ce512 Add reminder note to manual Docker build workflow 2025-10-16 11:45:27 +08:00