Commit graph

5260 commits

Author SHA1 Message Date
yangdx
fbcc35bba6 Merge branch 'hotfix-postgres' 2025-10-11 13:45:58 +08:00
yangdx
289337b2c8 Bump API version to 0237 2025-10-11 13:45:29 +08:00
Daniel.y
766f27da36
Merge pull request #2193 from kevinnkansah/main
Update Web Dependencies
2025-10-11 13:41:12 +08:00
Daniel.y
82397834e7
Merge pull request #2195 from danielaskdd/hotfix-postgres
Hotfix: Preserve ordering in get_by_ids methods across all storage implementations
2025-10-11 13:39:31 +08:00
yangdx
e1e4f1b02c Fix get_by_ids to return None for missing records consistently 2025-10-11 13:34:26 +08:00
yangdx
b7216ede58 Fix linting 2025-10-11 13:27:31 +08:00
yangdx
49197fbfc0 Update pymilvus to >=2.6.2 and add protobuf compatibility constraint 2025-10-11 13:27:10 +08:00
yangdx
7cddd56461 Revert core version to 1.4.9..2 2025-10-11 13:06:58 +08:00
yangdx
9be22dd666 Preserve ordering in get_by_ids methods across all storage implementations
- Fix result ordering in vector stores
- Update KV storage get_by_ids methods
- Maintain order in doc status storage
- Return None for missing IDs
2025-10-11 12:37:59 +08:00
Daniel.y
49326f2b14
Merge pull request #2194 from danielaskdd/offline
Feat: Add Comprehensive Offline Deployment Solution
2025-10-11 10:36:01 +08:00
yangdx
a5c05f1b92 Add offline deployment support with cache management and layered deps
• Add tiktoken cache downloader CLI
• Add layered offline dependencies
• Add offline requirements files
• Add offline deployment guide
2025-10-11 10:28:14 +08:00
kevinnkansah
b81b86203c chore: update deps 2025-10-10 17:12:59 +02:00
yangdx
fea10cd03f Merge branch 'chart-enchancment' 2025-10-10 15:35:52 +08:00
yangdx
648d7bb175 Refactor Helm template to handle optional envFrom values safely
• Add null checks for envFrom fields
• Support both secrets and configmaps
• Build envFrom list dynamically
• Only render envFrom when entries exist
• Fix template indentation issues
2025-10-10 15:31:35 +08:00
yangdx
8d3b53ce22 Condensed AGENTS.md to focus on essential development guidelines 2025-10-10 14:10:23 +08:00
yangdx
12facac506 Enhance graph API endpoints with detailed docs and field validation
- Remove redundant README section
- Add Pydantic field validation
- Expand endpoint docstrings
- Include request/response examples
- Document merge operation benefits
2025-10-10 12:49:00 +08:00
yangdx
85d1a563b3 Merge branch 'adminunblinded/main' 2025-10-10 12:31:47 +08:00
yangdx
1bf802eebf Add AGENTS.md documentation section for AI coding agent guidance 2025-10-10 12:21:35 +08:00
yangdx
d0ae7a67a0 Fix typos and grammar in env.example configuration comments 2025-10-10 11:56:19 +08:00
yangdx
6e39c0c0ff Rename Agments.md to AGENTS.md and standardize formatting 2025-10-10 11:53:52 +08:00
NeelM0906
b7c77396a0 Fix entity/relation creation endpoints to properly update vector stores
- Changed create_entity to use rag.acreate_entity() instead of direct graph manipulation
  - Changed create_relation to use rag.acreate_relation() instead of direct graph manipulation
  - This ensures vector embeddings are created and entities/relations are searchable
  - Adds proper concurrency locks and metadata population
2025-10-09 17:02:17 -04:00
NeelM0906
f6d1fb98ac Fix Linting errors 2025-10-09 16:52:22 -04:00
Daniel.y
b4d61eb8f5
Merge pull request #2192 from danielaskdd/postgres-network-retry
## Refactor: Add PostgreSQL Connection Retry Mechanism with Network Robustness
2025-10-10 03:52:21 +08:00
yangdx
b3ed264707 Refactor PostgreSQL retry config to use centralized configuration
• Move retry config to ClientManager
• Remove env var parsing from PostgreSQLDB
• Add config params to test setup
2025-10-10 03:44:13 +08:00
yangdx
bd535e3e7a Add PostgreSQL connection retry configuration options
- Add retry environment variables
- Fix asyncpg import in retry tests
2025-10-10 03:06:21 +08:00
yangdx
e758204ab2 Add PostgreSQL connection retry mechanism with comprehensive error handling
• Implement connection retry with backoff
• Add transient error detection
• Pool management with timeout guards
2025-10-10 03:06:01 +08:00
yangdx
577b9e6882 Add project intelligence files for AI agent collaboration
- Add .clinerules with technical patterns
- Create Agments.md for Codex agent guidance
- Ensures consistent behavior across all team members
2025-10-09 16:35:38 +08:00
Daniel.y
0f15fdc3e2
Merge pull request #2181 from yrangana/feat/openai-embedding-token-tracking
feat: Add token tracking support to openai_embed function
2025-10-09 12:15:29 +08:00
Yasiru Rangana
ae9f4ae73f fix: Remove trailing whitespace for pre-commit linting 2025-10-09 15:01:53 +11:00
NeelM0906
9f44e89de7 Add knowledge graph manipulation endpoints
Added three new REST API endpoints for direct knowledge graph manipulation:

- POST /graph/entity/create: Create new entities in the knowledge graph
- POST /graph/relation/create: Create relationships between entities
- POST /graph/entities/merge: Merge duplicate/misspelled entities while preserving relationships

The merge endpoint is particularly useful for consolidating entities discovered after document processing, fixing spelling errors, and cleaning up the knowledge graph. All relationships from source entities are transferred to the target entity, with intelligent handling of duplicate relationships.

Updated API documentation in lightrag/api/README.md with usage examples for all three endpoints.
2025-10-08 15:59:47 -04:00
Yasiru Rangana
ec40b17eea feat: Add token tracking support to openai_embed function
- Add optional token_tracker parameter to openai_embed()
- Track prompt_tokens and total_tokens for embedding API calls
- Enables monitoring of embedding token usage alongside LLM calls
- Maintains backward compatibility with existing code
2025-10-08 14:36:08 +11:00
yangdx
f1e0110716 Merge branch 'kevinnkansah/main' 2025-10-07 23:04:59 +08:00
yangdx
f2c0b41e78 Make PostgreSQL statement_cache_size configuration optional
• Remove forced int conversion
• Allow None values for cache size
• Add conditional parameter setting
2025-10-07 22:57:21 +08:00
Daniel.y
ea5e390bb4
Merge pull request #2178 from aleksvujic/patch-1
Fixed typo in log message when creating new graph file
2025-10-07 21:54:02 +08:00
Aleks Vujić
dd8f44e621
Fixed typo in log message when creating new graph file 2025-10-07 14:30:05 +02:00
Tomek Cyran
119d2fa171 Adding support for imagePullSecrets, envFrom, and deployment strategy in Helm chart 2025-10-06 16:25:50 +02:00
kevinnkansah
fdcb034da0 chore: distinguish settings 2025-10-06 12:01:40 +02:00
kevinnkansah
22a7b482c5 fix: renamed PostGreSQL options env variable and allowed LRU cache to be an optional env variable 2025-10-06 11:56:09 +02:00
kevinnkansah
d8a9617c0e fix: fix: asyncpg bouncer connection pool error
Prepared statement caching is disabled by setting
`statement_cache_size=0` in the `asyncpg` connection pool parameters.
This is necessary to prevent
`asyncpg.exceptions.InvalidSQLStatementNameError` when using
transaction-level connection poolers like Supabase Supavisor or
pgbouncer, which do not support prepared statements.
2025-10-06 00:36:25 +02:00
kevinnkansah
108cdbe133 feat: add options for PostGres connection 2025-10-05 23:29:04 +02:00
yangdx
6190fa8985 Fix linting 2025-10-06 04:57:11 +08:00
yangdx
91387628ff Add test script for aquery_data endpoint validation 2025-10-06 03:59:50 +08:00
yangdx
4fe41f76f2 Merge branch 'doc-name-in-full-docs' 2025-10-05 14:03:02 +08:00
yangdx
d473f635d8 Update webui assets 2025-10-05 14:02:18 +08:00
yangdx
a31192dd5a Update i18n file for pipeline UI text across locales 2025-10-05 14:01:22 +08:00
yangdx
aac787bafb Clarify chunk tracking log message in _build_llm_context 2025-10-05 13:33:55 +08:00
Daniel.y
1b274706d8
Merge pull request #2171 from danielaskdd/doc-name-in-full-docs
Fix: Add file_path field to full_docs storage
2025-10-05 13:03:14 +08:00
yangdx
457d51952e Add doc_name field to full docs storage
- Store file_path in full_docs storage
- Update PostgreSQL implementation by map file_path to doc_name
- Other storage implementation automatically handles the new field
2025-10-05 11:44:27 +08:00
yangdx
d550f1c58c Fix linting 2025-10-05 10:42:15 +08:00
yangdx
1574fec7f0 Update webui assets 2025-10-05 10:41:46 +08:00