Commit graph

42 commits

Author SHA1 Message Date
yangdx
7404f76d8c Optimize chat performance by reducing animations in inactive tabs
• Add isTabActive prop to ChatMessage
• Disable spinner in inactive tabs
• Reduce opacity for inactive content
• Hide loading indicator when inactive
• Pass tab state from RetrievalTesting

(cherry picked from commit dab1c35834)
2025-12-04 19:11:08 +08:00
Raphael MANSUY
fe9b8ec02a
tests: stabilize integration tests + skip external services; fix multi-tenant API behavior and idempotency (#4)
* feat: Implement multi-tenant architecture with tenant and knowledge base models

- Added data models for tenants, knowledge bases, and related configurations.
- Introduced role and permission management for users in the multi-tenant system.
- Created a service layer for managing tenants and knowledge bases, including CRUD operations.
- Developed a tenant-aware instance manager for LightRAG with caching and isolation features.
- Added a migration script to transition existing workspace-based deployments to the new multi-tenant architecture.

* chore: ignore lightrag/api/webui/assets/ directory

* chore: stop tracking lightrag/api/webui/assets (ignore in .gitignore)

* feat: Initialize LightRAG Multi-Tenant Stack with PostgreSQL

- Added README.md for project overview, setup instructions, and architecture details.
- Created docker-compose.yml to define services: PostgreSQL, Redis, LightRAG API, and Web UI.
- Introduced env.example for environment variable configuration.
- Implemented init-postgres.sql for PostgreSQL schema initialization with multi-tenant support.
- Added reproduce_issue.py for testing default tenant access via API.

* feat: Enhance TenantSelector and update related components for improved multi-tenant support

* feat: Enhance testing capabilities and update documentation

- Updated Makefile to include new test commands for various modes (compatibility, isolation, multi-tenant, security, coverage, and dry-run).
- Modified API health check endpoint in Makefile to reflect new port configuration.
- Updated QUICK_START.md and README.md to reflect changes in service URLs and ports.
- Added environment variables for testing modes in env.example.
- Introduced run_all_tests.sh script to automate testing across different modes.
- Created conftest.py for pytest configuration, including database fixtures and mock services.
- Implemented database helper functions for streamlined database operations in tests.
- Added test collection hooks to skip tests based on the current MULTITENANT_MODE.

* feat: Implement multi-tenant support with demo mode enabled by default

- Added multi-tenant configuration to the environment and Docker setup.
- Created pre-configured demo tenants (acme-corp and techstart) for testing.
- Updated API endpoints to support tenant-specific data access.
- Enhanced Makefile commands for better service management and database operations.
- Introduced user-tenant membership system with role-based access control.
- Added comprehensive documentation for multi-tenant setup and usage.
- Fixed issues with document visibility in multi-tenant environments.
- Implemented necessary database migrations for user memberships and legacy support.

* feat(audit): Add final audit report for multi-tenant implementation

- Documented overall assessment, architecture overview, test results, security findings, and recommendations.
- Included detailed findings on critical security issues and architectural concerns.

fix(security): Implement security fixes based on audit findings

- Removed global RAG fallback and enforced strict tenant context.
- Configured super-admin access and required user authentication for tenant access.
- Cleared localStorage on logout and improved error handling in WebUI.

chore(logs): Create task logs for audit and security fixes implementation

- Documented actions, decisions, and next steps for both audit and security fixes.
- Summarized test results and remaining recommendations.

chore(scripts): Enhance development stack management scripts

- Added scripts for cleaning, starting, and stopping the development stack.
- Improved output messages and ensured graceful shutdown of services.

feat(starter): Initialize PostgreSQL with AGE extension support

- Created initialization scripts for PostgreSQL extensions including uuid-ossp, vector, and AGE.
- Ensured successful installation and verification of extensions.

* feat: Implement auto-select for first tenant and KB on initial load in WebUI

- Removed WEBUI_INITIAL_STATE_FIX.md as the issue is resolved.
- Added useTenantInitialization hook to automatically select the first available tenant and KB on app load.
- Integrated the new hook into the Root component of the WebUI.
- Updated RetrievalTesting component to ensure a KB is selected before allowing user interaction.
- Created end-to-end tests for multi-tenant isolation and real service interactions.
- Added scripts for starting, stopping, and cleaning the development stack.
- Enhanced API and tenant routes to support tenant-specific pipeline status initialization.
- Updated constants for backend URL to reflect the correct port.
- Improved error handling and logging in various components.

* feat: Add multi-tenant support with enhanced E2E testing scripts and client functionality

* update client

* Add integration and unit tests for multi-tenant API, models, security, and storage

- Implement integration tests for tenant and knowledge base management endpoints in `test_tenant_api_routes.py`.
- Create unit tests for tenant isolation, model validation, and role permissions in `test_tenant_models.py`.
- Add security tests to enforce role-based permissions and context validation in `test_tenant_security.py`.
- Develop tests for tenant-aware storage operations and context isolation in `test_tenant_storage_phase3.py`.

* feat(e2e): Implement OpenAI model support and database reset functionality

* Add comprehensive test suite for gpt-5-nano compatibility

- Introduced tests for parameter normalization, embeddings, and entity extraction.
- Implemented direct API testing for gpt-5-nano.
- Validated .env configuration loading and OpenAI API connectivity.
- Analyzed reasoning token overhead with various token limits.
- Documented test procedures and expected outcomes in README files.
- Ensured all tests pass for production readiness.

* kg(postgres_impl): ensure AGE extension is loaded in session and configure graph initialization

* dev: add hybrid dev helper scripts, Makefile, docker-compose.dev-db and local development docs

* feat(dev): add dev helper scripts and local development documentation for hybrid setup

* feat(multi-tenant): add detailed specifications and logs for multi-tenant improvements, including UX, backend handling, and ingestion pipeline

* feat(migration): add generated tenant/kb columns, indexes, triggers; drop unused tables; update schema and docs

* test(backward-compat): adapt tests to new StorageNameSpace/TenantService APIs (use concrete dummy storages)

* chore: multi-tenant and UX updates — docs, webui, storage, tenant service adjustments

* tests: stabilize integration tests + skip external services; fix multi-tenant API behavior and idempotency

- gpt5_nano_compatibility: add pytest-asyncio markers, skip when OPENAI key missing, prevent module-level asyncio.run collection, add conftest
- Ollama tests: add server availability check and skip markers; avoid pytest collection warnings by renaming helper classes
- Graph storage tests: rename interactive test functions to avoid pytest collection
- Document & Tenant routes: support external_ids for idempotency; ensure HTTPExceptions are re-raised
- LightRAG core: support external_ids in apipeline_enqueue_documents and idempotent logic
- Tests updated to match API changes (tenant routes & document routes)
- Add logs and scripts for inspection and audit
2025-12-04 16:04:21 +08:00
yangdx
b6a1832324 feat: prevent LaTeX parsing errors during streaming by implementing completeness detection
- Add latexRendered flag to control KaTeX plugin application
- Implement detectLatexCompleteness function to check formula closure
- Maintain backward compatibility for historical messages
2025-09-28 20:59:56 +08:00
yangdx
16e574a083 Fix query mode prefix regex to handle multiline queries in WebUI
- Allow newlines in query text
- Change `.+` to `[\s\S]+` in regex
- Support multiline input parsing
- Fix prefix matching edge case
2025-09-28 14:56:05 +08:00
yangdx
71367c7bc2 Add user prompt history dropdown to query settings
- Create UserPromptInputWithHistory component
- Move user prompt field to top of panel
- Add history tracking to settings store
- Include keyboard navigation support
- Auto-save prompts on query execution
2025-09-25 06:16:32 +08:00
yangdx
c358f83d2d Implement robust clipboard functionality with multiple fallback strategies
• Add comprehensive clipboard utility
• Support legacy browser environments
• Provide detailed user feedback
• Handle security context failures
2025-09-24 23:12:16 +08:00
yangdx
3d7635e097 refactor: addinging copy buttons beside each message 2025-09-24 20:43:22 +08:00
yangdx
5b0ad167d6 feat: Force sending history messages in bypass mode
• Force history turns to 3 for bypass mode if current setting is 0
• Add this feature allowing the LLM to generate output based on conversation history.
2025-09-22 15:09:34 +08:00
yangdx
40c8f1ef7b feat: add smart input switching between Input and Textarea components
• Switch to Textarea for multi-line input
• Handle Shift+Enter for newlines
• Maintain focus during component switch
• Support multi-line paste operations
• Auto-adjust textarea height dynamically
2025-09-22 13:00:22 +08:00
yangdx
d2029fd804 Replace Input with auto-resizing Textarea in RetrievalTesting
• Add new Textarea component
• Auto-resize between 40px-120px height
• Support Enter to submit, Shift+Enter for newline
• Add form autocomplete attributes
• Reset height after message submission
2025-09-22 02:01:39 +08:00
yangdx
9288ae1703 Refactor COT parsing to handle multiple think blocks robustly 2025-09-22 01:01:39 +08:00
yangdx
62aa0726a5 Fix conversation history handling when history_turns is 0
• Check history_turns > 0 before filtering
• Prevent sending all history converstion to backend when history_turns is 0
2025-09-21 23:51:19 +08:00
yangdx
8ad7109313 Fix linting 2025-09-08 20:11:21 +08:00
yangdx
4346846e5a Fix thinking content extraction to prevent duplication and overwriting
- Add thinkingProcessed ref to track state
- Extract thinking content only once
- Preserve real-time thinking updates
- Reset processed flag on new queries
- Always update display content stream
2025-09-08 19:34:05 +08:00
yangdx
eeff0d5c67 Fix thinking state management and UI improvements for chat messages
- Reset expansion state on new thinking
- Prevent content leakage during thinking
- Update thinkingTime type to allow null
- Add memory leak prevention cleanup
- Add missing i18n translations
2025-09-08 18:47:41 +08:00
yangdx
2ba10dbb5b Add AI thinking process display with expandable UI and timing
- Add thinking fields to Message type
- Create expandable thinking section
- Track thinking time during streaming
2025-09-08 18:09:04 +08:00
yangdx
4f523366aa Fix browse compatible problem for crypto.randomUUID 2025-04-29 02:37:05 +08:00
yangdx
4e2e668def Bump webui setting version to 12 2025-04-29 02:36:17 +08:00
yangdx
9792841a07 Stablize mermaid render in history messages 2025-04-26 12:30:29 +08:00
yangdx
e0d99d3c29 Postpond mermaid rendering untill streaming streaming respond stopped. 2025-04-26 10:16:13 +08:00
yangdx
1cbcb2a150 Optimize scrolling login of query view 2025-04-23 21:54:21 +08:00
yangdx
e97e54b7a5 Feat: support query mode prefix in retrieval input 2025-04-23 01:26:34 +08:00
yangdx
6f064925eb Simplified scroll to bottom logic 2025-04-23 00:38:35 +08:00
yangdx
5bfa2e7dc6 Improve scrolling logic 2025-04-22 22:15:42 +08:00
yangdx
f53115aaa1 Fix scrolling to bottom problem 2025-04-22 21:25:15 +08:00
yangdx
1b63149a11 Fix linting 2025-04-22 18:34:30 +08:00
yangdx
6c556cd65f Improve scrollToBottom logic 2025-04-22 18:05:08 +08:00
yangdx
6125116355 Fix useCallback Hook 2025-04-22 16:56:48 +08:00
yangdx
2b51ea7480 Merge branch 'fix-history-turns' 2025-04-11 00:45:37 +08:00
choizhang
10513d7ca5 fix(RetrievalTesting): auto scrollToBottom 2025-04-11 00:31:14 +08:00
choizhang
6009c25886 fix(RetrievalTesting): Limit the length of conversation history records 2025-04-10 17:02:28 +08:00
yangdx
46ffb6afa4 fix: improve form accessibility with proper label associations
Added missing htmlFor attributes to labels and corresponding IDs to form elements throughout the web UI to enhance accessibility. This ensures screen readers can correctly identify form controls and improves browser autofill functionality. Changes include:

- Fixed label associations in login form
- Added proper IDs to form elements in Settings component
- Replaced decorative labels with semantic headings in PropertiesView
- Added screen reader accessible labels in RetrievalTesting
- Improved checkbox accessibility in QuerySettings
2025-04-07 05:20:12 +08:00
yangdx
2753cbed97 Fix overflow issues in UI components
- Set overflow-hidden for main container
- Add overflow-auto to documents tab
- Add overflow-hidden to graph and retrieval tabs
- Set overflow-hidden for SigmaContainer
- Set overflow-hidden for retrieval testing container
2025-03-17 05:00:37 +08:00
zrguo
2ffd7f9111 fix linting 2025-03-11 21:13:50 +08:00
baoheping
59a2202e7c Added Minimum Degree 2025-03-08 11:01:10 +00:00
ArnoChen
e2b4e661e3 feat: retrieval message code highlight, message copy button 2025-02-24 18:17:17 +08:00
ArnoChen
eaf1e92e76 render chat message as markdown 2025-02-18 00:42:31 +08:00
ArnoChen
e083ebb95a improve streaming error handling 2025-02-18 00:30:51 +08:00
ArnoChen
cf7c45b5dd format 2025-02-17 01:05:48 +08:00
ArnoChen
e5b89c5400 fix retrieval testing and query settings 2025-02-16 21:58:30 +08:00
ArnoChen
fc3ca2777f add query settings 2025-02-16 21:43:14 +08:00
ArnoChen
d1358c30f3 enhance web UI with retrieval testing and UI improvements 2025-02-16 04:34:22 +08:00