Commit graph

18 commits

Author SHA1 Message Date
Edwin Jose
b28ec798ba Add multi-model OpenSearch vector store component
Introduces opensearch_multimodel.py, a new component supporting multi-model hybrid search and ingestion in OpenSearch with dynamic vector fields, parallel embedding, and advanced filtering. Refactors embedding generation in opensearch.py to use tenacity-based retry logic and IBM/Watsonx rate limiting. Updates related flow JSONs to integrate the new component.
2025-12-05 18:01:04 -05:00
phact
a109e76bd8 update other flows w/ latest opensearch component 2025-12-03 19:30:49 -05:00
Lucas Oliveira
cebb38eb04
fix: make backend reset langflow flows after upgrade, backup flows every 5 mins (#483)
* Changed backend to mount config at volume

* update lock

* Changed backend to reapply settings after detecting that flow is reset

* Added periodic backup for flows, make better reset

* tui warning

* Changed settings page to alert user that he has to disable lock flow

* Changed flows to be locked

* Do periodic backup only if onboarding is done

* Change backup function to only back up flows if flow lock is disabled

* Added session manager to reapply all settings

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-26 22:53:33 -03:00
Edwin Jose
998d8b9195 Add fail-safe mode to embedding and OpenSearch components
Introduces a 'fail_safe_mode' option to the Embedding Model and OpenSearch (Multi-Model Multi-Embedding) components, allowing errors to be logged and None returned instead of raising exceptions. Refactors embedding model fetching logic for better error handling and updates component metadata, field order, and dependencies. Also adds 'className' fields and updates frontend node folder IDs for improved UI consistency.
2025-11-26 01:15:30 -05:00
Edwin Jose
0c191edaaf Switch ingestion flow to multimodal OpenSearch component
Replaces OpenSearchHybrid with OpenSearchVectorStoreComponentMultimodalMultiEmbedding in ingestion_flow.json, updating all relevant edges and embedding connections. Updates docker-compose.yml to use local builds for backend, frontend, and langflow, and improves environment variable handling for API keys. This refactor enables multi-model and multimodal embedding support for document ingestion and search.
2025-11-25 19:09:21 -05:00
Edwin Jose
71b67f418d Enhance embedding model component and Docker builds
Switches Docker Compose services to local builds for backend, frontend, and langflow. Updates embedding model component to support IBM watsonx.ai features, including input token truncation and original text output, adds new dependencies, and improves configuration options in ingestion and agent flows.
2025-11-24 16:40:36 -05:00
Lucas Oliveira
37faf94979
feat: adds anthropic provider, splits onboarding editing into two, support provider changing with generic llm and embedding components (#373)
* Added flows with new components

* commented model provider assignment

* Added agent component display name

* commented provider assignment, assign provider on the generic component, assign custom values

* fixed ollama not showing loading steps, fixed loading steps never being removed

* made embedding and llm model optional on onboarding call

* added isEmbedding handling on useModelSelection

* added isEmbedding on onboarding card, separating embedding from non embedding card

* Added one additional step to configure embeddings

* Added embedding provider config

* Changed settings.py to return if not embedding

* Added editing fields to onboarding

* updated onboarding and flows_service to change embedding and llm separately

* updated templates that needs to be changed with provider values

* updated flows with new components

* Changed config manager to not have default models

* Changed flows_service settings

* Complete steps if not embedding

* Add more onboarding steps

* Removed one step from llm steps

* Added Anthropic as a model for the language model on the frontend

* Added anthropic models

* Added anthropic support on Backend

* Fixed provider health and validation

* Format settings

* Change anthropic logo

* Changed button to not jump

* Changed flows service to make anthropic work

* Fixed some things

* add embedding specific global variables

* updated flows

* fixed ingestion flow

* Implemented anthropic on settings page

* add embedding provider logo

* updated backend to work with multiple provider config

* update useUpdateSettings with new settings type

* updated provider health banner to check for health with new api

* changed queries and mutations to use new api

* changed embedding model input to work with new api

* Implemented provider based config on the frontend

* update existing design

* fixed settings configured

* fixed provider health query to include health check for both the providers

* Changed model-providers to show correctly the configured providers

* Updated prompt

* updated openrag agent

* Fixed settings to allow editing providers and changing llm and embedding models

* updated settings

* changed lf ver

* bump openrag version

* added more steps

* update settings to create the global variables

* updated steps

* updated default prompt

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-11 19:22:16 -03:00
phact
5b32a0ce12 fix: embedding handling for query vectors 2025-10-13 10:51:50 -04:00
phact
a7c5a9f8f3 fis: keyword type field name for search 2025-10-11 02:10:01 -04:00
phact
a424bb422a improve embedding generation timeout hadling w/ retry and error handling 2025-10-11 01:06:14 -04:00
phact
aff70096ce .keyword fix 2025-10-11 00:48:09 -04:00
phact
88d73625b5 flows 2025-10-11 00:03:58 -04:00
phact
af741f3784 other flows 2025-10-10 22:46:36 -04:00
Edwin Jose
42a198f96a Add CONNECTOR_TYPE_URL env and flow support
Introduces the CONNECTOR_TYPE_URL environment variable to docker-compose files and assets, updates the OpenRAG URL ingestion flow to use it, and ensures it is set in the auth service global variables. This enables explicit configuration and handling of URL-based connectors in the OpenRAG system.
2025-10-06 16:24:15 -04:00
Lucas Oliveira
fe708e4fd6 made openrag url mcp be mcp enabled 2025-10-03 17:50:46 -03:00
Lucas Oliveira
9d6827f9e3 updated openrag json 2025-10-03 17:40:53 -03:00
Edwin Jose
30f63a76b6 add mcp Flows 2025-10-03 11:02:45 -04:00
Edwin Jose
d5a70bc575 Add OpenRAG OpenSearch flow and update .gitignore
Added a new flow definition for OpenRAG with OpenSearch hybrid search in flows/openrag_url_mcp.json. Updated .gitignore to allow tracked JSON files in the flows directory while ignoring others.
2025-10-02 15:05:55 -04:00