Commit graph

80 commits

Author SHA1 Message Date
Edwin Jose
998d8b9195 Add fail-safe mode to embedding and OpenSearch components
Introduces a 'fail_safe_mode' option to the Embedding Model and OpenSearch (Multi-Model Multi-Embedding) components, allowing errors to be logged and None returned instead of raising exceptions. Refactors embedding model fetching logic for better error handling and updates component metadata, field order, and dependencies. Also adds 'className' fields and updates frontend node folder IDs for improved UI consistency.
2025-11-26 01:15:30 -05:00
Edwin Jose
2fa6efeaa9 update flows 2025-11-26 00:43:40 -05:00
Edwin Jose
d3a66c82b9 Add fail-safe mode to Embedding Model component
Introduces a 'fail_safe_mode' option to the Embedding Model component, allowing errors to be logged and None returned instead of raising exceptions. Refactors embedding initialization logic for OpenAI, Ollama, and IBM watsonx.ai providers to support this mode, and updates UI configuration and metadata accordingly.
2025-11-25 23:09:58 -05:00
Edwin Jose
0c191edaaf Switch ingestion flow to multimodal OpenSearch component
Replaces OpenSearchHybrid with OpenSearchVectorStoreComponentMultimodalMultiEmbedding in ingestion_flow.json, updating all relevant edges and embedding connections. Updates docker-compose.yml to use local builds for backend, frontend, and langflow, and improves environment variable handling for API keys. This refactor enables multi-model and multimodal embedding support for document ingestion and search.
2025-11-25 19:09:21 -05:00
Edwin Jose
71b67f418d Enhance embedding model component and Docker builds
Switches Docker Compose services to local builds for backend, frontend, and langflow. Updates embedding model component to support IBM watsonx.ai features, including input token truncation and original text output, adds new dependencies, and improves configuration options in ingestion and agent flows.
2025-11-24 16:40:36 -05:00
Cole Goldsmith
f6e6aa43a2
Feat/provider improvements (#422)
* remove connection dot indicators on settings page, better toast message for provider setup dialogs, fix typo in default agent prompt

* format

* open llm model select when toast button to settings is clicked
2025-11-19 15:20:27 -06:00
Lucas Oliveira
e9d2e05319 updated flows removing ollama base url global variable 2025-11-19 16:18:49 -03:00
Lucas Oliveira
37faf94979
feat: adds anthropic provider, splits onboarding editing into two, support provider changing with generic llm and embedding components (#373)
* Added flows with new components

* commented model provider assignment

* Added agent component display name

* commented provider assignment, assign provider on the generic component, assign custom values

* fixed ollama not showing loading steps, fixed loading steps never being removed

* made embedding and llm model optional on onboarding call

* added isEmbedding handling on useModelSelection

* added isEmbedding on onboarding card, separating embedding from non embedding card

* Added one additional step to configure embeddings

* Added embedding provider config

* Changed settings.py to return if not embedding

* Added editing fields to onboarding

* updated onboarding and flows_service to change embedding and llm separately

* updated templates that needs to be changed with provider values

* updated flows with new components

* Changed config manager to not have default models

* Changed flows_service settings

* Complete steps if not embedding

* Add more onboarding steps

* Removed one step from llm steps

* Added Anthropic as a model for the language model on the frontend

* Added anthropic models

* Added anthropic support on Backend

* Fixed provider health and validation

* Format settings

* Change anthropic logo

* Changed button to not jump

* Changed flows service to make anthropic work

* Fixed some things

* add embedding specific global variables

* updated flows

* fixed ingestion flow

* Implemented anthropic on settings page

* add embedding provider logo

* updated backend to work with multiple provider config

* update useUpdateSettings with new settings type

* updated provider health banner to check for health with new api

* changed queries and mutations to use new api

* changed embedding model input to work with new api

* Implemented provider based config on the frontend

* update existing design

* fixed settings configured

* fixed provider health query to include health check for both the providers

* Changed model-providers to show correctly the configured providers

* Updated prompt

* updated openrag agent

* Fixed settings to allow editing providers and changing llm and embedding models

* updated settings

* changed lf ver

* bump openrag version

* added more steps

* update settings to create the global variables

* updated steps

* updated default prompt

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-11 19:22:16 -03:00
Lucas Oliveira
a5d25e0c0b
fix: disable upload message when ingesting on onboarding, wait for file to be ingested, added knowledge filters on nudges (#345)
* Removed upload start message

* Made onboarding upload refetch nudges and only finish when document is ingested

* Implemented query filters on nudges

* changed get to post

* Implemented filtering for documents that are not sample data on nudges

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-11 18:20:39 -03:00
Lucas Oliveira
b9ea9c99f1
fix: fixed bugs on ollama integration, added ingestion on onboarding (#330)
* Updated ollama components

* Changed ollama display name to be correct

* Changed prompt of provider validation

* removed event dispatched from file upload

* Changed onboarding to upload the entire knowledge

* Changed default models for ollama
2025-10-30 09:02:06 -03:00
phact
86e075882d nuke extra flow 2025-10-24 14:27:29 -04:00
Mendon Kissling
ff344b88b6
Merge branch 'main' into add-notes-to-flows 2025-10-24 11:02:04 -04:00
Mendon Kissling
0088c78363
Merge branch 'main' into add-notes-to-flows 2025-10-24 10:33:06 -04:00
Lucas Oliveira
fcf7a302d0
feat: adds what is openrag prompt, refactors chat design, adds scroll to bottom on chat, adds streaming support (#283)
* Changed prompts to include info about OpenRAG, change status of As Dataframe and As Vector Store to false on OpenSearch component

* added markdown to onboarding step

* added className to markdown renderer

* changed onboarding step to not render span

* Added nudges to onboarding content

* Added onboarding style for nudges

* updated user message and assistant message designs

* updated route.ts to handle streaming messages

* created new useChatStreaming to handle streaming

* changed useChatStreaming to work with the chat page

* changed onboarding content to use default messages instead of onboarding steps, and to use the new hook to send messages

* added span to the markdown renderer on stream

* updated page to use new chat streaming hook

* disable animation on completed steps

* changed markdown renderer margins

* changed css to not display markdown links and texts on white always

* added isCompleted to assistant and user messages

* removed space between elements on onboarding step to ensure smoother animation

* removed opacity 50 on onboarding messages

* changed default api to be langflow on chat streaming

* added fade in and color transition

* added color transition

* Rendered onboarding with use-stick-to-bottom

* Added use stick to bottom on page

* fixed nudges design

* changed chat input design

* fixed nudges design

* made overflow be hidden on main

* Added overflow y auto on other pages

* Put animate on messages

* Add source to types

* Adds animate and delay props to messages
2025-10-22 14:03:23 -03:00
Mike Fortman
ea5ed8540d add button scale and fix agent flow name 2025-10-15 14:47:21 -05:00
phact
5b32a0ce12 fix: embedding handling for query vectors 2025-10-13 10:51:50 -04:00
phact
a7c5a9f8f3 fis: keyword type field name for search 2025-10-11 02:10:01 -04:00
phact
a424bb422a improve embedding generation timeout hadling w/ retry and error handling 2025-10-11 01:06:14 -04:00
phact
aff70096ce .keyword fix 2025-10-11 00:48:09 -04:00
phact
88d73625b5 flows 2025-10-11 00:03:58 -04:00
phact
af741f3784 other flows 2025-10-10 22:46:36 -04:00
phact
12ae6d3fb1 ingest flow works multi-embedding 2025-10-10 22:14:51 -04:00
Mendon Kissling
36f4d08ade position 2025-10-09 14:51:52 -04:00
Mendon Kissling
e8a425702e ingestion-flow 2025-10-09 14:39:07 -04:00
Mendon Kissling
07cf0c93d0 diff 2025-10-09 13:44:35 -04:00
Mendon Kissling
dcd0f8e29f add-note-to-openrag-agent 2025-10-09 13:40:52 -04:00
Edwin Jose
2f9ebcc507 Merge branch 'main' into add-mcp-agent-flows 2025-10-06 17:29:06 -04:00
Edwin Jose
42a198f96a Add CONNECTOR_TYPE_URL env and flow support
Introduces the CONNECTOR_TYPE_URL environment variable to docker-compose files and assets, updates the OpenRAG URL ingestion flow to use it, and ensures it is set in the auth service global variables. This enables explicit configuration and handling of URL-based connectors in the OpenRAG system.
2025-10-06 16:24:15 -04:00
Edwin Jose
55203d9c69 Update openrag_agent.json 2025-10-06 12:07:17 -04:00
Mike Fortman
da66d2e613 Merge branch 'main' of github.com:langflow-ai/openrag into docling-req 2025-10-06 09:49:04 -05:00
Edwin Jose
336e7bb501 Integrate OpenSearch hybrid search and update ingestion flow
Replaces the File component with a new OpenSearch hybrid search component in the ingestion flow, adds support for document metadata, and updates flow edges for DataFrame operations. Updates OpenSearch component implementation with advanced authentication, metadata handling, and vector store features. Docker Compose files and related service references are also updated to support the new OpenSearch integration.
2025-10-04 02:09:29 -04:00
Lucas Oliveira
9284000859 updated json 2025-10-03 17:55:13 -03:00
Lucas Oliveira
fe708e4fd6 made openrag url mcp be mcp enabled 2025-10-03 17:50:46 -03:00
Lucas Oliveira
9d6827f9e3 updated openrag json 2025-10-03 17:40:53 -03:00
Mike Fortman
b93faa26b0 fix flow names and descriptions from "Open Search" to "OpenSearch" 2025-10-03 15:38:18 -05:00
Edwin Jose
aa1ad5c50f Update openrag_agent.json 2025-10-03 11:09:17 -04:00
Edwin Jose
30f63a76b6 add mcp Flows 2025-10-03 11:02:45 -04:00
Edwin Jose
b6966ade48 Update openrag_agent.json 2025-10-02 16:12:43 -04:00
Edwin Jose
d5a70bc575 Add OpenRAG OpenSearch flow and update .gitignore
Added a new flow definition for OpenRAG with OpenSearch hybrid search in flows/openrag_url_mcp.json. Updated .gitignore to allow tracked JSON files in the flows directory while ignoring others.
2025-10-02 15:05:55 -04:00
Edwin Jose
634f98b293 Update agent flow and Dockerfile branch for OpenAI tests
Changed Dockerfile.langflow to use the 'test-openai-responses' branch. Improved file handling in ChatInput, updated ChatOutput to fix source property unpacking, and made AgentComponent use LCToolsAgentComponent._base_inputs. Also updated code hashes, dependency versions, and metadata timestamps in openrag_agent.json.
2025-10-02 14:08:14 -04:00
Lucas Oliveira
6d905f62ed Fixed nudges 2025-10-01 17:18:45 -03:00
Lucas Oliveira
65bf20a1e4 Fixed components: added load from db and removed Flow encapsulation 2025-09-29 16:42:36 -03:00
Edwin Jose
6c628dceb3 Update to components and flows 2025-09-29 14:53:47 -04:00
Edwin Jose
b51efd0d5e
Merge branch 'main' into lfx-openrag-update-flows 2025-09-26 12:16:02 -05:00
Edwin Jose
960dac34d2 Update ingestion_flow.json 2025-09-26 12:01:56 -04:00
Lucas Oliveira
e0015f35db
fix: update onboarding design, make opensearch index be initialized after onboarding, make flow reset change the models to the provider chosen (#100)
* changed tooltip stype

* added start on label wrapper

* changed switch to checkbox on openai onboarding and changed copies

* made border be red when api key is invalid

* Added embedding configuration after onboarding

* changed openrag ingest docling to have same embedding model component as other flows

* changed flows service to get flow by id, not by path

* modify reset_langflow to also put right embedding model

* added endpoint and project id to provider config

* added replacing the model with the provider model when resetting

* Moved consts to settings.py

* raise when flow_id is not found
2025-09-26 12:04:17 -03:00
Edwin Jose
392322077f Enable local build for OpenRAG services and update metadata handling
Switched OpenRAG backend and frontend in docker-compose.yml to use local Dockerfile builds instead of remote images. Updated environment variables for better clarity and system integration. In flows/openrag_agent.json and langflow_file_service, improved handling of docs_metadata to support Data objects and added logging for metadata ingestion. Added agent_llm edge to agent node in flow definition.
2025-09-26 03:08:26 -04:00
Edwin Jose
f4268bb99e Add new environment variables and improve logging
Added OWNER, OWNER_NAME, OWNER_EMAIL, and CONNECTOR_TYPE environment variables to docker-compose.yml and updated LANGFLOW_VARIABLES_TO_GET_FROM_ENVIRONMENT accordingly. Modified ingestion_flow.json to adjust node selection and className, and cleared a sensitive value. Added logging for metadata tweaks in langflow_file_service.py for better traceability.
2025-09-26 02:36:32 -04:00
Edwin Jose
843fc92b76 Enhance OpenSearch ingestion and metadata handling
Updated the OpenSearchVectorStoreComponent to improve document metadata ingestion, including support for Data objects in docs_metadata. Added new edges and nodes to ingestion_flow.json for dynamic metadata input. Changed Dockerfile.langflow to use the fix-file-component branch.
2025-09-26 02:10:51 -04:00
Edwin Jose
81300fdf9a Merge branch 'main' into lfx-openrag-update-flows 2025-09-25 15:40:33 -04:00