Commit graph

115 commits

Author SHA1 Message Date
ming luo
bc639d190b opensearch health check 2026-01-15 15:30:04 -05:00
phact
bb71167d11 v1 endpoints for kf and settings 2025-12-19 03:31:54 -05:00
phact
320973a426 backend /v1 frontend /api/v1 routing, sdks port 3000 2025-12-19 01:50:29 -05:00
phact
9bc6f8b6eb ingest poll and other sdk endpoint fixes 2025-12-16 22:40:39 -05:00
phact
74cba85ae6 v0 sdks wip 2025-12-16 02:04:31 -05:00
Lucas Oliveira
6cc011d36e Added onboarding rollback on backend 2025-12-05 15:49:13 -03:00
Lucas Oliveira
ed77a9cba0
feat: add Scarf telemetry to OpenRAG (#548)
* added telemetry utils

* added telemetry to openrag

* fixed http timeout

* Added OS and GPU logging

* Track task fail and cancel

* Updated messages to be more readable
2025-12-02 16:52:51 -03:00
Mike Fortman
55a685ebab fix get endpoints 2025-12-01 15:01:10 -06:00
Lucas Oliveira
3624b4f82b
fix: openrag documents ingestion (#545)
* Changed references to /app/documents to reference /app/openrag-documents

* bump version
2025-11-27 15:22:09 -03:00
pushkala-datastax
54dfd723dc
Container and openrag-documents 2025-11-27 09:37:55 -08:00
Lucas Oliveira
cebb38eb04
fix: make backend reset langflow flows after upgrade, backup flows every 5 mins (#483)
* Changed backend to mount config at volume

* update lock

* Changed backend to reapply settings after detecting that flow is reset

* Added periodic backup for flows, make better reset

* tui warning

* Changed settings page to alert user that he has to disable lock flow

* Changed flows to be locked

* Do periodic backup only if onboarding is done

* Change backup function to only back up flows if flow lock is disabled

* Added session manager to reapply all settings

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-26 22:53:33 -03:00
Mike Fortman
25dd787d2a
Merge branch 'main' into doc-directory-name 2025-11-26 16:11:58 -06:00
Mike Fortman
d6466db5a1 change documents directory 2025-11-26 12:59:40 -06:00
Edwin Jose
998d8b9195 Add fail-safe mode to embedding and OpenSearch components
Introduces a 'fail_safe_mode' option to the Embedding Model and OpenSearch (Multi-Model Multi-Embedding) components, allowing errors to be logged and None returned instead of raising exceptions. Refactors embedding model fetching logic for better error handling and updates component metadata, field order, and dependencies. Also adds 'className' fields and updates frontend node folder IDs for improved UI consistency.
2025-11-26 01:15:30 -05:00
Edwin Jose
0f2012bbb9 Update Langflow tweaks and add provider credentials to headers
Replaces all references to 'OpenSearchHybrid-Ve6bS' with 'OpenSearchVectorStoreComponentMultimodalMultiEmbedding-By9U4' in main.py, processors, and file service. Adds a utility for injecting provider credentials into Langflow request headers and integrates it into chat and file services for improved credential handling.
2025-11-25 22:50:38 -05:00
Eric Hare
cfe7f6b581
fix: Make sure we exclude the warmup file ingestion 2025-11-18 12:07:38 -08:00
Lucas Oliveira
37faf94979
feat: adds anthropic provider, splits onboarding editing into two, support provider changing with generic llm and embedding components (#373)
* Added flows with new components

* commented model provider assignment

* Added agent component display name

* commented provider assignment, assign provider on the generic component, assign custom values

* fixed ollama not showing loading steps, fixed loading steps never being removed

* made embedding and llm model optional on onboarding call

* added isEmbedding handling on useModelSelection

* added isEmbedding on onboarding card, separating embedding from non embedding card

* Added one additional step to configure embeddings

* Added embedding provider config

* Changed settings.py to return if not embedding

* Added editing fields to onboarding

* updated onboarding and flows_service to change embedding and llm separately

* updated templates that needs to be changed with provider values

* updated flows with new components

* Changed config manager to not have default models

* Changed flows_service settings

* Complete steps if not embedding

* Add more onboarding steps

* Removed one step from llm steps

* Added Anthropic as a model for the language model on the frontend

* Added anthropic models

* Added anthropic support on Backend

* Fixed provider health and validation

* Format settings

* Change anthropic logo

* Changed button to not jump

* Changed flows service to make anthropic work

* Fixed some things

* add embedding specific global variables

* updated flows

* fixed ingestion flow

* Implemented anthropic on settings page

* add embedding provider logo

* updated backend to work with multiple provider config

* update useUpdateSettings with new settings type

* updated provider health banner to check for health with new api

* changed queries and mutations to use new api

* changed embedding model input to work with new api

* Implemented provider based config on the frontend

* update existing design

* fixed settings configured

* fixed provider health query to include health check for both the providers

* Changed model-providers to show correctly the configured providers

* Updated prompt

* updated openrag agent

* Fixed settings to allow editing providers and changing llm and embedding models

* updated settings

* changed lf ver

* bump openrag version

* added more steps

* update settings to create the global variables

* updated steps

* updated default prompt

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-11 19:22:16 -03:00
Lucas Oliveira
a5d25e0c0b
fix: disable upload message when ingesting on onboarding, wait for file to be ingested, added knowledge filters on nudges (#345)
* Removed upload start message

* Made onboarding upload refetch nudges and only finish when document is ingested

* Implemented query filters on nudges

* changed get to post

* Implemented filtering for documents that are not sample data on nudges

---------

Co-authored-by: Sebastián Estévez <estevezsebastian@gmail.com>
2025-11-11 18:20:39 -03:00
Cole Goldsmith
b88c8b20df
Feat/provider validation banner (#353)
* models query combined

* make endpoint to handle provider health

* provider health banner

* update-pdf-to-include-provider-selection (#344)

* polishing the error fixing experience

* fix agent instructions and up char limit

* fix provider

* disable tracing in langflow

* improve docling serve banner remove false positives

* Changed pyproject.toml docling versions

* Added another uv lock revision

* version bump

* unused things and fix bad conflicts

* add isFetching to the hook

* put back settings for models queries to never cache results

* update banner refetching indicator

* validate provider settings when saving

* fix settings page layout issue

* Added retry as false on the get models, to not take a long time

---------

Co-authored-by: Mendon Kissling <59585235+mendonk@users.noreply.github.com>
Co-authored-by: Mike Fortman <michael.fortman@datastax.com>
Co-authored-by: phact <estevezsebastian@gmail.com>
Co-authored-by: Lucas Oliveira <lucas.edu.oli@hotmail.com>
2025-11-06 13:03:50 -06:00
phact
563efd957f lazy client initialization + client cleanup + http2 probe and fallback 2025-10-31 15:52:10 -04:00
phact
80fdd9680d make openai optional in tui and lazy client creation in backend 2025-10-29 22:38:31 -04:00
phact
163d313849 ingest should use task tracker 2025-10-16 20:52:44 -04:00
phact
612a98f083 remove /upload endpoint, switch tests to router 2025-10-13 23:21:19 -04:00
phact
3998014561 fix document processing embedding model bug 2025-10-13 11:31:56 -04:00
Copilot
140d24603d
Implement dynamic Ollama embedding dimension resolution with server probing (#237)
* Initial plan

* Implement dynamic Ollama embedding dimension resolution with probing

Co-authored-by: phact <1313220+phact@users.noreply.github.com>

* Fix Ollama probing

* raise instead of dims 0

* Show better error

* Run embedding probe before saving settings so that user can update

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: phact <1313220+phact@users.noreply.github.com>
Co-authored-by: Lucas Oliveira <lucas.edu.oli@hotmail.com>
Co-authored-by: phact <estevezsebastian@gmail.com>
2025-10-09 16:40:58 -03:00
phact
325358e917 key permissions 2025-10-07 13:18:31 -04:00
phact
8ee1011562 unnecessary arg 2025-10-07 01:32:56 -04:00
phact
6f32890d76 docling backend check 2025-10-06 15:54:21 -04:00
Lucas Oliveira
589839fedc implement duplicate handling on backend and frontend 2025-10-03 15:34:54 -03:00
Lucas Oliveira
11464f031e Merge remote-tracking branch 'origin/main' into lfx-openrag-update-flows 2025-10-02 17:40:19 -03:00
Lucas Oliveira
52896a8da7
fix: set defined models for openai, make default embedding be used when disable ingest with LF feature flag is enabled (#128)
* hard-coded openai models

* ensure index if disable ingest with langflow is active

* update backend to not update embedding model when flag is disabled

* initialize index on startup when feature flag is enabled

* put config.yaml on docker compose
2025-10-01 16:50:21 -03:00
Edwin Jose
b51efd0d5e
Merge branch 'main' into lfx-openrag-update-flows 2025-09-26 12:16:02 -05:00
Lucas Oliveira
e0015f35db
fix: update onboarding design, make opensearch index be initialized after onboarding, make flow reset change the models to the provider chosen (#100)
* changed tooltip stype

* added start on label wrapper

* changed switch to checkbox on openai onboarding and changed copies

* made border be red when api key is invalid

* Added embedding configuration after onboarding

* changed openrag ingest docling to have same embedding model component as other flows

* changed flows service to get flow by id, not by path

* modify reset_langflow to also put right embedding model

* added endpoint and project id to provider config

* added replacing the model with the provider model when resetting

* Moved consts to settings.py

* raise when flow_id is not found
2025-09-26 12:04:17 -03:00
Edwin Jose
392322077f Enable local build for OpenRAG services and update metadata handling
Switched OpenRAG backend and frontend in docker-compose.yml to use local Dockerfile builds instead of remote images. Updated environment variables for better clarity and system integration. In flows/openrag_agent.json and langflow_file_service, improved handling of docs_metadata to support Data objects and added logging for metadata ingestion. Added agent_llm edge to agent node in flow definition.
2025-09-26 03:08:26 -04:00
Edwin Jose
425b673e14 update to flow 2025-09-25 15:39:42 -04:00
Lucas Oliveira
28e566a1f4
feat: add session delete functionality (#70)
* implement delete user conversation on agent

* format

* implement delete session endpoint

* implement delete session on persistence services

* added deletion of sessions and added fetch sessions with query instead of with useEffect

* removed unused texts

* implemented dropdown menu on conversations
2025-09-24 17:41:53 -03:00
Lucas Oliveira
a8f4d734a3
fix: adjust onboarding copies and behaviors (#67)
* fixed logos

* pre-populate ollama endpoint

* show/hide api keys with button

* Added dropdown selector for ibm endpoint

* Added programatic dot pattern instead of background image

* Updated copies

* wait for 500ms before show connecting

* Changed copy

* removed unused log

* Added padding when password button is present

* made toggle be on mouse up

* show placeholder as loading models when they're loading

* removed description from model selector

* implemented getting key from env

* fixed complete button not updating
2025-09-24 17:35:16 -03:00
Edwin Jose
f710ae2137 Merge branch 'main' into lfx-openrag-update-flows 2025-09-24 11:39:09 -04:00
Edwin Jose
4e5f1ae931 Merge branch 'main' into lfx-openrag-update-flows 2025-09-23 11:40:16 -05:00
Mike Fortman
e67fc21a9b update flow based on docling presets 2025-09-22 16:58:12 -05:00
Lucas Oliveira
580c6f8e32 ingest documents only if user wants to 2025-09-22 09:35:41 -03:00
Edwin Jose
c8c78f83d8 update component name 2025-09-19 22:08:01 -04:00
Mike Fortman
9ad1fb3f4f Merge branch 'main' of github.com:langflow-ai/openrag into feat/onboarding 2025-09-18 21:04:37 -05:00
Lucas Oliveira
d68a787017 Added models fetching 2025-09-18 18:25:00 -03:00
Deon Sanchez
9b5a7be8b0 Merge branch 'main' of https://github.com/langflow-ai/openrag into delete-knowledge 2025-09-18 14:09:51 -06:00
Lucas Oliveira
410e98c802 removed unused session manager on onboarding endpoint 2025-09-17 17:43:59 -03:00
Lucas Oliveira
78380e1e07 add flows service to onboarding endpoint 2025-09-17 17:42:48 -03:00
Lucas Oliveira
f5e2ee8059 added onboarding request 2025-09-17 16:53:44 -03:00
Lucas Oliveira
03b827f3e0 Added settings service and added post endpoint to edit them 2025-09-17 16:50:19 -03:00
Edwin Jose
713f90c3c4 Integrate Langflow MCP JWT header update in AuthService
Added LangflowMCPService to update MCP servers with the user's JWT header after authentication. AuthService now triggers a background update to MCP servers on successful login, ensuring JWT propagation for downstream services.
2025-09-17 02:01:03 -04:00