Commit graph

29 commits

Author SHA1 Message Date
Eric Hare
a467e8a9b6
fix: Support for txt file processing outside of Docling 2025-12-08 09:09:05 -08:00
Lucas Oliveira
6cc011d36e Added onboarding rollback on backend 2025-12-05 15:49:13 -03:00
phact
9d04f0916e crank scarf timeout 2025-12-03 20:13:05 -05:00
phact
9f6f4cd60d fire and foreget 2025-12-03 19:49:30 -05:00
Lucas Oliveira
ed77a9cba0
feat: add Scarf telemetry to OpenRAG (#548)
* added telemetry utils

* added telemetry to openrag

* fixed http timeout

* Added OS and GPU logging

* Track task fail and cancel

* Updated messages to be more readable
2025-12-02 16:52:51 -03:00
Edwin Jose
998d8b9195 Add fail-safe mode to embedding and OpenSearch components
Introduces a 'fail_safe_mode' option to the Embedding Model and OpenSearch (Multi-Model Multi-Embedding) components, allowing errors to be logged and None returned instead of raising exceptions. Refactors embedding model fetching logic for better error handling and updates component metadata, field order, and dependencies. Also adds 'className' fields and updates frontend node folder IDs for improved UI consistency.
2025-11-26 01:15:30 -05:00
Edwin Jose
0f2012bbb9 Update Langflow tweaks and add provider credentials to headers
Replaces all references to 'OpenSearchHybrid-Ve6bS' with 'OpenSearchVectorStoreComponentMultimodalMultiEmbedding-By9U4' in main.py, processors, and file service. Adds a utility for injecting provider credentials into Langflow request headers and integrates it into chat and file services for improved credential handling.
2025-11-25 22:50:38 -05:00
phact
bba02910e6 await 2025-10-11 02:53:16 -04:00
Sebastián Estévez
b9f109ea7d
Merge branch 'main' into multi-embedding-support 2025-10-11 02:44:16 -04:00
phact
a7c5a9f8f3 fis: keyword type field name for search 2025-10-11 02:10:01 -04:00
phact
6266e5c18d persist dimensions 2025-10-10 14:16:58 -04:00
phact
4b29ad73af WIP, non-langflow mode only 2025-10-10 09:57:45 -04:00
phact
102c17d7ec WIP, non-langflow mode only 2025-10-10 09:43:37 -04:00
Copilot
140d24603d
Implement dynamic Ollama embedding dimension resolution with server probing (#237)
* Initial plan

* Implement dynamic Ollama embedding dimension resolution with probing

Co-authored-by: phact <1313220+phact@users.noreply.github.com>

* Fix Ollama probing

* raise instead of dims 0

* Show better error

* Run embedding probe before saving settings so that user can update

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: phact <1313220+phact@users.noreply.github.com>
Co-authored-by: Lucas Oliveira <lucas.edu.oli@hotmail.com>
Co-authored-by: phact <estevezsebastian@gmail.com>
2025-10-09 16:40:58 -03:00
phact
6a1bf8e61d tui ip bind check 2025-10-07 11:32:04 -04:00
phact
6f32890d76 docling backend check 2025-10-06 15:54:21 -04:00
Lucas Oliveira
eef9e380dc Added opensearch queries 2025-10-06 09:45:21 -03:00
Mike Fortman
d015ed1b0c
add container utils (#151)
* add container utils

* added localhost url to settings

* added localhost_url as a constant

* added localhost_url to get settings query

* make ollama onboarding have localhost url by default

* make endpoint be changed in models service and in onboarding backend instead of onboarding screen

* fixed embedding dimensions to get stripped model

* make config come as localhost but global variable be set as the transformed endpoint

* remove setting ollama url since it comes from the global variable

* use localhost again on ollama

---------

Co-authored-by: Lucas Oliveira <lucas.edu.oli@hotmail.com>
2025-09-30 16:34:55 -03:00
phact
6612388586 auto cleanup temp files 2025-09-29 14:08:36 -04:00
phact
0a49898fca Merge branch 'main' into shared-process-document-common-refactor 2025-09-29 12:12:10 -04:00
Lucas Oliveira
00477cac99 fix: update onboarding design, make opensearch index be initialized after onboarding, make flow reset change the models to the provider chosen (#100)
* changed tooltip stype

* added start on label wrapper

* changed switch to checkbox on openai onboarding and changed copies

* made border be red when api key is invalid

* Added embedding configuration after onboarding

* changed openrag ingest docling to have same embedding model component as other flows

* changed flows service to get flow by id, not by path

* modify reset_langflow to also put right embedding model

* added endpoint and project id to provider config

* added replacing the model with the provider model when resetting

* Moved consts to settings.py

* raise when flow_id is not found
2025-09-26 12:04:17 -03:00
phact
1b9d56bec0 WIP 2025-09-24 21:13:26 -04:00
phact
dc91f55014 doc processing knobs 2025-09-18 16:27:01 -04:00
phact
d198ffa706 logging & format 2025-09-04 20:56:47 -04:00
phact
a52a842df9 centralized logging 2025-09-03 15:57:35 -04:00
phact
9074bda6ed ruff 2025-09-03 09:17:30 -04:00
phact
6011b7fb2f worker logging and reliability 2025-08-22 12:40:55 -04:00
phact
5921586bcf tasks work post refactor 2025-07-30 15:49:58 -04:00
phact
c9182184cf refactor 2025-07-30 11:18:19 -04:00