Commit graph

33 commits

Author SHA1 Message Date
Eric Hare
ea4d97f191
fix: Better debugging for input type ingest failures 2025-12-12 12:00:19 -08:00
Edwin Jose
0f2012bbb9 Update Langflow tweaks and add provider credentials to headers
Replaces all references to 'OpenSearchHybrid-Ve6bS' with 'OpenSearchVectorStoreComponentMultimodalMultiEmbedding-By9U4' in main.py, processors, and file service. Adds a utility for injecting provider credentials into Langflow request headers and integrates it into chat and file services for improved credential handling.
2025-11-25 22:50:38 -05:00
Edwin Jose
07b84e373a Update config import to use settings module
Replaced imports from config_manager with settings in chat_service.py and langflow_file_service.py to use get_openrag_config from config.settings. This change ensures consistency with the updated configuration structure.
2025-11-25 19:40:24 -05:00
Edwin Jose
284b982dbf Add SELECTED_EMBEDDING_MODEL global variable support
Introduces SELECTED_EMBEDDING_MODEL as a global environment variable in docker-compose files and ensures it is passed in API headers for Langflow-related services. Updates settings and onboarding logic to set this variable without triggering flow updates, improving embedding model configuration consistency across services.
2025-11-25 17:47:54 -05:00
phact
7763dc5d48 fix: file tuple for ingest 2025-10-06 16:25:05 -04:00
Edwin Jose
336e7bb501 Integrate OpenSearch hybrid search and update ingestion flow
Replaces the File component with a new OpenSearch hybrid search component in the ingestion flow, adds support for document metadata, and updates flow edges for DataFrame operations. Updates OpenSearch component implementation with advanced authentication, metadata handling, and vector store features. Docker Compose files and related service references are also updated to support the new OpenSearch integration.
2025-10-04 02:09:29 -04:00
Edwin Jose
392322077f Enable local build for OpenRAG services and update metadata handling
Switched OpenRAG backend and frontend in docker-compose.yml to use local Dockerfile builds instead of remote images. Updated environment variables for better clarity and system integration. In flows/openrag_agent.json and langflow_file_service, improved handling of docs_metadata to support Data objects and added logging for metadata ingestion. Added agent_llm edge to agent node in flow definition.
2025-09-26 03:08:26 -04:00
Edwin Jose
f4268bb99e Add new environment variables and improve logging
Added OWNER, OWNER_NAME, OWNER_EMAIL, and CONNECTOR_TYPE environment variables to docker-compose.yml and updated LANGFLOW_VARIABLES_TO_GET_FROM_ENVIRONMENT accordingly. Modified ingestion_flow.json to adjust node selection and className, and cleared a sensitive value. Added logging for metadata tweaks in langflow_file_service.py for better traceability.
2025-09-26 02:36:32 -04:00
Edwin Jose
843fc92b76 Enhance OpenSearch ingestion and metadata handling
Updated the OpenSearchVectorStoreComponent to improve document metadata ingestion, including support for Data objects in docs_metadata. Added new edges and nodes to ingestion_flow.json for dynamic metadata input. Changed Dockerfile.langflow to use the fix-file-component branch.
2025-09-26 02:10:51 -04:00
Edwin Jose
372c7e2445 update to header 2025-09-25 16:24:43 -04:00
Edwin Jose
425b673e14 update to flow 2025-09-25 15:39:42 -04:00
Gabriel Luiz Freitas Almeida
8d1b4f7cf6 format langflow_file_service.py 2025-09-22 19:32:26 -03:00
Gabriel Luiz Freitas Almeida
b19890fa4d Fix tweaks to pass load_from_db=False 2025-09-22 19:32:08 -03:00
Edwin Jose
c8c78f83d8 update component name 2025-09-19 22:08:01 -04:00
Edwin Jose
eeb060700c Update langflow_file_service.py 2025-09-19 21:32:39 -04:00
Edwin Jose
083f3d5d3d update to flows 2025-09-19 21:17:31 -04:00
Edwin Jose
faac0c912e Merge branch 'main' into langflow-ingestion-modes 2025-09-09 02:42:52 -04:00
phact
132194d1f8 filenames 2025-09-09 00:13:16 -04:00
Gabriel Luiz Freitas Almeida
0539f7751a Enhance ingestion flow by adding user metadata and improving context handling
This commit updates the ingestion flow to include user metadata such as owner ID, name, and email, enhancing the context for downstream services. It also refines the handling of tweaks in the LangflowFileService to incorporate this metadata, ensuring better tracking and clarity in the ingestion process. These changes align with best practices for robust async development and improve the overall functionality of the ingestion flow.
2025-09-08 23:49:46 -03:00
Edwin Jose
445ad708f8
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 21:22:59 -04:00
Gabriel Luiz Freitas Almeida
86709db984 Update file path key in tweaks dictionary for LangflowFileService to enhance clarity
This commit modifies the key for file paths in the tweaks dictionary from "file_path" to "path" within the LangflowFileService class. This change improves code clarity and consistency, aligning with best practices for robust async development while maintaining existing functionality.
2025-09-08 22:02:58 -03:00
Edwin Jose
1c5e61abdb
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 19:32:41 -04:00
Gabriel Luiz Freitas Almeida
8ae543ac69 Refactor file path handling in LangflowFileService to improve clarity and consistency
This commit updates the LangflowFileService class by changing the key for file paths in the tweaks dictionary from "path" to "file_path". This modification enhances code clarity and aligns with best practices for maintaining robust async code. Additionally, it simplifies the logging statement for better readability while preserving the functionality related to JWT token handling.
2025-09-08 20:11:21 -03:00
Edwin Jose
975a4c214a Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 12:51:34 -04:00
Edwin Jose
dcd44017ce Update to langflow service to user logger correctly 2025-09-08 12:13:02 -04:00
Edwin Jose
5dd9959dd0
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 10:38:31 -04:00
phact
8dc77298be logging 2025-09-08 10:30:18 -04:00
phact
9f7c506cce log error when INGEST_FLOW_ID is not configured 2025-09-08 09:58:28 -04:00
Gabriel Luiz Freitas Almeida
18e1874c88 Enhance logging and JWT token handling in LangflowFileService
This commit refactors the LangflowFileService to utilize a centralized logger instead of instance-specific logging. It also improves the handling of the JWT token in the run_ingestion_flow method, ensuring it is correctly passed to downstream services and logged appropriately. These changes enhance code readability and maintainability while adhering to robust async coding practices.
2025-09-08 08:44:05 -03:00
Edwin Jose
6c99c1b61d Implement unified upload and ingest endpoint in Langflow
This commit introduces a new combined endpoint for uploading files and running ingestion in Langflow. The frontend component is updated to utilize this endpoint, streamlining the process by eliminating separate upload and ingestion calls. The response structure is adjusted to include deletion status and other relevant information, enhancing error handling and logging practices throughout the codebase.
2025-09-08 02:03:02 -04:00
Gabriel Luiz Freitas Almeida
db65f8789a Refactor LangflowFileService to utilize centralized API client
This commit streamlines the LangflowFileService by removing direct HTTP client usage in favor of a centralized API client for handling requests. It enhances the upload and delete file methods to improve code organization and maintainability. Additionally, it updates logging practices for better error visibility, ensuring adherence to robust async coding standards and documentation practices.
2025-09-05 11:36:44 -03:00
Gabriel Luiz Freitas Almeida
45e9c60af1 Enhance LangflowFileService with API key management and v2 endpoint support
This commit refactors the LangflowFileService to include asynchronous API key retrieval and updates the file upload and deletion methods to use the new v2 endpoints. The flow ID constant has been renamed for clarity, and additional logging has been added for better debugging and error handling. The payload structure for the ingestion flow has also been modified to improve functionality and maintainability.
2025-09-04 10:21:35 -03:00
Gabriel Luiz Freitas Almeida
f0744b153d Add LangflowFileService for file upload and ingestion flow
This commit introduces the LangflowFileService class, which provides methods for uploading user files, deleting user files, and triggering an ingestion flow using the Langflow Files API. The service is designed to handle asynchronous operations and includes error handling for API requests. Documentation for each method is included to ensure clarity on usage.
2025-09-02 23:10:20 -03:00