Commit graph

317 commits

Author SHA1 Message Date
Edwin Jose
dcd44017ce Update to langflow service to user logger correctly 2025-09-08 12:13:02 -04:00
Edwin Jose
5dd9959dd0
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 10:38:31 -04:00
phact
9f7c506cce log error when INGEST_FLOW_ID is not configured 2025-09-08 09:58:28 -04:00
Gabriel Luiz Freitas Almeida
20a5648b3d Refactor ingestion flow configuration for OpenSearch hybrid component
This commit updates the ingestion flow JSON configuration to enhance the OpenSearch hybrid component. Key changes include renaming the component to OpenSearchHybrid, updating input fields for better clarity, and improving the handling of JWT authentication. Additionally, the commit introduces new parameters for search configuration, such as engine selection and filter expressions, while ensuring the overall structure adheres to robust async coding practices and well-documented code.
2025-09-08 09:14:03 -03:00
Gabriel Luiz Freitas Almeida
18e1874c88 Enhance logging and JWT token handling in LangflowFileService
This commit refactors the LangflowFileService to utilize a centralized logger instead of instance-specific logging. It also improves the handling of the JWT token in the run_ingestion_flow method, ensuring it is correctly passed to downstream services and logged appropriately. These changes enhance code readability and maintainability while adhering to robust async coding practices.
2025-09-08 08:44:05 -03:00
Gabriel Luiz Freitas Almeida
deb39a6e5b Refactor user file upload and ingestion flow to streamline JWT token handling
This commit simplifies the handling of the JWT token in the upload_user_file and run_ingestion functions by removing unnecessary lines and ensuring the token is passed correctly to downstream services. This change enhances code readability and maintains the focus on robust async coding practices and well-documented code.
2025-09-08 08:43:53 -03:00
Gabriel Luiz Freitas Almeida
7b5589653a Add handling for Content-Type header in AppClients
This commit modifies the AppClients class to remove the Content-Type header if it is explicitly set to None, particularly for file uploads. This change enhances the robustness of the async code by ensuring proper header management during API requests, aligning with the project's focus on well-documented and maintainable code.
2025-09-08 08:43:32 -03:00
Gabriel Luiz Freitas Almeida
2543b2103b fix import statement 2025-09-08 08:42:46 -03:00
Edwin Jose
6c99c1b61d Implement unified upload and ingest endpoint in Langflow
This commit introduces a new combined endpoint for uploading files and running ingestion in Langflow. The frontend component is updated to utilize this endpoint, streamlining the process by eliminating separate upload and ingestion calls. The response structure is adjusted to include deletion status and other relevant information, enhancing error handling and logging practices throughout the codebase.
2025-09-08 02:03:02 -04:00
Gabriel Luiz Freitas Almeida
7172e95d98 Update logging in initialize_services to use logger instead of print statement
This commit replaces the print statement with a logger.info call in the initialize_services function, enhancing the logging practices for better error tracking and consistency across the codebase. This change aligns with the project's focus on robust async coding and well-documented code.
2025-09-05 11:37:44 -03:00
Gabriel Luiz Freitas Almeida
db65f8789a Refactor LangflowFileService to utilize centralized API client
This commit streamlines the LangflowFileService by removing direct HTTP client usage in favor of a centralized API client for handling requests. It enhances the upload and delete file methods to improve code organization and maintainability. Additionally, it updates logging practices for better error visibility, ensuring adherence to robust async coding standards and documentation practices.
2025-09-05 11:36:44 -03:00
Gabriel Luiz Freitas Almeida
89246ed1ae Refactor Langflow API integration in AppClients
This commit updates the settings for LANGFLOW_INGEST_FLOW_ID to remove reliance on a deprecated environment variable. It introduces a new Langflow HTTP client for making API requests and adds a centralized method for handling Langflow API requests, improving code organization and maintainability. The changes enhance the robustness of the async code while ensuring proper documentation practices are followed.
2025-09-05 11:33:37 -03:00
Gabriel Luiz Freitas Almeida
531ff8b6ac Merge branch 'main' into ingestion-flow 2025-09-05 10:26:38 -03:00
Gabriel Luiz Freitas Almeida
63982ba711 Format 2025-09-05 10:22:55 -03:00
Gabriel Luiz Freitas Almeida
b4ca29677e Refactor settings fetching in KnowledgeSourcesPage for cleaner state updates
This commit simplifies the state update logic in the KnowledgeSourcesPage component by using conditional chaining to set various settings from the backend response. It removes the unnecessary settingsLoaded state, streamlining the code for better readability and maintainability while adhering to robust coding practices.
2025-09-05 10:03:07 -03:00
Edwin Jose
e983d3c27a
Merge pull request #7 from langflow-ai/default-data 2025-09-05 01:27:22 -04:00
Sebastián Estévez
ff5aabfed6
Merge branch 'main' into default-data 2025-09-04 21:53:38 -04:00
phact
74a58b2d9a Merge branch 'main' of github.com:phact/gendb 2025-09-04 20:56:56 -04:00
phact
d198ffa706 logging & format 2025-09-04 20:56:47 -04:00
Gabriel Luiz Freitas Almeida
b493dab318 Enhance KnowledgeSourcesPage with ingestion settings and connector management
This commit refactors the KnowledgeSourcesPage component to include a new ingestion settings section, allowing users to configure document processing parameters such as chunk size and overlap. It also improves the connector management interface by integrating async fetching of connector statuses and enhancing error handling. The changes aim to provide a more robust and user-friendly experience while maintaining well-documented code practices.
2025-09-04 18:33:16 -03:00
Gabriel Luiz Freitas Almeida
69834ac4ac Refactor error logging in upload_user_file function
This commit replaces the print statement for error traceback with a structured logging approach using the logger. This change enhances error visibility and aligns with best practices for robust and well-documented async code.
2025-09-04 18:32:38 -03:00
Gabriel Luiz Freitas Almeida
9494e99808 Set tweaks to settings passed from the UI 2025-09-04 18:32:29 -03:00
Gabriel Luiz Freitas Almeida
2fbb8d8430 Implement async fetching of ingestion flow configuration
This commit adds functionality to retrieve and set ingestion-specific defaults from the Langflow API based on the flow configuration. It includes error handling for the API call and updates the settings with values for chunk size, chunk overlap, separator, and embedding model based on the flow data. This enhancement improves the flexibility and robustness of the ingestion process.
2025-09-04 18:31:38 -03:00
Edwin Jose
ce31933d71 Update session_manager.py 2025-09-04 17:21:13 -04:00
Edwin Jose
c307f93443 Merge branch 'main' into default-data 2025-09-04 17:04:22 -04:00
Gabriel Luiz Freitas Almeida
ec5092a54a Add ingestion flow for OpenSearch integration
This commit introduces a new JSON configuration file for the OpenSearch ingestion flow, detailing the data processing pipeline. The flow includes components for splitting text, generating embeddings, and ingesting data into OpenSearch, enhancing the capabilities for Retrieval Augmented Generation (RAG) tasks. The configuration is designed to support various input types and provides detailed metadata for each component, ensuring robust and well-documented integration.
2025-09-04 18:03:16 -03:00
Sebastián Estévez
25531ef80f
Merge pull request #16 from langflow-ai/anonymous-user
feat: add users classes
2025-09-04 17:02:40 -04:00
Gabriel Luiz Freitas Almeida
c4185bb33f Merge branch 'main' into ingestion-flow 2025-09-04 17:59:43 -03:00
Edwin Jose
db3e9a3270 Update session_manager.py 2025-09-04 16:58:40 -04:00
Edwin Jose
651dc22635 update to default files using anonymous users 2025-09-04 16:57:43 -04:00
Edwin Jose
f97f12b3af add users classes 2025-09-04 15:59:10 -04:00
Edwin Jose
34739193eb Merge branch 'main' into default-data 2025-09-04 15:41:03 -04:00
phact
d5fd34edf7 fix no-auth owner 2025-09-04 15:36:22 -04:00
Edwin Jose
6bd610a773 making tasks of init sequential 2025-09-04 15:22:13 -04:00
Edwin Jose
12f3265654 remove init_index in default file loading 2025-09-04 15:05:06 -04:00
Edwin Jose
08b2b6371c updated the default file loading task
support auth and non auth modes such that owner is None so these files will be considered as default files
2025-09-04 15:02:25 -04:00
Sebastián Estévez
e4e3535fe2
Merge branch 'main' into default-data 2025-09-04 13:55:51 -04:00
Sebastián Estévez
d5dda4ce2e
Merge pull request #14 from langflow-ai/tui
Tui improvements
2025-09-04 13:40:54 -04:00
phact
956d7582eb tui fixes 2025-09-04 13:40:22 -04:00
Edwin Jose
9f62d066ef Update main.py 2025-09-04 13:37:06 -04:00
Edwin Jose
2d0f53be30 delete make file 2025-09-04 13:36:31 -04:00
Mike Fortman
cf02238671
Merge pull request #12 from langflow-ai/iconfix
update favicon
2025-09-04 12:08:05 -05:00
Mike Fortman
727bcea952 update favicon 2025-09-04 12:06:57 -05:00
phact
214877e9ff btn fix 2025-09-04 12:02:35 -04:00
phact
5f84acb996 tui podman fixes, etc. 2025-09-04 11:45:39 -04:00
Gabriel Luiz Freitas Almeida
4bd2bd7765 Merge branch 'main' into ingestion-flow 2025-09-04 11:46:33 -03:00
Gabriel Luiz Freitas Almeida
e4603706fe Update Docker Compose files to replace FLOW_ID with LANGFLOW_CHAT_FLOW_ID
This commit modifies both docker-compose.yml and docker-compose-cpu.yml to update the environment variable from FLOW_ID to LANGFLOW_CHAT_FLOW_ID, ensuring consistency across configurations. These changes contribute to a more robust and well-documented codebase.
2025-09-04 10:27:08 -03:00
Gabriel Luiz Freitas Almeida
2bb74d89bb Implement file upload, ingestion, and deletion flow in KnowledgeDropdown component
This commit enhances the KnowledgeDropdown component by integrating a complete file handling process that includes uploading files to Langflow, running an ingestion flow, and deleting the uploaded files. It introduces error handling for each step and dispatches appropriate events to notify the UI of the upload and ingestion results. These changes improve the robustness and maintainability of the component, contributing to a well-documented codebase.
2025-09-04 10:26:27 -03:00
Gabriel Luiz Freitas Almeida
3118e54b69 Add ingest flow handling and UI updates in KnowledgeSourcesPage
This commit introduces state management for ingest flow IDs and corresponding edit URLs in the KnowledgeSourcesPage component. It enhances the user interface by adding a new section for file ingestion, allowing users to customize their file processing pipeline. The changes improve the overall functionality and maintainability of the settings page, contributing to a more robust and well-documented codebase.
2025-09-04 10:24:11 -03:00
Gabriel Luiz Freitas Almeida
83438a7c93 Refactor settings.py to enhance settings retrieval and improve flow ID handling
This commit updates the settings retrieval function to include new flow IDs for chat and ingestion, replacing the deprecated FLOW_ID. It also improves the logic for exposing edit URLs based on the availability of public URLs, contributing to a more robust and well-documented codebase.
2025-09-04 10:23:54 -03:00