Commit graph

183 commits

Author SHA1 Message Date
phact
6cfdb827c7 task timings 2025-09-09 14:33:15 -04:00
phact
d34a3c81f2 connections duplicate bug 2025-09-09 13:16:14 -04:00
phact
97a17c77d7 filename fix 2025-09-09 12:57:28 -04:00
Edwin Jose
cf27dfddeb Update processors.py 2025-09-09 03:32:17 -04:00
Edwin Jose
8dff280930 add langflow routers with langflow file processor 2025-09-09 03:20:21 -04:00
Edwin Jose
faac0c912e Merge branch 'main' into langflow-ingestion-modes 2025-09-09 02:42:52 -04:00
phact
4a562301cd duplicate file fix 2025-09-09 00:18:51 -04:00
phact
132194d1f8 filenames 2025-09-09 00:13:16 -04:00
phact
2fbc852eb3 drive convert to pdf and include file extension 2025-09-08 23:58:26 -04:00
Gabriel Luiz Freitas Almeida
0539f7751a Enhance ingestion flow by adding user metadata and improving context handling
This commit updates the ingestion flow to include user metadata such as owner ID, name, and email, enhancing the context for downstream services. It also refines the handling of tweaks in the LangflowFileService to incorporate this metadata, ensuring better tracking and clarity in the ingestion process. These changes align with best practices for robust async development and improve the overall functionality of the ingestion flow.
2025-09-08 23:49:46 -03:00
Edwin Jose
445ad708f8
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 21:22:59 -04:00
Gabriel Luiz Freitas Almeida
86709db984 Update file path key in tweaks dictionary for LangflowFileService to enhance clarity
This commit modifies the key for file paths in the tweaks dictionary from "file_path" to "path" within the LangflowFileService class. This change improves code clarity and consistency, aligning with best practices for robust async development while maintaining existing functionality.
2025-09-08 22:02:58 -03:00
phact
acdfd3c8ca os diag 2025-09-08 20:52:52 -04:00
Edwin Jose
1c5e61abdb
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 19:32:41 -04:00
Edwin Jose
e0117f5cd1 update to routers 2025-09-08 19:31:42 -04:00
Gabriel Luiz Freitas Almeida
8ae543ac69 Refactor file path handling in LangflowFileService to improve clarity and consistency
This commit updates the LangflowFileService class by changing the key for file paths in the tweaks dictionary from "path" to "file_path". This modification enhances code clarity and aligns with best practices for maintaining robust async code. Additionally, it simplifies the logging statement for better readability while preserving the functionality related to JWT token handling.
2025-09-08 20:11:21 -03:00
Gabriel Luiz Freitas Almeida
12cbd63dbf Refactor SearchService to improve data retrieval from search results
This commit updates the SearchService class to utilize the `get` method for safely accessing fields in the search results. This change enhances the robustness of the code by preventing potential KeyErrors and aligns with best practices for building maintainable async code. Additionally, it simplifies the data extraction process from the search results, improving overall code clarity.
2025-09-08 20:10:48 -03:00
Edwin Jose
ed41ce0a67 add router to main 2025-09-08 17:52:22 -04:00
Edwin Jose
9c362ab4d9 Merge branch 'langflow-ingestion-modes' of https://github.com/langflow-ai/openrag into langflow-ingestion-modes 2025-09-08 17:22:44 -04:00
Edwin Jose
890b2e526b updates to routers 2025-09-08 17:22:14 -04:00
Edwin Jose
63d7b585b6
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 17:21:39 -04:00
Gabriel Luiz Freitas Almeida
762152934e Add async method to retrieve connector by ID in LangflowConnectorService
This commit introduces the _get_connector method in the LangflowConnectorService class, providing an asynchronous way to retrieve a connector by its connection ID. This addition enhances the service's functionality and aligns with the ongoing improvements in asynchronous processing and code maintainability.
2025-09-08 18:06:18 -03:00
Edwin Jose
1531c6a9f5 Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 16:51:29 -04:00
phact
f3616db4cd FLOW_ID 2025-09-08 16:33:06 -04:00
Sebastián Estévez
084502c0b6
Merge branch 'main' into ingestion-flow 2025-09-08 16:29:13 -04:00
phact
a4e271cb37 Merge branch 'main' of github.com:phact/gendb 2025-09-08 16:12:43 -04:00
phact
73f039afb5 logging 2025-09-08 16:07:06 -04:00
Eric Hare
617615532d
Update connection_manager.py 2025-09-08 13:00:00 -07:00
Eric Hare
cff28fc4f9
feat: Cleanup duplicate connections 2025-09-08 12:56:38 -07:00
Edwin Jose
72e87eb702 change the parameter! 2025-09-08 15:42:20 -04:00
Gabriel Luiz Freitas Almeida
6d0a94e4b4 Refactor connector service initialization to use LangflowConnectorService
This commit updates the service initialization in main.py to replace the existing ConnectorService with LangflowConnectorService. This change enhances the management of connector documents by leveraging the new service's capabilities, aligning with the ongoing improvements in asynchronous processing and code maintainability.
2025-09-08 16:42:07 -03:00
Gabriel Luiz Freitas Almeida
beee47068c Add LangflowConnectorService for managing connector documents
This commit introduces the LangflowConnectorService class, which facilitates the management and processing of connector documents using the Langflow service. It includes methods for initializing the service, retrieving connectors, processing documents, and syncing files. The implementation emphasizes asynchronous processing and robust error handling, enhancing the overall maintainability and documentation of the codebase.
2025-09-08 16:40:24 -03:00
Gabriel Luiz Freitas Almeida
542082e5bf Add LangflowConnectorFileProcessor for handling connector file uploads
This commit introduces the LangflowConnectorFileProcessor class, which processes connector file uploads using the Langflow service. It includes initialization parameters for user and connection details, and implements the process_item method to handle file processing asynchronously. Additionally, it cleans up the existing ConnectorFileProcessor by removing unused imports and streamlining file info retrieval. These changes enhance the code's robustness and maintainability in line with async development practices.
2025-09-08 16:40:06 -03:00
Gabriel Luiz Freitas Almeida
327b435814 fix imports in task_service 2025-09-08 16:39:41 -03:00
Lucas Oliveira
192693d82d fixed agent.py extra comma 2025-09-08 16:36:03 -03:00
Lucas Oliveira
d6bf6444e5 Merge remote-tracking branch 'origin/main' into feat/nudges 2025-09-08 16:25:59 -03:00
Edwin Jose
1e97ec693a Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 14:44:33 -04:00
Gabriel Luiz Freitas Almeida
b3dcac0cde Refactor environment configuration in EnvManager
This commit updates the EnvConfig class by renaming the flow ID variables to LANGFLOW_CHAT_FLOW_ID and LANGFLOW_INGEST_FLOW_ID for better clarity. It also modifies the environment variable writing logic to reflect these changes. Additionally, the import statements have been reorganized for improved readability. These updates contribute to a more robust and well-documented codebase.
2025-09-08 15:10:00 -03:00
Gabriel Luiz Freitas Almeida
e144f8f0ef update FLOW_ID variable 2025-09-08 15:10:00 -03:00
Eric Hare
b9da6437f8
Properly set the project root for the gdrive token 2025-09-08 11:08:45 -07:00
Edwin Jose
3cb379370e ingestion modes for the default files 2025-09-08 13:48:45 -04:00
Edwin Jose
64ea8b6567 Update task_service.py 2025-09-08 13:18:50 -04:00
Edwin Jose
87e31d98a4 Update task_service.py 2025-09-08 13:17:24 -04:00
Edwin Jose
975a4c214a Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 12:51:34 -04:00
Edwin Jose
9db16bc69c update to fix the env issue 2025-09-08 12:46:42 -04:00
Edwin Jose
dcd44017ce Update to langflow service to user logger correctly 2025-09-08 12:13:02 -04:00
Gabriel Luiz Freitas Almeida
d5166f4314 fix langflow file service change 2025-09-08 12:59:28 -03:00
Gabriel Luiz Freitas Almeida
503fa92788
Merge branch 'main' into ingestion-flow 2025-09-08 12:19:52 -03:00
Edwin Jose
5dd9959dd0
Merge branch 'ingestion-flow' into langflow-ingestion-modes 2025-09-08 10:38:31 -04:00
phact
8dc77298be logging 2025-09-08 10:30:18 -04:00