ragflow/api/db
Fakai Zhao de839fc3f0
optimize srv broker and executor logic (#630)
### What problem does this PR solve?

Optimize task broker and executor for reduce memory usage and deployment
complexity.

### Type of change
- [x] Performance Improvement
- [x] Refactoring

### Change Log
- Enhance redis utils for message queue(use stream)
- Modify task broker logic via message queue (1.get parse event from
message queue 2.use ThreadPoolExecutor async executor )
- Modify the table column name of document and task (process_duation ->
process_duration maybe just a spelling mistake)
- Reformat some code style(just what i see)
- Add requirement_dev.txt for developer
- Add redis container on docker compose

---------

Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2024-05-07 11:43:33 +08:00
..
services optimize srv broker and executor logic (#630) 2024-05-07 11:43:33 +08:00
__init__.py Refactor: Use TaskStatus enum for task status handling (#646) 2024-05-06 18:39:17 +08:00
db_models.py add file management feature (#560) 2024-04-26 17:21:53 +08:00
db_utils.py apply pep8 formalize (#155) 2024-03-27 11:33:46 +08:00
init_data.py fix youdao bug (#551) 2024-04-26 09:58:22 +08:00
operatioins.py apply pep8 formalize (#155) 2024-03-27 11:33:46 +08:00
reload_config_base.py apply pep8 formalize (#155) 2024-03-27 11:33:46 +08:00
runtime_config.py apply pep8 formalize (#155) 2024-03-27 11:33:46 +08:00