S0b3Rr 5d21cc3660 fix: Fix the problem that concurrent execution limit in task executor fails and causes OOM (issue#7580) (#7700) ... ### What problem does this PR solve? ## Cause of the bug: During the execution process, due to improper use of trio CapacityLimiter, the configuration parameter MAX_CONCURRENT_TASKS is invalid, causing the executor to take out a large number of tasks from the Redis queue at one time. This behavior will cause the task executor to occupy too much memory and be killed by the OS when a large number of tasks exist at the same time. As a result, all executing tasks are suspended. ## Fix: Added the task_manager method to the entry of /rag/svr/task_executor.py to make CapacityLimiter effective. Deleted the invalid async with statement. ## Fix result: After testing, the task executor execution meets expectations, that is: concurrent execution of up to $MAX_CONCURRENT_TASKS tasks. ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) - [ ] New Feature (non-breaking change which adds functionality) - [ ] Documentation Update - [ ] Refactoring - [ ] Performance Improvement - [ ] Other (please describe):		2025-05-19 10:25:56 +08:00
..
cache_file_svr.py	Format: dos2unix (#4467)	2025-01-13 18:19:01 +08:00
discord_svr.py	Use consistent log file names, introduced initLogger (#3403)	2024-11-14 17:13:48 +08:00
jina_server.py	Update comments (#4569)	2025-01-21 20:52:28 +08:00
task_executor.py	fix: Fix the problem that concurrent execution limit in task executor fails and causes OOM (issue#7580) (#7700)	2025-05-19 10:25:56 +08:00