ragflow/rag
Sol 0d7cfce6e1
Update rag/nlp/query.py (#7816)
### What problem does this PR solve?
Fix tokenizer resulting in low recall

![37743d3a495f734aa69f1e173fa77457](https://github.com/user-attachments/assets/1394757e-8fcb-4f87-96af-a92716144884)

![4aba633a17f34269a4e17e84fafb34c4](https://github.com/user-attachments/assets/a1828e32-3e17-4394-a633-ba3f09bd506d)

![image](https://github.com/user-attachments/assets/61308f32-2a4f-44d5-a034-d65bbec554ef)



### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring

---------

Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2025-05-23 17:13:37 +08:00
..
app Fix: docx get image exception. (#7636) 2025-05-14 12:24:48 +08:00
llm Feat: Support tool calling in Generate component (#7572) 2025-05-16 16:32:19 +08:00
nlp Update rag/nlp/query.py (#7816) 2025-05-23 17:13:37 +08:00
res Format file format from Windows/dos to Unix (#1949) 2024-08-15 09:17:36 +08:00
svr Fix: improve task cancel lag (#7765) 2025-05-22 09:28:08 +08:00
utils Fix: whole knowledge graph lost after removing any document in the knowledge base (#7151) 2025-04-30 09:43:17 +08:00
__init__.py Update comments (#4569) 2025-01-21 20:52:28 +08:00
benchmark.py Refactor embedding batch_size (#3825) 2024-12-03 16:22:39 +08:00
prompts.py Fix: docx get image exception. (#7636) 2025-05-14 12:24:48 +08:00
raptor.py <think> tag is missing. (#7256) 2025-04-24 11:44:10 +08:00
settings.py Feat: Adds OpenSearch2.19.1 as the vector_database support (#7140) 2025-04-24 16:03:31 +08:00