ragflow/rag
Jin Hai 996c94a8e7
Move clk100k_base tokenizer to docker image (#3411)
### What problem does this PR solve?

Move the tiktoken of cl100k_base into docker image

issue: #3338 

### Type of change

- [x] Refactoring

Signed-off-by: jinhai <haijin.chn@gmail.com>
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2024-11-15 10:18:40 +08:00
..
app Use consistent log file names, introduced initLogger (#3403) 2024-11-14 17:13:48 +08:00
llm Use consistent log file names, introduced initLogger (#3403) 2024-11-14 17:13:48 +08:00
nlp fix: synonym bug (#3423) 2024-11-15 10:14:51 +08:00
res Format file format from Windows/dos to Unix (#1949) 2024-08-15 09:17:36 +08:00
svr Use consistent log file names, introduced initLogger (#3403) 2024-11-14 17:13:48 +08:00
utils Move clk100k_base tokenizer to docker image (#3411) 2024-11-15 10:18:40 +08:00
__init__.py build python version rag-flow (#21) 2024-01-15 08:46:22 +08:00
benchmark.py fix: synonym bug (#3423) 2024-11-15 10:14:51 +08:00
raptor.py Use consistent log file names, introduced initLogger (#3403) 2024-11-14 17:13:48 +08:00
settings.py Rework logging (#3358) 2024-11-12 17:35:13 +08:00