gmakstutis/ragflow
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
ragflow/web/src/assets/svg/llm
History
Alex Chen 7944aacafa
Feat: add gpustack model provider (#4469) 
### What problem does this PR solve?

Add GPUStack as a new model provider.
[GPUStack](https://github.com/gpustack/gpustack) is an open-source GPU
cluster manager for running LLMs. Currently, locally deployed models in
GPUStack cannot integrate well with RAGFlow. GPUStack provides both
OpenAI compatible APIs (Models / Chat Completions / Embeddings /
Speech2Text / TTS) and other APIs like Rerank. We would like to use
GPUStack as a model provider in ragflow.

[GPUStack Docs](https://docs.gpustack.ai/latest/quickstart/)

Related issue: https://github.com/infiniflow/ragflow/issues/4064.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)



### Testing Instructions
1. Install GPUStack and deploy the `llama-3.2-1b-instruct` llm, `bge-m3`
text embedding model, `bge-reranker-v2-m3` rerank model,
`faster-whisper-medium` Speech-to-Text model, `cosyvoice-300m-sft` in
GPUStack.
2. Add provider in ragflow settings.
3. Testing in ragflow.
2025-01-15 14:15:58 +08:00
..
anthropic.svg add support for Anthropic (#2148) 2024-08-29 13:30:06 +08:00
azure.svg update Minimax and Azure-Openai icon in setting page (#1420) 2024-07-08 17:55:04 +08:00
baai.svg feat: Add hint for operators, round to square, input variable, readable operator ID. #3056 (#3057) 2024-10-28 14:31:19 +08:00
baichuan.svg Added support for Baichuan LLM (#934) 2024-05-28 09:09:37 +08:00
bedrock.svg feat: add bedrock icon (#1430) 2024-07-08 19:14:25 +08:00
chat-minimax.svg update Minimax and Azure-Openai icon in setting page (#1420) 2024-07-08 17:55:04 +08:00
cohere.svg add support for cohere (#1849) 2024-08-07 18:40:51 +08:00
deepseek.svg feat: support DeepSeek (#667) 2024-05-08 10:30:18 +08:00
fish-audio.svg add support for TTS model (#2095) 2024-08-26 15:19:43 +08:00
gemini.svg Format file format from Windows/dos to Unix (#1949) 2024-08-15 09:17:36 +08:00
github.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00
google-cloud.svg add support for Google Cloud (#2175) 2024-09-02 12:06:41 +08:00
google.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00
gpustack.svg Feat: add gpustack model provider (#4469) 2025-01-15 14:15:58 +08:00
groq-next.svg fix: Minimax API is error! #1353 (#1585) 2024-07-18 12:09:25 +08:00
huggingface.svg add huggingface model (#2624) 2024-09-27 19:15:38 +08:00
hunyuan.svg add support for Tencent Hunyuan (#2015) 2024-08-20 15:27:13 +08:00
jina.svg feat: Replace the LocalAi icon #762 (#1875) 2024-08-09 10:09:10 +08:00
lepton-ai.svg add support for Voyage AI (#2159) 2024-08-29 16:14:49 +08:00
lm-studio.svg add support for LM Studio (#1663) 2024-07-24 12:46:43 +08:00
local-ai.svg feat: Replace the LocalAi icon #762 (#1875) 2024-08-09 10:09:10 +08:00
mistral.svg fix: add icon to MiniMax and Mistral #1353 (#1367) 2024-07-04 10:24:43 +08:00
moonshot.svg fix: When the component id is very long, the delete button of generate will be hidden #1906 (#1907) 2024-08-12 15:42:00 +08:00
nomic-ai.svg feat: Add hint for operators, round to square, input variable, readable operator ID. #3056 (#3057) 2024-10-28 14:31:19 +08:00
novita-ai.svg feat: Modify PerfXCloud name #1853 (#1931) 2024-08-13 18:49:33 +08:00
nvidia.svg add support for NVIDIA llm (#1645) 2024-07-23 10:43:09 +08:00
ollama.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00
open-router.svg feat: replace open-router.svg #1467 (#1538) 2024-07-16 17:11:37 +08:00
openai-api.svg add supprot for OpenAI-API-Compatible llm (#1787) 2024-08-06 16:20:21 +08:00
openai.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00
perfx-cloud.svg feat: Delete the file from the upload control of the message input box #1880 (#1946) 2024-08-15 09:19:17 +08:00
replicate.svg add support for Replicate (#1980) 2024-08-19 10:36:57 +08:00
sentence-transformers.svg feat: Add hint for operators, round to square, input variable, readable operator ID. #3056 (#3057) 2024-10-28 14:31:19 +08:00
siliconflow.svg add support for SILICONFLOW (#1926) 2024-08-13 16:09:10 +08:00
spark.svg add support for XunFei Spark (#2017) 2024-08-20 16:56:42 +08:00
stepfun.svg add support for StepFun (#1611) 2024-07-19 16:26:12 +08:00
tencent-cloud.svg add support for Tencent Cloud ASR (#2102) 2024-08-27 11:47:11 +08:00
together-ai.svg feat: Modify PerfXCloud name #1853 (#1931) 2024-08-13 18:49:33 +08:00
tongyi.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00
upstage.svg feat: Modify PerfXCloud name #1853 (#1931) 2024-08-13 18:49:33 +08:00
volc_engine.svg Add support for VolcEngine - the current version supports SDK2 (#885) 2024-05-23 11:15:29 +08:00
voyage.svg add support for Voyage AI (#2159) 2024-08-29 16:14:49 +08:00
wenxin.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00
xinference.svg feat: support Xinference (#319) 2024-04-11 18:17:45 +08:00
yi.svg add support for 01.AI (#1951) 2024-08-15 10:02:36 +08:00
yiyan.svg add support for Baidu yiyan (#2049) 2024-08-22 16:45:15 +08:00
youdao.svg feat: Add hint for operators, round to square, input variable, readable operator ID. #3056 (#3057) 2024-10-28 14:31:19 +08:00
zhipu.svg feat: add support for ollama #221 (#260) 2024-04-08 19:13:45 +08:00