Update env.examples
This commit is contained in:
parent
c8a17f7ea5
commit
87f1b47218
1 changed files with 1 additions and 1 deletions
|
|
@ -176,7 +176,7 @@ LLM_BINDING_API_KEY=your_api_key
|
||||||
|
|
||||||
### OpenAI Compatible API Specific Parameters
|
### OpenAI Compatible API Specific Parameters
|
||||||
### Set the max_tokens to mitigate endless output of some LLM (less than LLM_TIMEOUT * llm_output_tokens/second, i.e. 9000 = 180s * 50 tokens/s)
|
### Set the max_tokens to mitigate endless output of some LLM (less than LLM_TIMEOUT * llm_output_tokens/second, i.e. 9000 = 180s * 50 tokens/s)
|
||||||
### Typically, max_tokens does not include prompt content, though some models, such as Gemini-2.5-Flash, are exceptions
|
### Typically, max_tokens does not include prompt content, though some models, such as Gemini Models, are exceptions
|
||||||
#### OpenAI's new API utilizes max_completion_tokens instead of max_tokens
|
#### OpenAI's new API utilizes max_completion_tokens instead of max_tokens
|
||||||
# OPENAI_LLM_MAX_TOKENS=9000
|
# OPENAI_LLM_MAX_TOKENS=9000
|
||||||
# OPENAI_LLM_MAX_COMPLETION_TOKENS=9000
|
# OPENAI_LLM_MAX_COMPLETION_TOKENS=9000
|
||||||
|
|
|
||||||
Loading…
Add table
Reference in a new issue