oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-18 14:40:53 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Small change

Browse source
This commit is contained in:
oobabooga 2025-06-17 07:49:24 -07:00
parent 87ae09ecd6
commit 73138a29fa
1 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
docs/12 - OpenAI API.md
View file

@ -134,9 +134,9 @@ curl -k http://127.0.0.1:5000/v1/internal/model/load \
-d '{
"model_name": "Qwen_Qwen3-0.6B-Q4_K_M.gguf",
"args": {
"ctx_size": 32768,
"flash_attn": true,
"cache_type": "q8_0"
"ctx_size": 32768,
"flash_attn": true,
"cache_type": "q8_0"
}
}'
```