oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-04 14:17:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add multimodal support (ExLlamaV3) (#7174)

Browse source
This commit is contained in:
Katehuuh 2025-08-09 04:31:16 +02:00 • committed by GitHub
parent b391ac8eb1
commit 88127f46c1
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
13 changed files with 726 additions and 55 deletions
Download patch file Download diff file Expand all files Collapse all files

18
docs/12 - OpenAI API.md
View file

@ -77,6 +77,24 @@ curl http://127.0.0.1:5000/v1/chat/completions \
}'
```
#### Multimodal support (ExLlamaV3)
```shell
curl http://127.0.0.1:5000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"messages": [
{
"role": "user",
"content": [
{"type": "text", "text": "What color is this image?"},
{"type": "image_url", "image_url": {"url": "https://github.com/turboderp-org/exllamav3/blob/master/examples/media/cat.png?raw=true"}}
]
}
]
}'
```
#### SSE streaming
```shell