mirror of
https://github.com/oobabooga/text-generation-webui.git
synced 2026-03-07 22:23:51 +01:00
20 lines
983 B
Markdown
20 lines
983 B
Markdown
## What Works
|
|
|
|
| Loader | Loading LoRAs | Training LoRAs | Multimodal | Perplexity evaluation |
|
|
|----------------|---------------|----------------|------------|-----------------------|
|
|
| llama.cpp | ❌ | ❌ | ✅\* | ❌ |
|
|
| Transformers | ✅ | ✅ | ✅\*\* | ✅ |
|
|
| ExLlamav3_HF | ❌ | ❌ | ❌ | ✅ |
|
|
| ExLlamav3 | ❌ | ❌ | ✅ | ❌ |
|
|
| ExLlamav2_HF | ✅ | ❌ | ❌ | ✅ |
|
|
| ExLlamav2 | ✅ | ❌ | ❌ | ❌ |
|
|
| TensorRT-LLM | ❌ | ❌ | ❌ | ❌ |
|
|
|
|
❌ = not supported
|
|
|
|
✅ = supported
|
|
|
|
\* Via the `mmproj` parameter (multimodal projector file).
|
|
|
|
\*\* Via the `send_pictures` extension.
|