mirror of
https://github.com/oobabooga/text-generation-webui.git
synced 2026-03-09 15:13:56 +01:00
2f08dce7b0
- archived upstream: 7dc12af3a8
- replaced by ExLlamaV3, which has much better quantization accuracy
18 lines
797 B
Markdown
18 lines
797 B
Markdown
## What Works
|
|
|
|
| Loader | Loading LoRAs | Training LoRAs | Multimodal | Perplexity evaluation |
|
|
|----------------|---------------|----------------|------------|-----------------------|
|
|
| llama.cpp | ❌ | ❌ | ✅\* | ❌ |
|
|
| Transformers | ✅ | ✅ | ✅\*\* | ✅ |
|
|
| ExLlamav3_HF | ❌ | ❌ | ❌ | ✅ |
|
|
| ExLlamav3 | ❌ | ❌ | ✅ | ❌ |
|
|
| TensorRT-LLM | ❌ | ❌ | ❌ | ❌ |
|
|
|
|
❌ = not supported
|
|
|
|
✅ = supported
|
|
|
|
\* Via the `mmproj` parameter (multimodal projector file).
|
|
|
|
\*\* Via the `send_pictures` extension.
|