text-generation-webui/docs/What Works.md

18 lines
797 B
Markdown
Raw Normal View History

2023-10-22 00:15:54 +02:00
## What Works
| Loader | Loading LoRAs | Training LoRAs | Multimodal | Perplexity evaluation |
|----------------|---------------|----------------|------------|-----------------------|
| llama.cpp | ❌ | ❌ | ✅\* | ❌ |
| Transformers | ✅ | ✅ | ✅\*\* | ✅ |
| ExLlamav3_HF | ❌ | ❌ | ❌ | ✅ |
| ExLlamav3 | ❌ | ❌ | ✅ | ❌ |
| TensorRT-LLM | ❌ | ❌ | ❌ | ❌ |
2023-10-22 00:15:54 +02:00
❌ = not supported
2023-10-22 00:15:54 +02:00
✅ = supported
2023-10-22 00:15:54 +02:00
\* Via the `mmproj` parameter (multimodal projector file).
2023-10-22 00:15:54 +02:00
\*\* Via the `send_pictures` extension.