2023-10-22 00:15:54 +02:00
|
|
|
## What Works
|
|
|
|
|
|
2026-03-05 16:46:21 +01:00
|
|
|
| Loader | Loading LoRAs | Training LoRAs | Multimodal | Perplexity evaluation |
|
|
|
|
|
|----------------|---------------|----------------|------------|-----------------------|
|
|
|
|
|
| llama.cpp | ❌ | ❌ | ✅\* | ❌ |
|
|
|
|
|
| Transformers | ✅ | ✅ | ✅\*\* | ✅ |
|
|
|
|
|
| ExLlamav3_HF | ❌ | ❌ | ❌ | ✅ |
|
|
|
|
|
| ExLlamav3 | ❌ | ❌ | ✅ | ❌ |
|
|
|
|
|
| TensorRT-LLM | ❌ | ❌ | ❌ | ❌ |
|
2023-10-22 00:15:54 +02:00
|
|
|
|
2026-03-05 16:46:21 +01:00
|
|
|
❌ = not supported
|
2023-10-22 00:15:54 +02:00
|
|
|
|
2026-03-05 16:46:21 +01:00
|
|
|
✅ = supported
|
2023-10-22 00:15:54 +02:00
|
|
|
|
2026-03-05 16:46:21 +01:00
|
|
|
\* Via the `mmproj` parameter (multimodal projector file).
|
2023-10-22 00:15:54 +02:00
|
|
|
|
2026-03-05 16:46:21 +01:00
|
|
|
\*\* Via the `send_pictures` extension.
|