oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-04 22:27:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Remove ExLlamaV2 backend

Browse source 
- archived upstream: 7dc12af3a8
- replaced by ExLlamaV3, which has much better quantization accuracy
This commit is contained in:
oobabooga 2026-03-05 13:57:21 -08:00
parent 134ac8fc29
commit 2f08dce7b0
19 changed files with 22 additions and 713 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/What Works.md
View file

@ -6,8 +6,6 @@
| Transformers | ✅ | ✅ | ✅\*\* | ✅ |
| ExLlamav3_HF | ❌ | ❌ | ❌ | ✅ |
| ExLlamav3 | ❌ | ❌ | ✅ | ❌ |
| ExLlamav2_HF | ✅ | ❌ | ❌ | ✅ |
| ExLlamav2 | ✅ | ❌ | ❌ | ❌ |
| TensorRT-LLM | ❌ | ❌ | ❌ | ❌ |
❌ = not supported