oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-03-10 07:34:00 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Fix exllamav3 ignoring the stop button

Browse source
This commit is contained in:
oobabooga 2025-09-19 16:12:50 -07:00
parent 005fcf3f98
commit 1e863a7113
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
modules/exllamav3.py
View file

@ -344,6 +344,9 @@ class Exllamav3Model:
try:
while self.generator.num_remaining_jobs():
if shared.stop_everything:
break
results = self.generator.iterate()
for result in results:
if "eos" in result and result["eos"]: