oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-03-06 05:33:50 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Fix the logits API endpoint with transformers

Browse source
This commit is contained in:
oobabooga 2026-03-04 10:41:47 -08:00
parent 22141679e3
commit 64eb77e782
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
modules/logits.py
View file

@ -84,6 +84,7 @@ def _get_next_logits(prompt, state, use_samplers, previous, top_logits=25, retur
state['max_new_tokens'] = 1
state['auto_max_new_tokens'] = False
state.setdefault('stream', True)
for _ in generate_reply(prompt, state):
pass