UI: Fix max_updates_second not working

This commit is contained in:
oobabooga 2025-04-30 14:54:05 -07:00
parent b46ca01340
commit cd5c32dc19

View file

@ -100,8 +100,6 @@ def _generate_reply(question, state, stopping_strings=None, is_chat=False, escap
last_update = cur_time
yield reply
yield reply
if stop_found or (state['max_tokens_second'] > 0 and shared.stop_everything):
break