oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-06 16:50:11 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

revert incorrect eos_token_id change from #814 (#1261)

Browse source 
- fixes #1054
This commit is contained in:
kernyan 2023-04-16 00:47:01 -04:00 committed by GitHub
parent a2127239de
commit ac19d5101f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
modules/text_generation.py
View file

@ -209,7 +209,7 @@ def generate_reply(question, state, eos_token=None, stopping_strings=[]):
else:
for k in ['max_new_tokens', 'do_sample', 'temperature']:
generate_params[k] = state[k]
generate_params['stop'] = state['eos_token_ids'][-1]
generate_params['stop'] = eos_token_ids[-1]
if not shared.args.no_stream:
generate_params['max_new_tokens'] = 8