oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-10 00:53:39 +00:00
Code Issues Projects Releases Packages Wiki Activity

Add adaptive-p sampler and n-gram speculative decoding support

Browse source
This commit is contained in:
oobabooga 2026-03-04 09:41:29 -08:00
parent f010aa1612
commit 65de4c30c8
10 changed files with 145 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
modules/text_generation.py
View file

@ -317,6 +317,8 @@ def generate_reply_HF(question, original_question, state, stopping_strings=None,
'tfs',
'top_a',
'top_n_sigma',
'adaptive_target',
'adaptive_decay',
'dry_multiplier',
'dry_allowed_length',
'dry_base',