oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-20 22:13:43 +00:00
Code Issues Projects Releases Packages Wiki Activity

Add the top N-sigma sampler (#6796)

Browse source
This commit is contained in:
oobabooga 2025-03-14 16:45:11 -03:00 • committed by GitHub
parent 677d74a6a0
commit 5bcd2d7ad0
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 60 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
extensions/openai/typing.py
View file

@ -21,6 +21,7 @@ class GenerationOptions(BaseModel):
eta_cutoff: float = 0
tfs: float = 1
top_a: float = 0
top_n_sigma: float = 0
dry_multiplier: float = 0
dry_allowed_length: int = 2
dry_base: float = 1.75