oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2025-12-06 07:12:10 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Default ctx-size to 8192 when not found in the metadata

Browse source
This commit is contained in:
oobabooga 2025-08-11 07:39:53 -07:00
parent 52d1cbbbe9
commit 38c0b4a1ad
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
modules/models_settings.py
View file

@ -15,7 +15,7 @@ from modules.logging_colors import logger
def get_fallback_settings(): def get_fallback_settings():
return { return {
'bf16': False, 'bf16': False,
'ctx_size': 2048, 'ctx_size': 8192,
'rope_freq_base': 0, 'rope_freq_base': 0,
'compress_pos_emb': 1, 'compress_pos_emb': 1,
'alpha_value': 1, 'alpha_value': 1,