oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-02-01 13:24:18 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Fix obtaining the maximum number of GPU layers for DeepSeek-R1-0528-GGUF

Browse source
This commit is contained in:
oobabooga 2025-06-19 12:30:57 -07:00
parent 3344510553
commit a1b606a6ac
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
modules/models_settings.py
View file

@ -77,7 +77,7 @@ def get_model_metadata(model):
model_settings['compress_pos_emb'] = metadata[k]
elif k.endswith('rope.scaling.factor'):
model_settings['compress_pos_emb'] = metadata[k]
elif k.endswith('block_count'):
elif k.endswith('.block_count'):
model_settings['gpu_layers'] = metadata[k] + 1
model_settings['max_gpu_layers'] = metadata[k] + 1