oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-09 18:21:43 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Don't pass torch_dtype to transformers loader, let it be autodetected

Browse source
This commit is contained in:
oobabooga 2025-08-05 11:35:53 -07:00
parent 3039aeffeb
commit 3b28dc1821
1 changed files with 0 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
modules/transformers_loader.py
View file

@ -136,7 +136,6 @@ def load_model_HF(model_name):
path_to_model = Path(f'{shared.args.model_dir}/{model_name}')
params = {
'low_cpu_mem_usage': True,
'torch_dtype': torch.bfloat16 if shared.args.bf16 else torch.float16,
'attn_implementation': shared.args.attn_implementation,
}