oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-24 01:20:33 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Small change to the unload_model() function

Browse source
This commit is contained in:
oobabooga 2025-04-20 20:00:56 -07:00
parent c178ea02fe
commit 86c3ed3218
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
modules/models.py
View file

@ -131,6 +131,9 @@ def TensorRT_LLM_loader(model_name):
def unload_model(keep_model_name=False):
if shared.model is None:
return
is_llamacpp = (shared.model.__class__.__name__ == 'LlamaServer')
shared.model = shared.tokenizer = None