oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-07 23:53:40 +00:00
Code Issues Projects Releases Packages Wiki Activity

API: add instruction_template support to the model load endpoint

Browse source
This commit is contained in:
oobabooga 2026-04-06 07:02:53 -07:00
parent 4d6230a944
commit c26ffdd24c
5 changed files with 38 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

5
modules/api/script.py
View file

@ -487,6 +487,11 @@ async def handle_load_model(request_data: LoadModelRequest):
Loader args are reset to their startup defaults between loads, so
settings from a previous load do not leak into the next one.
The "instruction_template" parameter sets the default instruction
template by name (from user_data/instruction-templates/). The
"instruction_template_str" parameter sets it as a raw Jinja2 string
and takes precedence over "instruction_template".
'''
try: