oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-03-08 22:53:51 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
text-generation-webui/modules
History
oobabooga 8d43123f73 API: Fix function calling for Qwen, Mistral, GPT-OSS, and other models 
The tool call response parser only handled JSON-based formats, causing
tool_calls to always be empty for models that use non-JSON formats.

Add parsers for three additional tool call formats:
- Qwen3.5: <tool_call><function=name><parameter=key>value</parameter>
- Mistral/Devstral: functionName{"arg": "value"}
- GPT-OSS: <|channel|>commentary to=functions.name<|message|>{...}

Also fix multi-turn tool conversations crashing with Jinja2
UndefinedError on tool_call_id by preserving tool_calls and
tool_call_id metadata through the chat history conversion.
2026-03-06 00:55:33 -03:00
..
grammar Handle both int and str types in grammar char processing 2025-07-23 11:52:51 -07:00
callbacks.py fix: replace bare except clauses with except Exception (#7400) 2026-03-04 18:06:17 -03:00
chat.py API: Fix function calling for Qwen, Mistral, GPT-OSS, and other models 2026-03-06 00:55:33 -03:00
evaluate.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
exllamav3.py API: Add parallel request support for llama.cpp and ExLlamaV3 2026-03-05 16:49:58 -08:00
exllamav3_hf.py ExLlamav3_HF: Optimize prefill and fix CFG cache initialization 2026-03-04 11:09:58 -08:00
extensions.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
html_generator.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
image_models.py Image: Quantize the text encoder for lower VRAM 2025-12-05 13:08:46 -08:00
image_utils.py Image generation: Safer image uploading 2025-12-03 16:07:51 -08:00
llama_cpp_server.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
loaders.py TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support 2026-03-05 18:09:45 -08:00
logging_colors.py Lint 2023-12-19 21:36:57 -08:00
logits.py Remove ExLlamaV2 backend 2026-03-05 14:02:13 -08:00
LoRA.py Remove ExLlamaV2 backend 2026-03-05 14:02:13 -08:00
metadata_gguf.py fix: replace bare except clauses with except Exception (#7400) 2026-03-04 18:06:17 -03:00
models.py TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support 2026-03-05 18:09:45 -08:00
models_settings.py Remove ExLlamaV2 backend 2026-03-05 14:02:13 -08:00
presets.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
prompts.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
sampler_hijack.py Add adaptive-p sampler and n-gram speculative decoding support 2026-03-04 09:41:29 -08:00
sane_markdown_lists.py Disable uncommonly used indented codeblocks (#7401) 2026-03-04 17:51:00 -03:00
shared.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
tensorrt_llm.py TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support 2026-03-05 18:09:45 -08:00
text_generation.py TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support 2026-03-05 18:09:45 -08:00
torch_utils.py Remove obsolete DeepSpeed inference code (2023 relic) 2026-03-04 17:20:34 -08:00
training.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
transformers_loader.py Remove obsolete DeepSpeed inference code (2023 relic) 2026-03-04 17:20:34 -08:00
ui.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_chat.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_default.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_file_saving.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_image_generation.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_model_menu.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_notebook.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_parameters.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_session.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
utils.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
web_search.py Fix web search (attempt) 2025-08-14 12:05:14 -07:00