oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-03-18 03:14:39 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
text-generation-webui/modules
History
oobabooga fb1b3b6ddf API: Rewrite logprobs for OpenAI spec compliance across all backends 
- Rewrite logprobs output format to match the OpenAI specification for
  both chat completions and completions endpoints
- Fix top_logprobs count being ignored for llama.cpp and ExLlamav3
  backends in chat completions (always returned 1 instead of requested N)
- Fix non-streaming responses only returning logprobs for the last token
  instead of all generated tokens (affects all HF-based loaders)
- Fix logprobs returning null for non-streaming chat requests on HF loaders
- Fix off-by-one returning one extra top alternative on HF loaders
2026-03-12 14:17:32 -03:00
..
grammar Handle both int and str types in grammar char processing 2025-07-23 11:52:51 -07:00
callbacks.py fix: replace bare except clauses with except Exception (#7400) 2026-03-04 18:06:17 -03:00
chat.py UI: Fix stale tool_sequence after edit and chat-instruct tool rendering 2026-03-12 13:12:18 -03:00
evaluate.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
exllamav3.py Add native logit_bias and logprobs support for ExLlamav3 2026-03-10 11:03:25 -03:00
exllamav3_hf.py Fix ExLlamaV3 EOS handling, load order, and perplexity evaluation 2026-03-09 23:56:38 -03:00
extensions.py Refactor to not import gradio in --nowebui mode 2026-03-09 19:29:24 -07:00
html_generator.py Handle Qwen 3.5 thinking blocks 2026-03-06 19:01:28 -08:00
image_models.py Image: Quantize the text encoder for lower VRAM 2025-12-05 13:08:46 -08:00
image_utils.py Image generation: Safer image uploading 2025-12-03 16:07:51 -08:00
llama_cpp_server.py Forward logit_bias, logprobs, and n to llama.cpp backend 2026-03-10 10:41:45 -03:00
loaders.py Add missing custom_token_bans to llama.cpp and reasoning_effort to ExLlamav3 2026-03-10 09:58:00 -03:00
logging_colors.py Lint 2023-12-19 21:36:57 -08:00
logits.py Remove ExLlamaV2 backend 2026-03-05 14:02:13 -08:00
LoRA.py Remove ExLlamaV2 backend 2026-03-05 14:02:13 -08:00
metadata_gguf.py fix: replace bare except clauses with except Exception (#7400) 2026-03-04 18:06:17 -03:00
models.py Several small fixes 2026-03-06 16:52:13 -03:00
models_settings.py Refactor to not import gradio in --nowebui mode 2026-03-09 19:29:24 -07:00
paths.py Portable mode: always use ../user_data if it exists 2026-03-06 18:04:48 -08:00
presets.py API: Add command-line flags to override default generation parameters 2026-03-06 01:36:45 -03:00
prompts.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
sampler_hijack.py Add adaptive-p sampler and n-gram speculative decoding support 2026-03-04 09:41:29 -08:00
sane_markdown_lists.py Disable uncommonly used indented codeblocks (#7401) 2026-03-04 17:51:00 -03:00
shared.py UI: Fix stale tool_sequence after edit and chat-instruct tool rendering 2026-03-12 13:12:18 -03:00
tensorrt_llm.py TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support 2026-03-05 18:09:45 -08:00
text_generation.py API: Rewrite logprobs for OpenAI spec compliance across all backends 2026-03-12 14:17:32 -03:00
tool_use.py Initial tool-calling support in the UI 2026-03-12 01:16:19 -03:00
torch_utils.py Remove obsolete DeepSpeed inference code (2023 relic) 2026-03-04 17:20:34 -08:00
training.py Add guard against training with llama.cpp loader 2026-03-08 10:47:59 -03:00
transformers_loader.py API: Rewrite logprobs for OpenAI spec compliance across all backends 2026-03-12 14:17:32 -03:00
ui.py Initial tool-calling support in the UI 2026-03-12 01:16:19 -03:00
ui_chat.py Add tools refresh button and _tool_turn comment 2026-03-12 01:36:07 -03:00
ui_default.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_file_saving.py Security: prevent path traversal in character/user/file save and delete 2026-03-06 02:00:10 -03:00
ui_image_generation.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_model_menu.py llama.cpp: Add --fit-target param 2026-03-06 01:55:48 -03:00
ui_notebook.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
ui_parameters.py Use a new gr.DragDrop element for Sampler priority + update gradio 2026-03-11 19:35:12 -03:00
ui_session.py Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data 2026-03-05 19:31:10 -08:00
utils.py Training: Optimize _peek_json_keys to avoid loading entire file into memory 2026-03-06 15:39:08 -08:00
web_search.py Fix web search (attempt) 2025-08-14 12:05:14 -07:00