oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-06 07:03:37 +00:00
Code Issues Projects Releases Packages Wiki Activity
5509 commits 2 branches 100 tags 140 MiB
Commit graph

2169 commits

Author SHA1 Message Date
oobabooga
95d6c53e13 Revert "API: Add warning about vanilla llama-server not supporting prompt logprobs + instructions" 
This reverts commit 42dfcdfc5b.
 2026-04-03 07:30:48 -07:00
oobabooga
66d1a22c73 Fix crash when no model is selected (None passed to resolve_model_path) 2026-04-03 05:56:36 -07:00
oobabooga
000d776967 Revert "llama.cpp: Disable jinja by default (we use Python jinja, not cpp jinja)" 
This reverts commit a1cb5b5dc0.
 2026-04-03 05:49:03 -07:00
oobabooga
a1cb5b5dc0 llama.cpp: Disable jinja by default (we use Python jinja, not cpp jinja) 
This was causing template compilation issues with qwen models.
 2026-04-02 21:56:40 -07:00
oobabooga
42dfcdfc5b API: Add warning about vanilla llama-server not supporting prompt logprobs + instructions 2026-04-02 20:46:27 -07:00
oobabooga
6e2b70bde6 Add Gemma 4 tool-calling support 2026-04-02 20:26:27 -07:00
oobabooga
b108c55353 Fix portable builds not starting due to missing ik element 2026-04-02 19:14:50 -07:00
oobabooga
7aab2fdf9a API: Improve cache clearing in logprobs 2026-04-02 17:50:42 -07:00
oobabooga
091037ec20 Fix top_logprobs_ids missing for llama.cpp loader 2026-04-02 16:13:45 -03:00
oobabooga
ea1f8c71f2 API: Optimize prompt logprobs and refactor ExLlamav3 forward pass 2026-04-02 14:31:11 -03:00
oobabooga
c10c6e87ae API: Add token ids to logprobs output 2026-04-02 07:17:27 -07:00
oobabooga
a32ce254f2 Don't pass torch_dtype to transformers, autodetect from model config 2026-04-02 00:44:14 -03:00
oobabooga
4073164be0 Fix ExLlamav3 OOM on prompt logprobs and qwen3_5_moe HF compat 2026-04-01 19:44:55 -07:00
oobabooga
71c1a52afe API: Implement echo + logprobs for /v1/completions endpoint 2026-03-31 07:43:11 -07:00
oobabooga
6382fbef83 Several small code simplifications 2026-03-30 19:36:03 -07:00
oobabooga
0466b6e271 ik_llama.cpp: Auto-enable Hadamard KV cache rotation with quantized cache 2026-03-29 15:52:36 -07:00
oobabooga
4979e87e48 Add ik_llama.cpp support via ik_llama_cpp_binaries package 2026-03-28 12:09:00 -03:00
oobabooga
9dd04b86ce Suppress EOS token at logit level for ExLlamav3 when ban_eos_token is set 2026-03-28 06:17:57 -07:00
oobabooga
bda95172bd Fix stopping string detection for chromadb/context-1 2026-03-28 06:09:53 -07:00
oobabooga
4cbea02ed4 Add ik_llama.cpp support via --ik flag 2026-03-26 06:54:47 -07:00
oobabooga
e154140021 Rename "truncation length" to "context length" in logs 2026-03-25 07:21:02 -07:00
oobabooga
368f37335f Fix --idle-timeout issues with encode/decode and parallel generation 2026-03-25 06:37:45 -07:00
oobabooga
d6f1485dd1 UI: Update the enable_thinking info message 2026-03-24 21:45:11 -07:00
oobabooga
807be11832 Remove obsolete models/config.yaml and related code 2026-03-24 18:48:50 -07:00
oobabooga
750502695c Fix GPT-OSS tool-calling after 9ec20d97 2026-03-24 11:39:24 -07:00
oobabooga
a7ef430b38 Revert "llama.cpp: Don't suppress llama-server logs" 
This reverts commit 9488df3e48.
 2026-03-23 20:22:51 -07:00
oobabooga
286bbb685d Revert "Follow-up to previous commit" 
This reverts commit 1dda5e4711.
 2026-03-23 20:22:46 -07:00
oobabooga
02f18a1d65 API: Add thinking block signature field, fix error codes, clean up logging 2026-03-23 07:06:38 -07:00
oobabooga
307d0c92be UI polish 2026-03-23 06:35:14 -07:00
oobabooga
9ec20d9730 Strip thinking blocks before tool-call parsing 2026-03-22 19:19:14 -07:00
Phrosty1
bde496ea5d
Fix prompt corruption when continuing with context truncation (#7439) 2026-03-22 21:48:56 -03:00
oobabooga
1dda5e4711 Follow-up to previous commit 2026-03-21 20:58:45 -07:00
oobabooga
9488df3e48 llama.cpp: Don't suppress llama-server logs 2026-03-21 20:47:26 -07:00
oobabooga
2c4f364339 Update API docs to mention Anthropic support 2026-03-21 18:38:11 -07:00
oobabooga
f2c909725e API: Use top_p=0.95 by default 2026-03-21 11:11:09 -07:00
oobabooga
0216893475 API: Add Anthropic-compatible /v1/messages endpoint 2026-03-20 20:38:55 -07:00
oobabooga
f0e3997f37 Add missing __init__.py to modules/grammar 2026-03-20 16:04:57 -03:00
oobabooga
7c79143a14 API: Fix _start_cloudflared raising after first attempt instead of exhausting retries 2026-03-20 15:03:49 -03:00
oobabooga
1a910574c3 API: Fix debug_msg truthy check for OPENEDAI_DEBUG=0 2026-03-20 14:57:01 -03:00
oobabooga
bf6fbc019d API: Move OpenAI-compatible API from extensions/openai to modules/api 2026-03-20 14:46:00 -03:00
oobabooga
2e4232e02b Minor cleanup 2026-03-20 07:20:26 -07:00
oobabooga
e0e20ab9e7 Minor cleanup across multiple modules 2026-03-19 08:02:23 -07:00
oobabooga
dde1764763 Cleanup modules/chat.py 2026-03-18 21:12:14 -07:00
oobabooga
779e7611ff Use logger.exception() instead of traceback.print_exc() for error messages 2026-03-18 20:42:20 -07:00
oobabooga
ca36bd6eb6 API: Remove leading spaces from post-reasoning content 2026-03-18 07:36:11 -07:00
oobabooga
fef2bd8630 UI: Fix the instruction template delete dialog not appearing 2026-03-17 22:52:32 -07:00
oobabooga
c8bb2129ba Security: server-side file save roots, image URL SSRF protection, extension allowlist 2026-03-17 22:29:35 -07:00
oobabooga
08ff3f0f90 Merge remote-tracking branch 'refs/remotes/origin/dev' into dev 2026-03-17 19:52:24 -07:00
oobabooga
7e54e7b7ae llama.cpp: Support literal flags in --extra-flags (e.g. --rpc, --jinja) 
The old format is still accepted for backwards compatibility.
 2026-03-17 19:47:55 -07:00
oobabooga
2a6b1fdcba Fix --extra-flags breaking short long-form-only flags like --rpc 
Closes #7357
 2026-03-17 18:29:15 -07:00