5521 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
oobabooga	b5afecc63b	Merge pull request #7464 from oobabooga/dev ... Merge dev branch	2026-04-04 00:56:02 -03:00
oobabooga	2fbaee58cd	Add Windows + ROCm portable builds	2026-04-03 20:54:28 -07:00
oobabooga	62e67adb55	Merge pull request #7463 from oobabooga/dev ... Merge dev branch	2026-04-03 20:58:32 -03:00
oobabooga	fc35acab9b	API: Fix tool call parser crash on non-dict JSON output	2026-04-03 16:56:15 -07:00
oobabooga	8ecdb41078	fix(security): sanitize filenames in all prompt file operations (CWE-22) (#7462) ... --------- Co-authored-by: Alex Chen <ffulbtech@gmail.com>	2026-04-03 19:36:50 -03:00
oobabooga	5fb8c4fbd6	Update the custom gradio wheels	2026-04-03 11:02:00 -07:00
oobabooga	0050a33f37	Merge pull request #7461 from oobabooga/dev ... Merge dev branch	2026-04-03 14:07:42 -03:00
oobabooga	6b66da84d2	Update the custom gradio wheels	2026-04-03 10:01:51 -07:00
oobabooga	8e8e1ba898	Update the custom gradio wheels	2026-04-03 09:50:15 -07:00
oobabooga	131a9a0140	Update llama.cpp	2026-04-03 09:15:03 -07:00
oobabooga	95d6c53e13	Revert "API: Add warning about vanilla llama-server not supporting prompt logprobs + instructions" ... This reverts commit 42dfcdfc5b.	2026-04-03 07:30:48 -07:00
oobabooga	8bba9ecc3f	Update the custom gradio wheels	2026-04-03 05:58:05 -07:00
oobabooga	66d1a22c73	Fix crash when no model is selected (None passed to resolve_model_path)	2026-04-03 05:56:36 -07:00
oobabooga	000d776967	Revert "llama.cpp: Disable jinja by default (we use Python jinja, not cpp jinja)" ... This reverts commit a1cb5b5dc0.	2026-04-03 05:49:03 -07:00
oobabooga	a1cb5b5dc0	llama.cpp: Disable jinja by default (we use Python jinja, not cpp jinja) ... This was causing template compilation issues with qwen models.	2026-04-02 21:56:40 -07:00
oobabooga	b11379f328	Merge pull request #7455 from oobabooga/dev ... Merge dev branch	2026-04-03 00:50:06 -03:00
oobabooga	42dfcdfc5b	API: Add warning about vanilla llama-server not supporting prompt logprobs + instructions	2026-04-02 20:46:27 -07:00
oobabooga	6e2b70bde6	Add Gemma 4 tool-calling support	2026-04-02 20:26:27 -07:00
oobabooga	9374a4e70d	Merge pull request #7453 from oobabooga/dev ... Merge dev branch	2026-04-02 23:15:51 -03:00
oobabooga	b108c55353	Fix portable builds not starting due to missing ik element	2026-04-02 19:14:50 -07:00
oobabooga	ae699ac570	Merge pull request #7452 from oobabooga/dev ... Merge dev branch	2026-04-02 22:18:46 -03:00
oobabooga	7aab2fdf9a	API: Improve cache clearing in logprobs	2026-04-02 17:50:42 -07:00
oobabooga	d84157403a	Update the custom gradio wheels	2026-04-02 17:31:44 -07:00
oobabooga	a61bde509f	Update llama.cpp	2026-04-02 17:30:02 -07:00
oobabooga	091037ec20	Fix top_logprobs_ids missing for llama.cpp loader	2026-04-02 16:13:45 -03:00
oobabooga	f6f8f14c8d	Security: Fix SSRF in superbooga extensions	2026-04-02 16:13:39 -03:00
oobabooga	80e81a54ca	Remove ik macOS wheels from full requirements	2026-04-02 11:11:44 -07:00
oobabooga	468cb5cb87	Update accelerate	2026-04-02 10:59:28 -07:00
oobabooga	6a1f720c7b	Update transformers	2026-04-02 10:58:20 -07:00
oobabooga	8f8b57a029	Update exllamav3	2026-04-02 10:54:20 -07:00
oobabooga	c50e17bdbe	Add dedicated ik portable requirements files and remove macOS ik builds	2026-04-02 14:50:52 -03:00
oobabooga	ea1f8c71f2	API: Optimize prompt logprobs and refactor ExLlamav3 forward pass	2026-04-02 14:31:11 -03:00
oobabooga	c10c6e87ae	API: Add token ids to logprobs output	2026-04-02 07:17:27 -07:00
oobabooga	a32ce254f2	Don't pass torch_dtype to transformers, autodetect from model config	2026-04-02 00:44:14 -03:00
oobabooga	4073164be0	Fix ExLlamav3 OOM on prompt logprobs and qwen3_5_moe HF compat	2026-04-01 19:44:55 -07:00
oobabooga	328534b762	Update llama.cpp	2026-04-01 12:51:07 -07:00
oobabooga	71c1a52afe	API: Implement echo + logprobs for /v1/completions endpoint	2026-03-31 07:43:11 -07:00
oobabooga	6382fbef83	Several small code simplifications	2026-03-30 19:36:03 -07:00
oobabooga	0466b6e271	ik_llama.cpp: Auto-enable Hadamard KV cache rotation with quantized cache	2026-03-29 15:52:36 -07:00
oobabooga	be6fc0663a	Update the custom gradio wheels	2026-03-28 08:11:28 -07:00
oobabooga	4979e87e48	Add ik_llama.cpp support via ik_llama_cpp_binaries package	2026-03-28 12:09:00 -03:00
oobabooga	9dd04b86ce	Suppress EOS token at logit level for ExLlamav3 when ban_eos_token is set	2026-03-28 06:17:57 -07:00
oobabooga	bda95172bd	Fix stopping string detection for chromadb/context-1	2026-03-28 06:09:53 -07:00
oobabooga	4cbea02ed4	Add ik_llama.cpp support via --ik flag	2026-03-26 06:54:47 -07:00
oobabooga	e154140021	Rename "truncation length" to "context length" in logs	2026-03-25 07:21:02 -07:00
oobabooga	368f37335f	Fix --idle-timeout issues with encode/decode and parallel generation	2026-03-25 06:37:45 -07:00
oobabooga	d6f1485dd1	UI: Update the enable_thinking info message	2026-03-24 21:45:11 -07:00
oobabooga	807be11832	Remove obsolete models/config.yaml and related code	2026-03-24 18:48:50 -07:00
oobabooga	dd9d254c49	Merge pull request #7441 from oobabooga/dev ... Merge dev branch	2026-03-24 16:39:03 -03:00
oobabooga	f48a2b79d0	UI: Minor polish	2026-03-24 11:45:33 -07:00