1673 commits

Author	SHA1	Message	Date
oobabooga	e4d3f4449d	API: Fix a regression	2025-05-16 13:02:27 -07:00
oobabooga	adb975a380	Prevent fractional gpu-layers in the UI	2025-05-16 12:52:43 -07:00
oobabooga	fc483650b5	Set the maximum gpu_layers value automatically when the model is loaded with --model	2025-05-16 11:58:17 -07:00
oobabooga	38c50087fe	Prevent a crash on systems without an NVIDIA GPU	2025-05-16 11:55:30 -07:00
oobabooga	253e85a519	Only compute VRAM/GPU layers for llama.cpp models	2025-05-16 10:02:30 -07:00
oobabooga	9ec9b1bf83	Auto-adjust GPU layers after model unload to utilize freed VRAM	2025-05-16 09:56:23 -07:00
oobabooga	ee7b3028ac	Always cache GGUF metadata calls	2025-05-16 09:12:36 -07:00
oobabooga	4925c307cf	Auto-adjust GPU layers on context size and cache type changes + many fixes	2025-05-16 09:07:38 -07:00
oobabooga	93e1850a2c	Only show the VRAM info for llama.cpp	2025-05-15 21:42:15 -07:00
oobabooga	cbf4daf1c8	Hide the LoRA menu in portable mode	2025-05-15 21:21:54 -07:00
oobabooga	fd61297933	Lint	2025-05-15 21:19:19 -07:00
oobabooga	5534d01da0	Estimate the VRAM for GGUF models + autoset gpu-layers (#6980)	2025-05-16 00:07:37 -03:00
oobabooga	c4a715fd1e	UI: Move the LoRA menu under "Other options"	2025-05-13 20:14:09 -07:00
oobabooga	035cd3e2a9	UI: Hide the extension install menu in portable builds	2025-05-13 20:09:22 -07:00
oobabooga	2826c60044	Use logger for "Output generated in ..." messages	2025-05-13 14:45:46 -07:00
oobabooga	3fa1a899ae	UI: Fix gpu-layers being ignored (closes #6973)	2025-05-13 12:07:59 -07:00
oobabooga	62c774bf24	Revert "New attempt" ... This reverts commit e7ac06c169.	2025-05-13 06:42:25 -07:00
oobabooga	e7ac06c169	New attempt	2025-05-10 19:20:04 -07:00
oobabooga	47d4758509	Fix #6970	2025-05-10 17:46:00 -07:00
oobabooga	4920981b14	UI: Remove the typing cursor	2025-05-09 20:35:38 -07:00
oobabooga	8984e95c67	UI: More friendly message when no model is loaded	2025-05-09 07:21:05 -07:00
oobabooga	512bc2d0e0	UI: Update some labels	2025-05-08 23:43:55 -07:00
oobabooga	f8ef6e09af	UI: Make ctx-size a slider	2025-05-08 18:19:04 -07:00
oobabooga	9ea2a69210	llama.cpp: Add --no-webui to the llama-server command	2025-05-08 10:41:25 -07:00
oobabooga	1c7209a725	Save the chat history periodically during streaming	2025-05-08 09:46:43 -07:00
Jonas	fa960496d5	Tools support for OpenAI compatible API (#6827)	2025-05-08 12:30:27 -03:00
oobabooga	a2ab42d390	UI: Remove the exllamav2 info message	2025-05-08 08:00:38 -07:00
oobabooga	348d4860c2	UI: Create a "Main options" section in the Model tab	2025-05-08 07:58:59 -07:00
oobabooga	d2bae7694c	UI: Change the ctx-size description	2025-05-08 07:26:23 -07:00
oobabooga	b28fa86db6	Default --gpu-layers to 256	2025-05-06 17:51:55 -07:00
Downtown-Case	5ef564a22e	Fix model config loading in shared.py for Python 3.13 (#6961)	2025-05-06 17:03:33 -03:00
oobabooga	c4f36db0d8	llama.cpp: remove tfs (it doesn't get used)	2025-05-06 08:41:13 -07:00
oobabooga	05115e42ee	Set top_n_sigma before temperature by default	2025-05-06 08:27:21 -07:00
oobabooga	1927afe894	Fix top_n_sigma not showing for llama.cpp	2025-05-06 08:18:49 -07:00
oobabooga	d1c0154d66	llama.cpp: Add top_n_sigma, fix typical_p in sampler priority	2025-05-06 06:38:39 -07:00
mamei16	8137eb8ef4	Dynamic Chat Message UI Update Speed (#6952)	2025-05-05 18:05:23 -03:00
oobabooga	475e012ee8	UI: Improve the light theme colors	2025-05-05 06:16:29 -07:00
oobabooga	b817bb33fd	Minor fix after df7bb0db1f	2025-05-05 05:00:20 -07:00
oobabooga	f3da45f65d	ExLlamaV3_HF: Change max_chunk_size to 256	2025-05-04 20:37:15 -07:00
oobabooga	df7bb0db1f	Rename --n-gpu-layers to --gpu-layers	2025-05-04 20:03:55 -07:00
oobabooga	d0211afb3c	Save the chat history right after sending a message	2025-05-04 18:52:01 -07:00
oobabooga	690d693913	UI: Add padding to only show the last message/reply after sending a message ... To avoid scrolling	2025-05-04 18:13:29 -07:00
oobabooga	7853fb1c8d	Optimize the Chat tab (#6948)	2025-05-04 18:58:37 -03:00
oobabooga	b7a5c7db8d	llama.cpp: Handle short arguments in --extra-flags	2025-05-04 07:14:42 -07:00
oobabooga	4c2e3b168b	llama.cpp: Add a retry mechanism when getting the logits (sometimes it fails)	2025-05-03 06:51:20 -07:00
oobabooga	ea60f14674	UI: Show the list of files if the user tries to download a GGUF repository	2025-05-03 06:06:50 -07:00
oobabooga	b71ef50e9d	UI: Add a min-height to prevent constant scrolling during chat streaming	2025-05-02 23:45:58 -07:00
oobabooga	d08acb4af9	UI: Rename enable_thinking -> Enable thinking	2025-05-02 20:50:52 -07:00
oobabooga	4cea720da8	UI: Remove the "Autoload the model" feature	2025-05-02 16:38:28 -07:00
oobabooga	905afced1c	Add a --portable flag to hide things in portable mode	2025-05-02 16:34:29 -07:00