oobabooga
27bcc45c18
API: Add command-line flags to override default generation parameters
2026-03-06 01:36:45 -03:00
oobabooga
e2548f69a9
Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data
...
If --user-data-dir is not set, auto-detect: use ../user_data when
./user_data doesn't exist, making it easy to share user data across
portable builds by placing it one folder up.
2026-03-05 19:31:10 -08:00
oobabooga
65de4c30c8
Add adaptive-p sampler and n-gram speculative decoding support
2026-03-04 09:41:29 -08:00
oobabooga
6436bf1920
More UI persistence: presets and characters ( #7051 )
2025-06-08 01:58:02 -03:00
oobabooga
05115e42ee
Set top_n_sigma before temperature by default
2025-05-06 08:27:21 -07:00
oobabooga
d1c0154d66
llama.cpp: Add top_n_sigma, fix typical_p in sampler priority
2025-05-06 06:38:39 -07:00
oobabooga
905afced1c
Add a --portable flag to hide things in portable mode
2025-05-02 16:34:29 -07:00
oobabooga
d9de14d1f7
Restructure the repository ( #6904 )
2025-04-26 08:56:54 -03:00
oobabooga
5bcd2d7ad0
Add the top N-sigma sampler ( #6796 )
2025-03-14 16:45:11 -03:00
oobabooga
83c426e96b
Organize internals ( #6646 )
2025-01-10 18:04:32 -03:00
Philipp Emanuel Weidmann
301375834e
Exclude Top Choices (XTC): A sampler that boosts creativity, breaks writing clichés, and inhibits non-verbatim repetition ( #6335 )
2024-09-27 22:50:12 -03:00
oobabooga
5c918c5b2d
Make it possible to sort DRY
2024-09-27 15:40:48 -07:00
oobabooga
7424f789bf
Fix the sampling monkey patch (and add more options to sampler_priority) ( #6411 )
2024-09-27 19:03:25 -03:00
Philipp Emanuel Weidmann
852c943769
DRY: A modern repetition penalty that reliably prevents looping ( #5677 )
2024-05-19 23:53:47 -03:00
oobabooga
35da6b989d
Organize the parameters tab ( #5767 )
2024-03-28 16:45:03 -03:00
kalomaze
cfb25c9b3f
Cubic sampling w/ curve param ( #5551 )
...
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2024-03-03 13:22:21 -03:00
oobabooga
069ed7c6ef
Lint
2024-02-13 16:05:41 -08:00
oobabooga
c55b8ce932
Improved random preset generation
2024-02-06 08:51:52 -08:00
oobabooga
775902c1f2
Sampler priority: better logging, always save to presets
2024-02-06 06:49:22 -08:00
oobabooga
8c35fefb3b
Add custom sampler order support ( #5443 )
2024-02-06 11:20:10 -03:00
kalomaze
b6077b02e4
Quadratic sampling ( #5403 )
...
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2024-02-04 00:20:02 -03:00
oobabooga
29c2693ea0
dynatemp_low, dynatemp_high, dynatemp_exponent parameters ( #5209 )
2024-01-08 23:28:35 -03:00
oobabooga
9cd2106303
Revert "Add dynamic temperature to the random preset button"
...
This reverts commit 4365fb890f .
2024-01-08 16:46:24 -08:00
oobabooga
4365fb890f
Add dynamic temperature to the random preset button
2024-01-07 13:08:15 -08:00
oobabooga
0d07b3a6a1
Add dynamic_temperature_low parameter ( #5198 )
2024-01-07 17:03:47 -03:00
kalomaze
48327cc5c4
Dynamic Temperature HF loader support ( #5174 )
...
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2024-01-07 10:36:26 -03:00
oobabooga
2c5a1e67f9
Parameters: change max_new_tokens & repetition_penalty_range defaults ( #4842 )
2023-12-07 20:04:52 -03:00
oobabooga
83b64e7fc1
New feature: "random preset" button ( #4647 )
2023-11-18 18:31:41 -03:00
oobabooga
ec17a5d2b7
Make OpenAI API the default API ( #4430 )
2023-11-06 02:38:29 -03:00
oobabooga
aa5d671579
Add temperature_last parameter ( #4472 )
2023-11-04 13:09:07 -03:00
oobabooga
7f9c1cbb30
Change min_p default to 0.0
2023-11-03 08:25:22 -07:00
kalomaze
367e5e6e43
Implement Min P as a sampler option in HF loaders ( #4449 )
2023-11-02 16:32:51 -03:00
tdrussell
72f6fc6923
Rename additive_repetition_penalty to presence_penalty, add frequency_penalty ( #4376 )
2023-10-25 12:10:28 -03:00
tdrussell
4440f87722
Add additive_repetition_penalty sampler setting. ( #3627 )
2023-10-23 02:28:07 -03:00
saltacc
f01b9aa71f
Add customizable ban tokens ( #3899 )
2023-09-15 18:27:27 -03:00
oobabooga
0af10ab49b
Add Classifier Free Guidance (CFG) for Transformers/ExLlama ( #3325 )
2023-08-06 17:22:48 -03:00
oobabooga
f094330df0
When saving a preset, only save params that differ from the defaults
2023-07-31 19:13:29 -07:00
oobabooga
4b1804a438
Implement sessions + add basic multi-user support ( #2991 )
2023-07-04 00:03:30 -03:00
oobabooga
3443219cbc
Add repetition penalty range parameter to transformers ( #2916 )
2023-06-29 13:40:13 -03:00
oobabooga
7ef6a50e84
Reorganize model loading UI completely ( #2720 )
2023-06-16 19:00:37 -03:00
oobabooga
474dc7355a
Allow API requests to use parameter presets
2023-06-14 11:32:20 -03:00