oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-09 02:00:27 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
1986 commits 3 branches 92 tags 66 MiB
Commit graph

1986 commits

This branch
This branch
All branches
Author SHA1 Message Date
oobabooga cbd63eeeff Fix repeated tokens with exllama 2023-06-17 19:02:08 -03:00
oobabooga 766c760cd7 Use gen_begin_reuse in exllama 2023-06-17 18:00:10 -03:00
oobabooga 239b11c94b Minor bug fixes 2023-06-17 17:57:56 -03:00
Bhavika Tekwani d8d29edf54
Install wheel using pip3 (#2719) 2023-06-16 23:46:40 -03:00
Jonathan Yankovich a1ca1c04a1
Update ExLlama.md (#2729) 
Add details for configuring exllama
 2023-06-16 23:46:25 -03:00
oobabooga b27f83c0e9 Make exllama stoppable 2023-06-16 22:03:23 -03:00
oobabooga 7f06d551a3 Fix streaming callback 2023-06-16 21:44:56 -03:00
oobabooga 1e400218e9 Fix a typo 2023-06-16 21:01:57 -03:00
oobabooga 5f392122fd Add gpu_split param to ExLlama 
Adapted from code created by Ph0rk0z. Thank you Ph0rk0z.
 2023-06-16 20:49:36 -03:00
oobabooga cb9be5db1c
Update ExLlama.md 2023-06-16 20:40:12 -03:00
oobabooga 83be8eacf0 Minor fix 2023-06-16 20:38:32 -03:00
oobabooga 9f40032d32
Add ExLlama support (#2444) 2023-06-16 20:35:38 -03:00
oobabooga dea43685b0 Add some clarifications 2023-06-16 19:10:53 -03:00
oobabooga 7ef6a50e84
Reorganize model loading UI completely (#2720) 2023-06-16 19:00:37 -03:00
oobabooga 57be2eecdf
Update README.md 2023-06-16 15:04:16 -03:00
Meng-Yuan Huang 772d4080b2
Update llama.cpp-models.md for macOS (#2711) 2023-06-16 00:00:24 -03:00
Tom Jobbins 646b0c889f
AutoGPTQ: Add UI and command line support for disabling fused attention and fused MLP (#2648) 2023-06-15 23:59:54 -03:00
dependabot[bot] 909d8c6ae3
Bump transformers from 4.30.0 to 4.30.2 (#2695) 2023-06-14 19:56:28 -03:00
oobabooga 2b9a6b9259 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-06-14 18:45:24 -03:00
oobabooga 4d508cbe58 Add some checks to AutoGPTQ loader 2023-06-14 18:44:43 -03:00
FartyPants 56c19e623c
Add LORA name instead of "default" in PeftModel (#2689) 2023-06-14 18:29:42 -03:00
oobabooga 134430bbe2 Minor change 2023-06-14 11:34:42 -03:00
oobabooga 474dc7355a Allow API requests to use parameter presets 2023-06-14 11:32:20 -03:00
oobabooga 8936160e54
Add WSL installer to README (thanks jllllll) 2023-06-13 00:07:34 -03:00
FartyPants 9f150aedc3
A small UI change in Models menu (#2640) 2023-06-12 01:24:44 -03:00
oobabooga da5d9a28d8 Fix tabbed extensions showing up at the bottom of the UI 2023-06-11 21:20:51 -03:00
oobabooga ae5e2b3470 Reorganize a bit 2023-06-11 19:50:20 -03:00
oobabooga e471919e6d Make llava/minigpt-4 work with AutoGPTQ 2023-06-11 17:56:01 -03:00
oobabooga f4defde752 Add a menu for installing extensions 2023-06-11 17:11:06 -03:00
oobabooga 8e73806b20 Improve "Interface mode" appearance 2023-06-11 15:29:45 -03:00
oobabooga a06c953692 Minor style change 2023-06-11 15:13:26 -03:00
oobabooga ac122832f7 Make dropdown menus more similar to automatic1111 2023-06-11 14:20:16 -03:00
Amine Djeghri 8275dbc68c
Update WSL-installation-guide.md (#2626) 2023-06-11 12:30:34 -03:00
oobabooga 6133675e0f
Add menus for saving presets/characters/instruction templates/prompts (#2621) 2023-06-11 12:19:18 -03:00
oobabooga ea0eabd266 Bump llama-cpp-python version 2023-06-10 21:59:29 -03:00
oobabooga ec2b5bae39
Merge pull request #2616 from oobabooga/dev 
Merge dev branch
 2023-06-10 21:55:59 -03:00
brandonj60 b04e18d10c
Add Mirostat v2 sampling to transformer models (#2571) 2023-06-09 21:26:31 -03:00
oobabooga aff3e04df4 Remove irrelevant docs 
Compiling from source, in my tests, makes no difference in
the resulting tokens/s.
 2023-06-09 21:15:37 -03:00
oobabooga d7db25dac9 Fix a permission 2023-06-09 01:44:17 -03:00
oobabooga d033c85cf9 Fix a permission 2023-06-09 01:43:22 -03:00
oobabooga 741afd74f6 Update requirements-minimal.txt 2023-06-09 00:48:41 -03:00
oobabooga c333e4c906 Add docs for performance optimizations 2023-06-09 00:47:48 -03:00
oobabooga aaf240a14c
Merge pull request #2587 from oobabooga/dev 2023-06-09 00:30:59 -03:00
oobabooga c6552785af Minor cleanup 2023-06-09 00:30:22 -03:00
oobabooga 92b45cb3f5 Merge branch 'main' into dev 2023-06-09 00:27:11 -03:00
oobabooga 8a7a8343be Detect TheBloke_WizardLM-30B-GPTQ 2023-06-09 00:26:34 -03:00
oobabooga 0f8140e99d Bump transformers/accelerate/peft/autogptq 2023-06-09 00:25:13 -03:00
FartyPants ac40c59ac3
Added Guanaco-QLoRA to Instruct character (#2574) 2023-06-08 12:24:32 -03:00
oobabooga db2cbe7b5a Detect WizardLM-30B-V1.0 instruction format 2023-06-08 11:43:40 -03:00
oobabooga e0b43102e6 Merge remote-tracking branch 'refs/remotes/origin/dev' into dev 2023-06-08 11:35:23 -03:00