oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-27 19:04:51 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
980 commits 4 branches 92 tags 66 MiB
Commit graph

980 commits

This branch
This branch
All branches
Author SHA1 Message Date
oobabooga 45b7e53565
Only catch proper Exceptions in the text generation function 2023-03-20 20:36:02 -03:00
oobabooga 6872ffd976
Update README.md 2023-03-20 16:53:14 -03:00
oobabooga db4219a340
Update comments 2023-03-20 16:40:08 -03:00
oobabooga 7618f3fe8c
Add -gptq-preload for 4-bit offloading (#460) 
This works in a 4GB card now:

```
python server.py --model llama-7b-hf --gptq-bits 4 --gptq-pre-layer 20
```
 2023-03-20 16:30:56 -03:00
oobabooga 9a3bed50c3
Attempt at fixing 4-bit with CPU offload 2023-03-20 15:11:56 -03:00
oobabooga 536d0a4d93
Add an import 2023-03-20 14:00:40 -03:00
oobabooga 75a7a84ef2
Exception handling (#454) 
* Update text_generation.py
* Update extensions.py
 2023-03-20 13:36:52 -03:00
oobabooga a90f507abe
Exit elevenlabs_tts if streaming is enabled 2023-03-20 11:49:42 -03:00
oobabooga 31ab2be8ef Remove redundant requirements #309 2023-03-19 22:10:55 -03:00
oobabooga 164e05daad Download .py files using download-model.py 2023-03-19 20:34:52 -03:00
oobabooga dd4374edde Update README 2023-03-19 20:15:15 -03:00
oobabooga 9378754cc7 Update README 2023-03-19 20:14:50 -03:00
oobabooga 7ddf6147ac
Update README.md 2023-03-19 19:25:52 -03:00
oobabooga b552d2b58a Remove unused imports 
o
 2023-03-19 19:24:41 -03:00
oobabooga ddb62470e9 --no-cache and --gpu-memory in MiB for fine VRAM control 2023-03-19 19:21:41 -03:00
oobabooga 4bafe45a51
Merge pull request #309 from Brawlence/main 
Extension: Stable Diffusion Api integration
 2023-03-19 13:24:47 -03:00
oobabooga eab8de0d4a Merge branch 'main' into Brawlence-main 2023-03-19 13:09:59 -03:00
oobabooga 4d701a6eb9 Create a mirror for the preset menu 2023-03-19 12:51:47 -03:00
oobabooga 257edf5f56 Make the Default preset more reasonable 
Credits: anonymous 4chan user who got it off
"some twitter post or something someone linked,
who even knows anymore"
 2023-03-19 12:30:51 -03:00
oobabooga a78b6508fc Make custom LoRAs work by default #385 2023-03-19 12:11:35 -03:00
oobabooga 7073e96093 Add back RWKV dependency #98 2023-03-19 12:05:28 -03:00
oobabooga 217e1d9fdf Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-03-19 10:37:23 -03:00
oobabooga c79fc69e95 Fix the API example with streaming #417 2023-03-19 10:36:57 -03:00
oobabooga 0cbe2dd7e9
Update README.md 2023-03-18 12:24:54 -03:00
oobabooga 36ac7be76d
Merge pull request #407 from ThisIsPIRI/gitignore 
Add loras to .gitignore
 2023-03-18 11:57:10 -03:00
oobabooga d2a7fac8ea
Use pip instead of conda for pytorch 2023-03-18 11:56:04 -03:00
ThisIsPIRI 705f513c4c Add loras to .gitignore 2023-03-18 23:33:24 +09:00
oobabooga a0b1a30fd5
Specify torchvision/torchaudio versions 2023-03-18 11:23:56 -03:00
oobabooga c753261338 Disable stop_at_newline by default 2023-03-18 10:55:57 -03:00
oobabooga 7c945cfe8e Don't include PeftModel every time 2023-03-18 10:55:24 -03:00
oobabooga 86b99006d9
Remove rwkv dependency 2023-03-18 10:27:52 -03:00
oobabooga a163807f86
Update README.md 2023-03-18 03:07:27 -03:00
oobabooga a7acfa4893
Update README.md 2023-03-17 22:57:46 -03:00
oobabooga bcd8afd906
Merge pull request #393 from WojtekKowaluk/mps_support 
Fix for MPS support on Apple Silicon
 2023-03-17 22:57:28 -03:00
oobabooga e26763a510 Minor changes 2023-03-17 22:56:46 -03:00
Wojtek Kowaluk 7994b580d5 clean up duplicated code 2023-03-18 02:27:26 +01:00
oobabooga dc35861184
Update README.md 2023-03-17 21:05:17 -03:00
Wojtek Kowaluk 30939e2aee add mps support on apple silicon 2023-03-18 00:56:23 +01:00
Wojtek Kowaluk 7d97da1dcb add venv paths to gitignore 2023-03-18 00:54:17 +01:00
oobabooga f2a5ca7d49
Update README.md 2023-03-17 20:50:27 -03:00
oobabooga 8c8286b0e6
Update README.md 2023-03-17 20:49:40 -03:00
oobabooga 0c05e65e5c
Update README.md 2023-03-17 20:25:42 -03:00
oobabooga adc200318a Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-03-17 20:19:33 -03:00
oobabooga 20f5b455bf Add parameters reference #386 #331 2023-03-17 20:19:04 -03:00
oobabooga 66e8d12354
Update README.md 2023-03-17 19:59:37 -03:00
oobabooga 9a871117d7
Update README.md 2023-03-17 19:52:22 -03:00
oobabooga d4f38b6a1f
Update README.md 2023-03-17 18:57:48 -03:00
oobabooga ad7c829953
Update README.md 2023-03-17 18:55:01 -03:00
oobabooga 4426f941e0
Update the installation instructions. Tldr use WSL 2023-03-17 18:51:07 -03:00
oobabooga 9256e937d6 Add some LoRA params 2023-03-17 17:45:28 -03:00