oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2025-12-06 07:12:10 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
1257 commits 6 branches 88 tags 66 MiB
Commit graph

390 commits

Author SHA1 Message Date
oobabooga 03cb44fc8c Add new llama.cpp library (2048 context, temperature, etc now work) 2023-04-06 13:12:14 -03:00
EyeDeck 39f3fec913
Broaden GPTQ-for-LLaMA branch support (#820) 2023-04-06 12:16:48 -03:00
Alex "mcmonkey" Goodwin 0c7ef26981
Lora trainer improvements (#763) 2023-04-06 02:04:11 -03:00
oobabooga e94ab5dac1 Minor fixes 2023-04-06 01:43:10 -03:00
oobabooga 3f3e42e26c
Refactor several function calls and the API 2023-04-06 01:22:15 -03:00
SDS 378d21e80c
Add LLaMA-Precise preset (#767) 2023-04-05 18:52:36 -03:00
Forkoz 8203ce0cac
Stop character pic from being cached when changing chars or clearing. (#798) 
Tested on both FF and chromium
 2023-04-05 14:25:01 -03:00
oobabooga 7f66421369 Fix loading characters 2023-04-05 14:22:32 -03:00
oobabooga e722c240af Add Instruct mode 2023-04-05 13:54:50 -03:00
oobabooga 3d6cb5ed63 Minor rewrite 2023-04-05 01:21:40 -03:00
oobabooga f3a2e0b8a9 Disable pre_layer when the model type is not llama 2023-04-05 01:19:26 -03:00
catalpaaa 4ab679480e
allow quantized model to be loaded from model dir (#760) 2023-04-04 23:19:38 -03:00
oobabooga ae1fe45bc0 One more cache reset 2023-04-04 23:15:57 -03:00
oobabooga 8ef89730a5 Try to better handle browser image cache 2023-04-04 23:09:28 -03:00
oobabooga cc6c7a37f3 Add make_thumbnail function 2023-04-04 23:03:58 -03:00
oobabooga 80dfba05f3 Better crop/resize cached images 2023-04-04 22:52:15 -03:00
oobabooga 65d8a24a6d Show profile pictures in the Character tab 2023-04-04 22:28:49 -03:00
OWKenobi ee4547cd34
Detect "vicuna" as llama model type (#772) 2023-04-04 13:23:27 -03:00
oobabooga b24147c7ca Document --pre_layer 2023-04-03 17:34:25 -03:00
oobabooga 4c9ed09270 Update settings template 2023-04-03 14:59:26 -03:00
OWKenobi dcf61a8897
"character greeting" displayed and editable on the fly (#743) 
* Add greetings field

* add greeting field and make it interactive

* Minor changes

* Fix a bug

* Simplify clear_chat_log

* Change a label

* Minor change

* Simplifications

* Simplification

* Simplify loading the default character history

* Fix regression

---------

Co-authored-by: oobabooga
 2023-04-03 12:16:15 -03:00
Alex "mcmonkey" Goodwin 8b1f20aa04
Fix some old JSON characters not loading (#740) 2023-04-03 10:49:28 -03:00
oobabooga 8b442305ac Rename another variable 2023-04-03 01:15:20 -03:00
oobabooga 08448fb637 Rename a variable 2023-04-03 01:02:11 -03:00
oobabooga 2a267011dc Use Path.stem for simplicity 2023-04-03 00:56:14 -03:00
Alex "mcmonkey" Goodwin ea97303509
Apply dialogue format in all character fields not just example dialogue (#650) 2023-04-02 21:54:29 -03:00
TheTerrasque 2157bb4319
New yaml character format (#337 from TheTerrasque/feature/yaml-characters) 
This doesn't break backward compatibility with JSON characters.
 2023-04-02 20:34:25 -03:00
oobabooga 5f3f3faa96 Better handle CUDA out of memory errors in chat mode 2023-04-02 17:48:00 -03:00
oobabooga b0890a7925 Add shared.is_chat() function 2023-04-01 20:15:00 -03:00
oobabooga b857f4655b
Update shared.py 2023-04-01 13:56:47 -03:00
oobabooga fcda3f8776 Add also_return_rows to generate_chat_prompt 2023-04-01 01:12:13 -03:00
oobabooga 2c52310642 Add --threads flag for llama.cpp 2023-03-31 21:18:05 -03:00
oobabooga eeafd60713 Fix streaming 2023-03-31 19:05:38 -03:00
oobabooga 52065ae4cd Add repetition_penalty 2023-03-31 19:01:34 -03:00
oobabooga 2259143fec Fix llama.cpp with --no-stream 2023-03-31 18:43:45 -03:00
oobabooga 3a47a602a3 Detect ggml*.bin files automatically 2023-03-31 17:18:21 -03:00
oobabooga 0aee7341d8 Properly count tokens/s for llama.cpp in chat mode 2023-03-31 17:04:32 -03:00
oobabooga ea3ba6fc73 Merge branch 'feature/llamacpp' of github.com:thomasantony/text-generation-webui into thomasantony-feature/llamacpp 2023-03-31 14:45:53 -03:00
oobabooga 09b0a3aafb Add repetition_penalty 2023-03-31 14:45:17 -03:00
oobabooga 4d98623041
Merge branch 'main' into feature/llamacpp 2023-03-31 14:37:04 -03:00
oobabooga 4c27562157 Minor changes 2023-03-31 14:33:46 -03:00
oobabooga 9d1dcf880a General improvements 2023-03-31 14:27:01 -03:00
oobabooga 770ff0efa9 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-03-31 12:22:22 -03:00
oobabooga 1d1d9e40cd Add seed to settings 2023-03-31 12:22:07 -03:00
Maya b246d17513
Fix type object is not subscriptable 
Fix `type object is not subscriptable` on python 3.8
 2023-03-31 14:20:31 +03:00
oobabooga d4a9b5ea97 Remove redundant preset (see the plot in #587) 2023-03-30 17:34:44 -03:00
Thomas Antony 7fa5d96c22 Update to use new llamacpp API 2023-03-30 11:23:05 +01:00
Thomas Antony 79fa2b6d7e Add support for alpaca 2023-03-30 11:23:04 +01:00
Thomas Antony a5f5736e74 Add to text_generation.py 2023-03-30 11:22:38 +01:00
Thomas Antony 7745faa7bb Add llamacpp to models.py 2023-03-30 11:22:37 +01:00