oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-06 16:50:11 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
508 commits 6 branches 91 tags 66 MiB
Commit graph

508 commits

This branch
This branch
All branches
Author SHA1 Message Date
oobabooga e46c43afa6 Move some stuff from server.py to modules 2023-02-23 13:42:23 -03:00
oobabooga 1dacd34165 Further refactor 2023-02-23 13:28:30 -03:00
oobabooga ce7feb3641 Further refactor 2023-02-23 13:03:52 -03:00
oobabooga 98af4bfb0d Refactor the code to make it more modular 2023-02-23 12:05:25 -03:00
oobabooga 18e0ec955e Improve some descriptions in --help 2023-02-23 10:11:58 -03:00
oobabooga ced5d9ab04
Update README.md 2023-02-23 10:04:07 -03:00
oobabooga b18071330f
Update README.md 2023-02-23 01:32:05 -03:00
oobabooga c72892835a Don't show *-np models in the list of choices 2023-02-22 11:38:16 -03:00
oobabooga 95e536f876 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-02-22 11:24:14 -03:00
oobabooga 044b963987 Add stop parameter for flexgen (#105) 2023-02-22 11:23:36 -03:00
oobabooga b4a7f5fa70
Update README.md 2023-02-22 01:54:12 -03:00
oobabooga ea21a22940 Remove redundant preset 2023-02-22 01:01:26 -03:00
oobabooga b8b3d4139c Add --compress-weight parameter 2023-02-22 00:43:21 -03:00
oobabooga 193fb1660a Conversion seems to work better this way 2023-02-22 00:35:10 -03:00
oobabooga eef6fc3cbf Add a preset for FlexGen 2023-02-21 23:33:15 -03:00
oobabooga 311404e258 Reuse disk-cache-dir parameter for flexgen 2023-02-21 22:11:05 -03:00
oobabooga f3c75bbd64 Add --percent flag for flexgen 2023-02-21 22:08:46 -03:00
oobabooga b83f51ee04 Add FlexGen support #92 (experimental) 2023-02-21 21:00:06 -03:00
oobabooga e52b697d5a Add bf16 back here (the fp16 -> bf16 conversion takes a few seconds) 2023-02-21 00:54:53 -03:00
oobabooga bc856eb962 Add some more margin 2023-02-20 20:49:21 -03:00
oobabooga 444cd69c67 Fix regex bug in loading character jsons with special characters 2023-02-20 19:38:19 -03:00
oobabooga f867285e3d Make the circle a bit less red 2023-02-20 18:41:38 -03:00
oobabooga e4440cd984 Make highlighted text gray in cai-chat mode 2023-02-20 16:43:32 -03:00
oobabooga bb1dac2f76 Convert the download option (A-Z) to upper case 2023-02-20 15:50:48 -03:00
oobabooga d7a738fb7a Load any 13b/20b/30b model in 8-bit mode when no flags are supplied 2023-02-20 15:44:10 -03:00
oobabooga c1de491c63 No need to have bf16 support here 2023-02-20 15:12:42 -03:00
oobabooga 8123c5b01a Sort the imports 2023-02-20 15:06:27 -03:00
oobabooga 77846ceef3 Minor change 2023-02-20 15:05:48 -03:00
oobabooga e195377050 Deprecate torch dumps, move to safetensors (they load even faster) 2023-02-20 15:03:19 -03:00
oobabooga 14ffa0b418 Fix line breaks in --chat mode 2023-02-20 13:25:46 -03:00
oobabooga 58520a1f75
Update README.md 2023-02-20 12:44:31 -03:00
oobabooga c8eab98fd2 Add an example of usage for the API 2023-02-20 12:39:36 -03:00
oobabooga c92f347c94
Merge pull request #90 from SillyLossy/regexp 
Escape regexp in message extraction
 2023-02-19 08:31:19 -03:00
SillyLossy ded890c378 Escape regexp in message extraction 2023-02-19 12:55:45 +02:00
oobabooga 8c9dd95d55
Print the softprompt metadata when it is loaded 2023-02-19 01:48:23 -03:00
oobabooga f79805f4a4
Change a comment 2023-02-18 22:58:40 -03:00
oobabooga 05e9da0c12
Update README.md 2023-02-18 22:34:51 -03:00
oobabooga b1add0e586
Update README.md 2023-02-18 22:32:16 -03:00
oobabooga 55bb5e5ef0 Bump accelerate version 2023-02-18 22:15:47 -03:00
oobabooga 995bcfcf5e Minor style change 2023-02-18 22:14:57 -03:00
oobabooga d58544a420 Some minor formatting changes 2023-02-18 11:07:55 -03:00
oobabooga 3e6a8ccdce Fix galactica latex css 2023-02-18 00:18:39 -03:00
oobabooga 14f49bbe9a Fix galactica equations in dark mode 2023-02-17 23:57:09 -03:00
oobabooga abb4667b44 Improve basic HTML style 2023-02-17 23:08:34 -03:00
oobabooga 00ca17abc9 Minor change 2023-02-17 22:52:03 -03:00
oobabooga 2fd003c044 Fix gpt4chan styles that were broken by gradio 3.18.0 2023-02-17 22:47:41 -03:00
oobabooga 0dd41e4830 Reorganize the sliders some more 2023-02-17 16:33:27 -03:00
oobabooga 6b9ac2f88e Reorganize the generation parameters 2023-02-17 16:18:01 -03:00
oobabooga 3923ac967f Create a cache for profile pictures (in RAM) 
This is a performance optimization.
 2023-02-17 14:30:39 -03:00
oobabooga 596732a981 The soft prompt length must be considered here too 2023-02-17 12:35:30 -03:00