oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-04 07:40:13 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
526 commits 6 branches 91 tags 66 MiB
Commit graph

526 commits

This branch
This branch
All branches
Author SHA1 Message Date
oobabooga f4f508c8e2
Update README.md 2023-02-24 09:03:09 -03:00
oobabooga 876761329b Merge branch 'elwolf6-max_memory' 2023-02-24 08:55:55 -03:00
oobabooga f6f792363b Separate command-line params by spaces instead of commas 2023-02-24 08:55:09 -03:00
oobabooga e260e84e5a Merge branch 'max_memory' of https://github.com/elwolf6/text-generation-webui into elwolf6-max_memory 2023-02-24 08:47:01 -03:00
oobabooga 146f786c57 Reorganize a bit 2023-02-24 08:44:54 -03:00
oobabooga c2f4c395b9 Clean up some chat functions 2023-02-24 08:31:30 -03:00
luis 5abdc99a7c gpu-memory arg change 2023-02-23 18:43:55 -05:00
oobabooga 9ae063e42b Fix softprompts when deepspeed is active (#112) 2023-02-23 20:22:47 -03:00
oobabooga dac6fe0ff4 Reset the history if no default history exists on reload 2023-02-23 19:53:50 -03:00
oobabooga 3b8cecbab7 Reload the default chat on page refresh 2023-02-23 19:50:23 -03:00
oobabooga f1914115d3 Fix minor issue with chat logs 2023-02-23 16:04:47 -03:00
oobabooga 682f7bdbba
Merge pull request #110 from oobabooga/refactored 
Refactor everything
 2023-02-23 15:30:32 -03:00
oobabooga b78561fba6 Minor bug fix 2023-02-23 15:26:41 -03:00
oobabooga 2e86a1ec04 Move chat history into shared module 2023-02-23 15:11:18 -03:00
oobabooga c87800341c Move function to extensions module 2023-02-23 14:55:21 -03:00
oobabooga 2048b403a5 Reorder functions 2023-02-23 14:49:02 -03:00
oobabooga 7224343a70 Improve the imports 2023-02-23 14:41:42 -03:00
oobabooga 364529d0c7 Further refactor 2023-02-23 14:31:28 -03:00
oobabooga e46c43afa6 Move some stuff from server.py to modules 2023-02-23 13:42:23 -03:00
oobabooga 1dacd34165 Further refactor 2023-02-23 13:28:30 -03:00
oobabooga ce7feb3641 Further refactor 2023-02-23 13:03:52 -03:00
oobabooga 98af4bfb0d Refactor the code to make it more modular 2023-02-23 12:05:25 -03:00
oobabooga 18e0ec955e Improve some descriptions in --help 2023-02-23 10:11:58 -03:00
oobabooga ced5d9ab04
Update README.md 2023-02-23 10:04:07 -03:00
oobabooga b18071330f
Update README.md 2023-02-23 01:32:05 -03:00
oobabooga c72892835a Don't show *-np models in the list of choices 2023-02-22 11:38:16 -03:00
oobabooga 95e536f876 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-02-22 11:24:14 -03:00
oobabooga 044b963987 Add stop parameter for flexgen (#105) 2023-02-22 11:23:36 -03:00
oobabooga b4a7f5fa70
Update README.md 2023-02-22 01:54:12 -03:00
oobabooga ea21a22940 Remove redundant preset 2023-02-22 01:01:26 -03:00
oobabooga b8b3d4139c Add --compress-weight parameter 2023-02-22 00:43:21 -03:00
oobabooga 193fb1660a Conversion seems to work better this way 2023-02-22 00:35:10 -03:00
oobabooga eef6fc3cbf Add a preset for FlexGen 2023-02-21 23:33:15 -03:00
oobabooga 311404e258 Reuse disk-cache-dir parameter for flexgen 2023-02-21 22:11:05 -03:00
oobabooga f3c75bbd64 Add --percent flag for flexgen 2023-02-21 22:08:46 -03:00
oobabooga b83f51ee04 Add FlexGen support #92 (experimental) 2023-02-21 21:00:06 -03:00
oobabooga e52b697d5a Add bf16 back here (the fp16 -> bf16 conversion takes a few seconds) 2023-02-21 00:54:53 -03:00
oobabooga bc856eb962 Add some more margin 2023-02-20 20:49:21 -03:00
oobabooga 444cd69c67 Fix regex bug in loading character jsons with special characters 2023-02-20 19:38:19 -03:00
oobabooga f867285e3d Make the circle a bit less red 2023-02-20 18:41:38 -03:00
oobabooga e4440cd984 Make highlighted text gray in cai-chat mode 2023-02-20 16:43:32 -03:00
oobabooga bb1dac2f76 Convert the download option (A-Z) to upper case 2023-02-20 15:50:48 -03:00
oobabooga d7a738fb7a Load any 13b/20b/30b model in 8-bit mode when no flags are supplied 2023-02-20 15:44:10 -03:00
oobabooga c1de491c63 No need to have bf16 support here 2023-02-20 15:12:42 -03:00
oobabooga 8123c5b01a Sort the imports 2023-02-20 15:06:27 -03:00
oobabooga 77846ceef3 Minor change 2023-02-20 15:05:48 -03:00
oobabooga e195377050 Deprecate torch dumps, move to safetensors (they load even faster) 2023-02-20 15:03:19 -03:00
oobabooga 14ffa0b418 Fix line breaks in --chat mode 2023-02-20 13:25:46 -03:00
oobabooga 58520a1f75
Update README.md 2023-02-20 12:44:31 -03:00
oobabooga c8eab98fd2 Add an example of usage for the API 2023-02-20 12:39:36 -03:00