oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2025-12-06 07:12:10 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
338 commits 6 branches 88 tags 66 MiB
Commit graph

181 commits

Author SHA1 Message Date
oobabooga f38c9bf428 Fix deepspeed (oops) 2023-02-02 10:39:37 -03:00
oobabooga 90f1067598 Move deepspeed parameters to another file 2023-02-02 10:25:09 -03:00
81300 248ec4fa21
Merge branch 'oobabooga:main' into ds 2023-02-01 20:50:51 +02:00
81300 a6f4760772
Add arg for bfloat16 2023-02-01 20:22:07 +02:00
81300 c515282f5c
no_split_module_classes not needed 2023-02-01 19:47:26 +02:00
81300 0a0d289537
Fix issue with generating on multiple GPUs 2023-02-01 19:02:07 +02:00
81300 a97afa6965
Add DeepSpeed ZeRO-3 integration 2023-02-01 18:48:13 +02:00
oobabooga 6b13816c47 Change default --disk behavior 2023-02-01 10:43:28 -03:00
oobabooga 119be56390 Add back low_cpu_mem_usage=True 
Removing it didn't help with anything, so I am adding it bad on a purely
superstiticious basis.
 2023-02-01 10:01:44 -03:00
oobabooga d4a0b377ab Allow standalone --cpu-memory 
I think that what I am doing probably makes sense, but I could be wrong.
 2023-01-31 21:23:16 -03:00
oobabooga 8ef89df746 Try to leave at least 1GiB free to prevent oom errors 2023-01-31 20:47:05 -03:00
oobabooga bb77f20a6c Don't use low_cpu_mem_usage and device_map together 2023-01-31 13:24:05 -03:00
oobabooga 001ecf95b2
Update server.py 2023-01-31 08:14:16 -03:00
Silver267 a85bb5e9a2
Fix an error 
Fixes "UnboundLocalError: local variable 'substring_found' referenced before assignment" when loading non-pygmalion models in cai chat mode.
 2023-01-31 01:34:10 -05:00
oobabooga 5b0bbfa6e8 Clean up 2023-01-30 14:17:12 -03:00
oobabooga 2dadf42cb5 Print the tokenized example dialogue in a prettier way 2023-01-30 08:29:49 -03:00
oobabooga 161cae001b I needed this 2023-01-29 23:20:22 -03:00
oobabooga 3ebca480f6 Minor fix 2023-01-29 23:05:17 -03:00
oobabooga 00707a0b3b Add "Impersonate" button 2023-01-29 22:56:23 -03:00
oobabooga de72e83508 Reorganize things 2023-01-29 14:27:22 -03:00
oobabooga 6fbfee9e6d Remove some bloat 2023-01-29 12:05:18 -03:00
oobabooga 9c9bd1074f Add option to replace the bot's last reply 2023-01-29 12:02:44 -03:00
oobabooga e5ff4ddfc8 Add bot prefix modifier option in extensions 2023-01-29 10:11:59 -03:00
oobabooga b6d01bb704 Enable extensions in all modes, not just chat 2023-01-29 09:48:18 -03:00
oobabooga 1a139664f5 Grammar 2023-01-29 02:54:36 -03:00
oobabooga 2d134031ca Apply extensions to character greeting 2023-01-29 00:04:11 -03:00
oobabooga e349b52256 Read extensions parameters from settings file 2023-01-28 23:21:40 -03:00
oobabooga 2239be2351 Support for number/bool extension parameters 2023-01-28 23:08:28 -03:00
oobabooga 6da94e358c Add support for extensions parameters 
Still experimental
 2023-01-28 23:00:51 -03:00
oobabooga e779fd795f Save TavernAI characters with TavernAI- prefix 2023-01-28 21:01:56 -03:00
oobabooga 833a1138fa Explain the dialogue tokenization output 2023-01-28 20:41:02 -03:00
oobabooga 545b7395b2 Prevent huge --help outputs 2023-01-28 20:36:51 -03:00
oobabooga f4c455ce29
Merge pull request #30 from 10sa/patch-1 
Add listening port options for listening mode.
 2023-01-28 20:35:20 -03:00
oobabooga 7b283a4a3d
Update server.py 2023-01-28 20:35:05 -03:00
oobabooga f4674d34a9 Reorganize chat UI elements 2023-01-28 20:28:08 -03:00
oobabooga 3687962e6c Add support for TavernAI character cards (closes #31) 2023-01-28 20:18:23 -03:00
oobabooga f71531186b Upload profile pictures from the web UI 2023-01-28 19:16:37 -03:00
Tensa 3742d3b18a
Add listening port options for listening mode. 2023-01-28 03:38:34 +09:00
oobabooga 69ffef4391 History loading minor bug fix 2023-01-27 12:01:11 -03:00
oobabooga 8b8236c6ff Fix Regenerate button bug 2023-01-27 11:14:19 -03:00
oobabooga 1d1f931757 Load extensions at startup 2023-01-27 10:53:05 -03:00
oobabooga 70e034589f Update the export/load chat history functions 2023-01-27 02:16:05 -03:00
oobabooga 6b5dcd46c5 Add support for extensions 
This is experimental.
 2023-01-27 00:40:39 -03:00
oobabooga e69990e37b Change order of upload and download tabs in chat mode 2023-01-26 16:57:12 -03:00
oobabooga ac6065d5ed Fix character loading bug 2023-01-26 13:45:19 -03:00
oobabooga 61611197e0 Add --verbose option (oops) 2023-01-26 02:18:06 -03:00
oobabooga abc920752f Stop at eos_token while streaming text (for #26) 2023-01-25 22:27:04 -03:00
oobabooga b77933d327 File names must be img_me.jpg and img_bot.jpg 2023-01-25 19:40:30 -03:00
oobabooga fc73188ec7 Allow specifying your own profile picture in chat mode 2023-01-25 19:37:44 -03:00
oobabooga 3fa14befc5 Bump the gradio version, add back the queue 2023-01-25 16:10:35 -03:00