Commit graph

376 commits

Author SHA1 Message Date
81300 20dbef9623
Extend bfloat16 support 2023-02-09 20:00:03 +02:00
oobabooga 04d3d0aee6
Add 1-click windows installer (for #45) 2023-02-09 13:27:30 -03:00
oobabooga a21620fc59 Update README 2023-02-08 01:17:50 -03:00
oobabooga cadd100405 min_length has to be 0 when streaming is on 2023-02-08 00:23:35 -03:00
oobabooga 6be571cff7 Better variable names 2023-02-08 00:19:20 -03:00
oobabooga fc0493d885 Add credits 2023-02-08 00:09:41 -03:00
oobabooga 58b07cca81 length_penalty can be negative (apparently) 2023-02-07 23:33:02 -03:00
oobabooga d038963193 Rename a variable (for #59) 2023-02-07 23:26:02 -03:00
oobabooga 7e4c25691d Repetition penalty has to be < 5 2023-02-07 23:23:39 -03:00
oobabooga 1c30e1b49a Add even more sliders 2023-02-07 23:11:04 -03:00
oobabooga 24dc705eca Add lots of sliders 2023-02-07 22:08:21 -03:00
oobabooga 53af062fa5
Update README.md 2023-02-05 23:14:25 -03:00
oobabooga a2519ede90
Merge pull request #57 from martinnj/fix/tokenize-dialogue-regex-backref
Fix a regex issue in `tokenize_dialogue`.
2023-02-05 14:09:19 -03:00
Martin J 06a4664805 Fix a regex issue in tokenize_dialogue.
The existing regex would fail if using character names that start with
numbers, for example: 9S or 2B.
2023-02-05 07:42:57 +01:00
oobabooga 2fe235738e Reorganize chat buttons 2023-02-04 22:53:42 -03:00
oobabooga 2207d44986 Windows doesn't like : in filenames 2023-02-04 20:07:39 -03:00
oobabooga b4fc8dfa8f Add safetensors version 2023-02-04 18:58:17 -03:00
oobabooga 65266f3349 Fix loading official colab chat logs 2023-02-03 22:43:02 -03:00
oobabooga 54a6a74b7d Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-02-03 20:07:38 -03:00
oobabooga 3dbebe30b1 Remove deepspeed requirement (only works on Linux for now) 2023-02-03 20:07:13 -03:00
oobabooga 90bb2caffd
Update README.md 2023-02-03 19:45:11 -03:00
oobabooga 9215e281ba Add --threads option to the download script 2023-02-03 18:57:12 -03:00
oobabooga 03f084f311 Add safetensors support 2023-02-03 18:36:32 -03:00
oobabooga 93b0d1b1b8
Update README.md 2023-02-03 10:14:52 -03:00
oobabooga 44e8c671f9 Fix API documentation formatting in chat mode 2023-02-03 10:00:05 -03:00
oobabooga 03ebfba0fb Bump bitsandbytes version 2023-02-03 09:29:31 -03:00
oobabooga 6212b41930 Update README 2023-02-03 09:13:14 -03:00
oobabooga a28f0d8bd7 Show it/s in the same units with or without streaming
Closes #49
2023-02-03 09:11:11 -03:00
oobabooga 4e4cd67223 Save chat history with name/date in filename
closes #50
2023-02-03 09:02:35 -03:00
oobabooga 3af3ffeb90 Make --help output more readable 2023-02-02 23:36:28 -03:00
oobabooga 638495b633 Simplify generate() function 2023-02-02 13:47:08 -03:00
oobabooga 3f05cf5ddd Simplify encode() function 2023-02-02 13:31:32 -03:00
oobabooga afc2b0f4c8 Remove .gitignore 2023-02-02 12:42:49 -03:00
oobabooga 224be31a74 Use main bs4 package 2023-02-02 12:20:58 -03:00
oobabooga cecaebc291 Add bs4 requirement (fixes #47) 2023-02-02 12:18:32 -03:00
oobabooga 0c2eb444e6 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-02-02 12:17:02 -03:00
oobabooga 2583bc5840 Simplify deepspeed implementation (#40) 2023-02-02 12:15:44 -03:00
oobabooga 7f4315b120
Mention 8bit fix for Windows users
Closes #44, #20
2023-02-02 11:00:57 -03:00
oobabooga d6b2d68527 Remove redundant requirements 2023-02-02 10:40:09 -03:00
oobabooga f38c9bf428 Fix deepspeed (oops) 2023-02-02 10:39:37 -03:00
oobabooga 90f1067598 Move deepspeed parameters to another file 2023-02-02 10:25:09 -03:00
oobabooga 1a658b41aa
Merge pull request #43 from 81300/ds
Add DeepSpeed ZeRO-3 integration
2023-02-02 10:03:19 -03:00
oobabooga 39461bd796
Delete .gitignore 2023-02-02 10:01:56 -03:00
81300 248ec4fa21
Merge branch 'oobabooga:main' into ds 2023-02-01 20:50:51 +02:00
81300 a6f4760772
Add arg for bfloat16 2023-02-01 20:22:07 +02:00
81300 c515282f5c
no_split_module_classes not needed 2023-02-01 19:47:26 +02:00
81300 0a0d289537
Fix issue with generating on multiple GPUs 2023-02-01 19:02:07 +02:00
81300 a97afa6965
Add DeepSpeed ZeRO-3 integration 2023-02-01 18:48:13 +02:00
oobabooga 6b13816c47 Change default --disk behavior 2023-02-01 10:43:28 -03:00
oobabooga 119be56390 Add back low_cpu_mem_usage=True
Removing it didn't help with anything, so I am adding it bad on a purely
superstiticious basis.
2023-02-01 10:01:44 -03:00