oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-02-05 07:14:17 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
5166 commits 8 branches 92 tags 67 MiB
Commit graph

531 commits

Author SHA1 Message Date
tdrussell 72f6fc6923
Rename additive_repetition_penalty to presence_penalty, add frequency_penalty (#4376) 2023-10-25 12:10:28 -03:00
tdrussell 4440f87722
Add additive_repetition_penalty sampler setting. (#3627) 2023-10-23 02:28:07 -03:00
Jiashu Xu c544f5cc51
Support LLaVA v1.5 7B (#4348) 2023-10-22 12:49:04 -03:00
FartyPants (FP HAM) 6a61158adf
Training PRO a month worth of updates (#4345) 2023-10-22 12:38:09 -03:00
oobabooga 1a34927314 Make API URLs more visible 2023-10-21 21:11:07 -07:00
Haotian Liu 32984ea2f0
Support LLaVA v1.5 (#4305) 2023-10-20 02:28:14 -03:00
missionfloyd c0ffb77fd8
More silero languages (#3950) 2023-10-16 17:12:32 -03:00
hronoas db7ecdd274
openai: fix empty models list on query present in url (#4139) 2023-10-16 17:02:47 -03:00
Jesus Alvarez ed66ca3cdf
Add HTTPS support to APIs (openai and default) (#4270) 
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-10-13 01:31:13 -03:00
Haotian Liu 2b75d725e6
Initial support for LLaVA-LLaMA-2. (#3377) 2023-10-10 18:40:52 -03:00
James Braza 8614c9d085
README for superboogav2 (#4212) 
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-10-07 19:50:39 -03:00
oobabooga 2a7cb346dd Update the whisper_stt requirements 2023-10-06 21:01:26 -07:00
oobabooga d33facc9fe
Bump to pytorch 11.8 (#4209) 2023-10-07 00:23:49 -03:00
Chenxiao Wang 3fb1e0236a
fix: update superboogav2 requirements.txt (#4100) 2023-09-27 23:45:59 -03:00
missionfloyd 86e7c05429
Delete extensions/Training_PRO/readme.md (#4112) 2023-09-27 23:45:13 -03:00
Sam a0d99dcf90
fix: add missing superboogav2 dep (#4099) 2023-09-26 23:37:22 -03:00
HideLord 0845724a89
Supercharging superbooga (#3272) 2023-09-26 21:30:19 -03:00
oobabooga 08cf150c0c
Add a grammar editor to the UI (#4061) 2023-09-24 18:05:24 -03:00
oobabooga b227e65d86 Add grammar to llama.cpp loader (closes #4019) 2023-09-24 07:10:45 -07:00
Chenxiao Wang 9de2dfa887
extensions/openai: Fix error when preparing cache for embedding models (#3995) 2023-09-24 00:58:28 -03:00
oobabooga 5dd212cf52 TTS extensions fixes after #4022 2023-09-22 14:58:51 -07:00
FartyPants 26f10854f3
Training PRO extension update (#4036) 2023-09-22 18:51:31 -03:00
oobabooga d43d150b1e Fix a bug in the chat API (closes #4034) 2023-09-22 09:40:07 -07:00
oobabooga d6814d7c15 Fix a bug in the API (closes #4027) 2023-09-21 17:54:53 -07:00
Chenxiao Wang 347aed4254
extensions/openai: load extension settings via settings.yaml (#3953) 2023-09-17 22:39:29 -03:00
FartyPants 230b562d53
Training_PRO extension - added target selector (#3969) 2023-09-17 17:00:00 -03:00
oobabooga 763ea3bcb2 Improved multimodal error message 2023-09-17 09:22:16 -07:00
FartyPants e34c6e6938
Training PRO extension (#3961) 2023-09-17 11:09:31 -03:00
Shulzhenko Anatolii 0668f4e67f
Add speechrecognition dependency for OpenAI extension (#3959) 2023-09-16 13:49:48 -03:00
wizd cc7f345c29
add whisper api to openai plugin (#3958) 2023-09-16 12:04:04 -03:00
Lu Guanghua cd534ba46e
Fix Google Translate escaping (#3827) 
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-09-16 10:18:06 -03:00
oobabooga f5fb1ee666 Change a comment 2023-09-15 20:16:30 -07:00
oobabooga 2c1b548cea Minor fix 2023-09-15 20:14:32 -07:00
oobabooga 8f97e87cac Lint the openai extension 2023-09-15 20:11:16 -07:00
saltacc f01b9aa71f
Add customizable ban tokens (#3899) 2023-09-15 18:27:27 -03:00
jllllll 8250d0149d
Fix pydantic version conflict in elevenlabs extension (#3927) 2023-09-14 13:42:13 -03:00
Chang Chi, Meng b61d9aef19
openai API: add support for chunked transfer encoding in POST requests (#3870) 2023-09-12 15:54:42 -03:00
missionfloyd 43ec9d1619
silero_tts: Add language option (#3878) 2023-09-12 15:49:46 -03:00
oobabooga df123a20fc Prevent extra keys from being saved to settings.yaml 2023-09-11 20:13:10 -07:00
oobabooga 47d1ca467b Pin pandas version in superbooga 2023-09-11 18:34:34 -07:00
oobabooga 9331ab4798
Read GGUF metadata (#3873) 2023-09-11 18:49:30 -03:00
oobabooga b2f7ca0d18 Cloudfare fix 2 2023-08-29 19:54:43 -07:00
oobabooga 6c16e4cecf Cloudfare fix 
Credits: https://github.com/oobabooga/text-generation-webui/issues/1524#issuecomment-1698255209
 2023-08-29 16:35:44 -07:00
oobabooga cec8db52e5
Add max_tokens_second param (#3533) 2023-08-29 17:44:31 -03:00
oobabooga 1a642c12b5 Fix silero_tts HTML unescaping 2023-08-26 00:45:07 -07:00
oobabooga a2c67262c7 Unescape model output for silero/elevenlabs 2023-08-24 17:27:12 -07:00
tdrussell 2da38e89e6
Fix whitespace formatting in perplexity_colors extension. (#3643) 2023-08-22 16:49:37 -03:00
oobabooga 6394fef1db Rewrite tab detection js 2023-08-20 21:02:53 -07:00
SeanScripts 2c1fd0d72b
Add probability dropdown to perplexity_colors extension (#3148) 2023-08-20 20:28:14 -03:00
oobabooga eaf5f0f089 Merge remote-tracking branch 'refs/remotes/origin/main' 2023-08-17 11:38:29 -07:00
oobabooga 669c640eb4 Fix extensions block appearing where it shouldn't 2023-08-17 11:37:14 -07:00
ausboss a954b3e7de
fixes error when not specifying tunnel id (#3606) 2023-08-17 15:20:36 -03:00
oobabooga 2a29208224
Add a "Show controls" button to chat UI (#3590) 2023-08-16 02:39:58 -03:00
oobabooga 3ae2cee446 Fix empty space when the gallery is hidden 2023-08-13 06:09:27 -07:00
oobabooga 919a3cf9d0 Fix the gallery 2023-08-13 05:43:09 -07:00
oobabooga a1a9ec895d
Unify the 3 interface modes (#3554) 2023-08-13 01:12:15 -03:00
Hans Raaf f4caaf337a
Fix superbooga when using regenerate (#3362) 2023-08-08 23:26:28 -03:00
Friedemann Lipphardt 901b028d55
Add option for named cloudflare tunnels (#3364) 2023-08-08 22:20:27 -03:00
jllllll 2cf64474f2
Use chat_instruct_command in API (#3482) 2023-08-06 23:46:25 -03:00
oobabooga c237ce607e Move characters/instruction-following to instruction-templates 2023-08-06 17:50:32 -07:00
oobabooga 0af10ab49b
Add Classifier Free Guidance (CFG) for Transformers/ExLlama (#3325) 2023-08-06 17:22:48 -03:00
SodaPrettyCold 23055b21ee
[Bug fix] Remove html tags form the Prompt sent to Stable Diffusion (#3151) 2023-08-04 20:20:28 -03:00
oobabooga ed57a79c6e
Add back silero preview by @missionfloyd (#3446) 2023-08-04 02:29:14 -03:00
matatonic 8f98268252
extensions/openai: include content-length for json replies (#3416) 2023-08-03 16:10:49 -03:00
rafa-9 d578baeb2c
Use character settings from API properties if present (#3428) 2023-08-03 15:56:40 -03:00
oobabooga e074538b58 Revert "Make long_replies ban the eos token as well" 
This reverts commit 6c521ce967.
 2023-08-02 21:45:10 -07:00
oobabooga e931844fe2
Add auto_max_new_tokens parameter (#3419) 2023-08-02 14:52:20 -03:00
oobabooga 6c521ce967 Make long_replies ban the eos token as well 2023-08-01 18:47:49 -07:00
matatonic 9ae0eab989
extensions/openai: +Array input (batched) , +Fixes (#3309) 2023-08-01 22:26:00 -03:00
oobabooga d06c34dea5
Add an extension that makes chat replies longer (#3363) 2023-07-31 13:34:41 -03:00
oobabooga ca4188aabc Update the example extension 2023-07-29 18:57:22 -07:00
GuizzyQC 4b37a2b397
sd_api_pictures: Widen sliders for image size minimum and maximum (#3326) 2023-07-26 13:49:46 -03:00
oobabooga f24f87cfb0 Change a comment 2023-07-26 09:38:13 -07:00
oobabooga b553c33dd0 Add a link to the gradio docs 2023-07-26 07:49:22 -07:00
oobabooga b11f63cb18 update extensions docs 2023-07-26 07:00:33 -07:00
oobabooga ef8637e32d
Add extension example, replace input_hijack with chat_input_modifier (#3307) 2023-07-25 18:49:56 -03:00
matatonic 90a4ab631c
extensions/openai: Fixes for: embeddings, tokens, better errors. +Docs update, +Images, +logit_bias/logprobs, +more. (#3122) 2023-07-24 11:28:12 -03:00
iongpt 74fc5dd873
Add user-agent to download-model.py requests (#3243) 2023-07-24 11:19:13 -03:00
SeanScripts 9800745db9
Color tokens by probability and/or perplexity (#3078) 2023-07-13 17:30:22 -03:00
oobabooga 2463d7c098 Spaces 2023-07-12 11:35:43 -07:00
oobabooga e202190c4f lint 2023-07-12 11:33:25 -07:00
oobabooga 180420d2c9 Fix send_pictures extension 2023-07-11 20:56:01 -07:00
atriantafy d9fabdde40
Add context_instruct to API. Load default model instruction template … (#2688) 2023-07-12 00:01:03 -03:00
Keith Kjer 37bffb2e1a
Add reference to new pipeline in multimodal readme (#2947) 2023-07-11 19:04:15 -03:00
Juliano Henriquez 1fc0b5041e
substitu superboog Beatiful Soup Parser (#2996) 
* add lxml to requirments

add lxml to requirments

* Change Beaitful Soup Parser

"lxml" parser which might be more tolerant of certain kinds of parsing errors than "html.parser" and quicker at the same time.
 2023-07-11 19:02:49 -03:00
Salvador E. Tropea ab044a5a44
Elevenlabs tts fixes (#2959) 
* [Fixed] Keep setting option for the voice

- It was always changed to the first available voice
- Also added an error if the selected voice isn't valid

* [Fixed] elevenlabs_tts API key handling

- The one from the settings wasn't applied
- We always got "Enter your API key", even when the settings specified
  an api_key

* [Added] elevenlabs_tts model selection

- Now we can also use the "eleven_multilingual_v1" model.
  Used for anything but english.
 2023-07-11 19:00:37 -03:00
matatonic 3e7feb699c
extensions/openai: Major openai extension updates & fixes (#3049) 
* many openai updates

* total reorg & cleanup.

* fixups

* missing import os for images

* +moderations, custom_stopping_strings, more fixes

* fix bugs in completion streaming

* moderation fix (flagged)

* updated moderation categories

---------

Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
 2023-07-11 18:50:08 -03:00
Salvador E. Tropea 463aac2d65
[Added] google_translate activate param (#2961) 
- So you can quickly enable/disable it, otherwise you must select
  English to disable it, and then your language to enable it again.
 2023-07-09 01:08:20 -03:00
Chris Rude 70b088843d
fix for issue #2475: Streaming api deadlock (#3048) 2023-07-08 23:21:20 -03:00
Brandon McClure acf24ebb49
Whisper_stt params for model, language, and auto_submit (#3031) 2023-07-07 20:54:53 -03:00
oobabooga 70a4d5dbcf Update chat API (fixes #3006) 2023-07-04 17:36:47 -07:00
oobabooga 463ddfffd0 Fix start_with 2023-07-03 23:32:02 -07:00
oobabooga 4b1804a438
Implement sessions + add basic multi-user support (#2991) 2023-07-04 00:03:30 -03:00
oobabooga 3443219cbc
Add repetition penalty range parameter to transformers (#2916) 2023-06-29 13:40:13 -03:00
missionfloyd 5008daa0ff
Add exception handler to load_checkpoint() (#2904) 2023-06-27 22:00:29 -03:00
oobabooga 67a83f3ad9 Use DPM++ 2M Karras for Stable Diffusion 2023-06-27 18:47:35 -03:00
Minecrafter20 40bbd53640
Add custom prompt format for SD API pictures (#1964) 2023-06-27 17:49:18 -03:00
missionfloyd cb029cf65f
Get SD samplers from API (#2889) 2023-06-27 17:31:54 -03:00
GuizzyQC d7a7f7896b
Add SD checkpoint selection in sd_api_pictures (#2872) 2023-06-27 17:29:27 -03:00
oobabooga c52290de50
ExLlama with long context (#2875) 2023-06-25 22:49:26 -03:00
matatonic b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements (#2849) 2023-06-24 22:50:04 -03:00
rizerphe 77baf43f6d
Add CORS support to the API (#2718) 2023-06-24 10:16:06 -03:00
matatonic 1e97aaac95
extensions/openai: docs update, model loader, minor fixes (#2557) 2023-06-17 19:15:24 -03:00
oobabooga 7ef6a50e84
Reorganize model loading UI completely (#2720) 2023-06-16 19:00:37 -03:00
oobabooga 134430bbe2 Minor change 2023-06-14 11:34:42 -03:00
oobabooga 474dc7355a Allow API requests to use parameter presets 2023-06-14 11:32:20 -03:00
oobabooga c6552785af Minor cleanup 2023-06-09 00:30:22 -03:00
matatonic 7be6fe126b
extensions/api: models api for blocking_api (updated) (#2539) 2023-06-08 11:34:36 -03:00
bobzilla 643c44e975
Add ngrok shared URL ingress support (#1944) 2023-06-06 07:34:20 -03:00
matatonic 4a17a5db67
[extensions/openai] various fixes (#2533) 2023-06-06 01:43:04 -03:00
oobabooga d183c7d29e Fix streaming japanese/chinese characters 
Credits to matasonic for the idea
 2023-06-02 02:09:52 -03:00
matatonic a6d3f010a5
extensions/openai: include all available models in Model.list (#2368) 
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
 2023-05-30 22:13:37 -03:00
matatonic e5b756ecfe
Fixes #2331, IndexError: string index out of range (#2383) 2023-05-30 22:07:40 -03:00
Yiximail 4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation (#2392) 2023-05-30 22:03:40 -03:00
matatonic ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) (#2423) 2023-05-30 21:54:24 -03:00
matatonic df50f077db
fixup missing tfs top_a params, defaults reorg (#2443) 2023-05-30 21:52:33 -03:00
oobabooga 8e0a997c60
Add new parameters to API extension 2023-05-29 22:03:08 -03:00
matatonic 2b7ba9586f
Fixes #2326, KeyError: 'assistant' (#2382) 2023-05-29 14:19:57 -03:00
Elias Vincent Simon 2cf711f35e
update SpeechRecognition dependency (#2345) 2023-05-26 00:34:57 -03:00
Luis Lopez 0dbc3d9b2c
Fix get_documents_ids_distances return error when n_results = 0 (#2347) 2023-05-25 23:25:36 -03:00
Luis Lopez ee674afa50
Add superbooga time weighted history retrieval (#2080) 2023-05-25 10:22:45 -03:00
Gabriel Terrien e50ade438a
FIX silero_tts/elevenlabs_tts activation/deactivation (#2313) 2023-05-24 10:06:38 -03:00
Anthony K 7dc87984a2
Fix spelling mistake in new name var of chat api (#2309) 2023-05-23 23:03:03 -03:00
matatonic 9714072692
[extensions/openai] use instruction templates with chat_completions (#2291) 2023-05-23 19:58:41 -03:00
oobabooga 74aae34beb Allow passing your name to the chat API 2023-05-23 19:39:18 -03:00
oobabooga 4d94a111d4 memoize load_character to speed up the chat API 2023-05-23 00:50:58 -03:00
oobabooga c0fd7f3257
Add mirostat parameters for llama.cpp (#2287) 2023-05-22 19:37:24 -03:00
oobabooga e116d31180 Prevent unwanted log messages from modules 2023-05-21 22:42:34 -03:00
oobabooga 8ac3636966
Add epsilon_cutoff/eta_cutoff parameters (#2258) 2023-05-21 15:11:57 -03:00
oobabooga 767a767989 Fix elevenlabs_tts too 2023-05-21 14:11:46 -03:00
oobabooga 1e5821bd9e Fix silero tts autoplay (attempt #2) 2023-05-21 13:25:11 -03:00
oobabooga a5d5bb9390 Fix silero tts autoplay 2023-05-21 12:11:59 -03:00
matatonic 78b2478d9c
assistant: space fix, system: prompt fix (#2219) 2023-05-20 23:32:34 -03:00
Luis Lopez 9c53517d2c
Fix superbooga error when querying empty DB (Issue #2160) (#2212) 2023-05-20 22:27:22 -03:00
oobabooga c5af549d4b
Add chat API (#2233) 2023-05-20 18:42:17 -03:00
oobabooga ad0b71af11 Add missing file 2023-05-17 00:37:34 -03:00
oobabooga a84f499718 Allow extensions to define custom CSS and JS 2023-05-17 00:30:54 -03:00
pixel 458a627ab9
fix: elevenlabs cloned voices do not show up in webui after entering API key (#2107) 2023-05-16 20:21:36 -03:00
Orbitoid 428261eede
fix: elevenlabs removed the need for the api key for refreshing voices (#2097) 2023-05-16 13:34:49 -03:00
atriantafy 26cf8c2545
add api port options (#1990) 2023-05-15 20:44:16 -03:00
oobabooga 897fa60069 Sort selected superbooga chunks by insertion order 
For better coherence
 2023-05-14 22:19:29 -03:00
Luis Lopez b07f849e41
Add superbooga chunk separator option (#2051) 2023-05-14 21:44:52 -03:00
matatonic ab08cf6465
[extensions/openai] clip extra leading space (#2042) 2023-05-14 12:57:52 -03:00
oobabooga 5f6cf39f36 Change the injection context string 2023-05-13 14:23:02 -03:00
oobabooga 7cc17e3f1f Refactor superbooga 2023-05-13 14:15:40 -03:00
oobabooga 826c74c201 Expand superbooga to instruct mode and change the chat implementation 2023-05-13 12:50:19 -03:00
oobabooga c746a5bd00 Add .rstrip(' ') to openai api 2023-05-12 14:40:48 -03:00
Damian Stewart 3f1bfba718
Clarify how to start server.py with multimodal API support (#2025) 2023-05-12 14:37:49 -03:00
oobabooga 146a9cb393 Allow superbooga to download URLs in parallel 2023-05-12 14:19:55 -03:00
matatonic f98fd01dcd
is_chat=False for /edits (#2011) 2023-05-11 19:15:11 -03:00
oobabooga 0d36c18f5d Always return only the new tokens in generation functions 2023-05-11 17:07:20 -03:00
matatonic c4f0e6d740
is_chat changes fix for openai extension (#2008) 2023-05-11 16:32:25 -03:00
oobabooga 638c6a65a2
Refactor chat functions (#2003) 2023-05-11 15:37:04 -03:00
matatonic 309b72e549
[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes (#1935) 2023-05-11 11:06:39 -03:00
oobabooga 943b5e5f80 Minor bug fix 2023-05-10 23:54:25 -03:00
oobabooga 9695bfe117 Add an option for cleaning up html in superbooga 2023-05-10 23:51:52 -03:00
oobabooga f1d10edcb7
Update README.md 2023-05-10 12:13:14 -03:00
oobabooga c35860ff2f Add a link to silero samples 2023-05-10 01:39:35 -03:00
oobabooga 3913155c1f
Style improvements (#1957) 2023-05-09 22:49:39 -03:00
missionfloyd fe4dfc647d
SileroTTS preview (#1934) 2023-05-09 20:28:59 -03:00
oobabooga 8fa5f651d6 Style changes 2023-05-09 20:20:35 -03:00
Wojtab e9e75a9ec7
Generalize multimodality (llava/minigpt4 7b and 13b now supported) (#1741) 2023-05-09 20:18:02 -03:00
Jeffrey Lin 791a38bad1
[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client (#1876) 2023-05-08 22:31:34 -03:00
kaiokendev 0e27b660e8
Fix issue where n_results/k > index size (#1929) 2023-05-08 21:16:00 -03:00
oobabooga b5260b24f1
Add support for custom chat styles (#1917) 2023-05-08 12:35:03 -03:00
oobabooga 82eb284a3f Fix a bug in silero tts 2023-05-07 23:59:43 -03:00
oobabooga b3bbda22d1 Exception handling 2023-05-07 16:50:45 -03:00
oobabooga 8515f19078 Fix typing error 2023-05-07 16:25:39 -03:00
oobabooga 6b67cb6611 Generalize superbooga to chat mode 2023-05-07 15:05:26 -03:00
oobabooga ec1cda0e1f Rename superbig to superbooga 2023-05-07 13:29:49 -03:00
oobabooga 8216c8f732 Handle multiline inputs 2023-05-07 11:54:26 -03:00
oobabooga a35a2fab02 Reorganize superbig ui 2023-05-07 11:30:16 -03:00
oobabooga befa307c42 Add support for loading multiple URLs into superbig 2023-05-07 11:08:02 -03:00
oobabooga 04eca9b65b Make chunk length/count customizable 2023-05-07 05:02:04 -03:00
oobabooga 8c06eeaf84 Add requirement 2023-05-07 04:50:12 -03:00
oobabooga 58f9a30be1 Add support for input file/url in superbig 2023-05-07 04:49:02 -03:00
oobabooga 6afba065a1 Only update the chroma database when necessary 2023-05-07 04:03:17 -03:00
kaiokendev 5a4bd3918c
Add SuperBIG extension (alpha) (#1548) 
---------

Co-authored-by: kaiokendev <>
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-05-07 03:50:12 -03:00
oobabooga 85238de421 Remove unused variable 2023-05-06 11:03:12 -03:00
oobabooga de9c4e260e
Minor fixes to elevenlabs_tts 2023-05-06 10:57:34 -03:00
Steve Randall b03a2ac512
Elevenlabs Extension Improvement and migration to official API (#1830) 2023-05-06 10:56:31 -03:00
oobabooga 8aafb1f796
Refactor text_generation.py, add support for custom generation functions (#1817) 2023-05-05 18:53:03 -03:00
oobabooga 4bf7253ec5 Fix typing bug in api 2023-05-03 19:27:20 -03:00
Thireus ☠ 4883e20fa7
Fix openai extension script.py - TypeError: '_Environ' object is not callable (#1753) 2023-05-03 09:51:49 -03:00
Wojtab 80c2f25131
LLaVA: small fixes (#1664) 
* change multimodal projector to the correct one

* remove reference to custom stopping strings from readme

* fix stopping strings if tokenizer extension adds/removes tokens

* add API example

* LLaVA 7B just dropped, add to readme that there is no support for it currently
 2023-05-02 23:12:22 -03:00
oobabooga c31b0f15a7 Remove some spaces 2023-05-02 23:07:07 -03:00
oobabooga 320fcfde4e Style/pep8 improvements 2023-05-02 23:05:38 -03:00
matatonic 7ac41b87df
add openai compatible api (#1475) 2023-05-02 22:49:53 -03:00
oobabooga 88cdf6ed3d Prevent websocket from disconnecting 2023-05-02 19:03:19 -03:00
oobabooga d87ca8f2af LLaVA fixes 2023-04-26 03:47:34 -03:00
oobabooga 68ed73dd89 Make API extension print its exceptions 2023-04-25 23:23:47 -03:00
Wojtab 65beb51b0b
fix returned dtypes for LLaVA (#1547) 2023-04-25 21:25:34 -03:00
MajdajkD c86e9a3372
fix websocket batching (#1511) 2023-04-24 03:51:32 -03:00
Wojtab 04b98a8485
Fix Continue for LLaVA (#1507) 2023-04-23 22:58:15 -03:00
Wojtab 12212cf6be
LLaVA support (#1487) 2023-04-23 20:32:22 -03:00
Andy Salerno 654933c634
New universal API with streaming/blocking endpoints (#990) 
Previous title: Add api_streaming extension and update api-example-stream to use it

* Merge with latest main

* Add parameter capturing encoder_repetition_penalty

* Change some defaults, minor fixes

* Add --api, --public-api flags

* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.

* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'

* Update the API examples

* Change a comment

* Update README

* Remove the gradio API

* Remove unused import

* Minor change

* Remove unused import

---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-04-23 15:52:43 -03:00
oobabooga 7ff645899e Fix bug in api extension 2023-04-22 17:33:36 -03:00
AICatgirls b992c9236a
Prevent API extension responses from getting cut off with --chat enabled (#1467) 2023-04-22 16:06:43 -03:00
Φφ 143e88694d
SD_api_pictures: Modefix, +hires options, UI layout change (#1400) 2023-04-21 17:49:18 -03:00
oobabooga ff0d0ac552 Api extension bug fix 2023-04-20 13:26:58 -03:00
oobabooga 96ba55501c Rename custom_stopping_strings in the api extension 2023-04-20 00:15:32 -03:00
oobabooga b0c762ceba
Revert a change 
I think that this may be needed for some clients
 2023-04-18 04:10:45 -03:00
oobabooga 163ea295e7 Fix but in API extension 2023-04-17 13:54:15 -03:00
oobabooga 19e3a59997 Remove unused extension 2023-04-17 11:06:08 -03:00
GuizzyQC 5011f94659
Improved compatibility between silero and sd_api_pictures (#1196) 2023-04-16 21:18:52 -03:00
oobabooga b937c9d8c2
Add skip_special_tokens checkbox for Dolly model (#1218) 2023-04-16 14:24:49 -03:00
Lou Bernardi 4d13cc0a1f
Suppress whisper_stt pip warning (#1215) 2023-04-15 01:15:59 -03:00
oobabooga 7a0ef1c941 Reorganize whisper extension 2023-04-13 10:40:27 -03:00
Φφ 1d8526849b
SD_api_pictures: Fix for metadata (#1082) 2023-04-12 11:42:30 -03:00
oobabooga 4f7e88c043 Simplify send_pictures 2023-04-12 10:30:12 -03:00
oobabooga 80f4eabb2a Fix send_pictures extension 2023-04-12 10:27:06 -03:00
oobabooga 49ce866c99 Fix silero_tts 2023-04-12 00:58:11 -03:00
Tymec 832ee4323d
API: add endpoint for counting tokens (#1051) 2023-04-11 23:08:42 -03:00
Alexander01998 61641a4551
Add missing new parameters to API extension 2023-04-11 22:41:13 -03:00
oobabooga dc3c9d00a0 Update the API extension 2023-04-11 13:07:45 -03:00
oobabooga 64f5c90ee7 Fix the API extension 2023-04-10 20:14:38 -03:00
BlueprintCoding 8178fde2cb
Added dropdown to character bias. (#986) 2023-04-09 23:44:31 -03:00
Φφ c97c270040
Send_pictures small fix (#546) 2023-04-08 01:55:16 -03:00
Φφ ffd102e5c0
SD Api Pics extension, v.1.1 (#596) 2023-04-07 21:36:04 -03:00
oobabooga 5543a5089d Auto-submit the whisper extension transcription 2023-04-07 15:57:51 -03:00
oobabooga 1dc464dcb0 Sort imports 2023-04-07 14:42:03 -03:00
Φφ e563b015d8
Silero TTS offline cache (#628) 2023-04-07 12:15:57 -03:00
oobabooga 1c413ed593 Remove torch from silero 2023-04-07 11:51:50 -03:00
da3dsoul 3f922d4bfb
Extract the Preprocessing for Silero into a file and Improve it (#757) 2023-04-07 11:46:29 -03:00
oobabooga 46c4654226 More PEP8 stuff 2023-04-07 00:52:02 -03:00
oobabooga ea6e77df72
Make the code more like PEP8 for readability (#862) 2023-04-07 00:15:45 -03:00
oobabooga 3f3e42e26c
Refactor several function calls and the API 2023-04-06 01:22:15 -03:00
oobabooga e722c240af Add Instruct mode 2023-04-05 13:54:50 -03:00
oobabooga ca8bb38949 Simplify gallery 2023-04-05 00:34:17 -03:00
oobabooga 80dfba05f3 Better crop/resize cached images 2023-04-04 22:52:15 -03:00
oobabooga 65d8a24a6d Show profile pictures in the Character tab 2023-04-04 22:28:49 -03:00
Niels Mündler 7aab88bcc6
Give API extension access to all generate_reply parameters (#744) 
* Make every parameter of the generate_reply function parameterizable

* Add stopping strings as parameterizable
 2023-04-03 13:31:12 -03:00
TheTerrasque 2157bb4319
New yaml character format (#337 from TheTerrasque/feature/yaml-characters) 
This doesn't break backward compatibility with JSON characters.
 2023-04-02 20:34:25 -03:00
oobabooga b0890a7925 Add shared.is_chat() function 2023-04-01 20:15:00 -03:00
oobabooga 3b90d604d7 Sort the imports 2023-03-31 02:01:48 -03:00
ye7iaserag ec093a5af7
Fix div alignment for long strings 2023-03-31 06:54:24 +02:00
oobabooga 3737eafeaa Remove a border and allow more characters per pagination page 2023-03-31 00:48:50 -03:00
ye7iaserag f9940b79dc
Implement character gallery using Dataset 2023-03-31 04:56:49 +02:00
Maya Eary d1377c37af Fixes for api server - chat mode and integer temperature 2023-03-28 20:57:16 +03:00
Φφ 1a1e420e65 Silero_tts streaming fix 
Temporarily suppress the streaming during the audio response as it would interfere with the audio (making it stutter and play anew)
 2023-03-25 21:33:30 +03:00
oobabooga bfe960731f
Merge branch 'main' into fix/api-reload 2023-03-24 16:54:41 -03:00
oobabooga 4a724ed22f
Reorder imports 2023-03-24 16:53:56 -03:00
oobabooga d5fc1bead7
Merge pull request #489 from Brawlence/ext-fixes 
Extensions performance & memory optimisations
 2023-03-22 16:10:59 -03:00
oobabooga bfb1be2820
Minor fix 2023-03-22 16:09:48 -03:00
oobabooga 0abff499e2
Use image.thumbnail 2023-03-22 16:03:05 -03:00
oobabooga 104212529f
Minor changes 2023-03-22 15:55:03 -03:00
wywywywy 61346b88ea
Add "seed" menu in the Parameters tab 2023-03-22 15:40:20 -03:00
Φφ 5389fce8e1 Extensions performance & memory optimisations 
Reworked remove_surrounded_chars() to use regular expression ( https://regexr.com/7alb5 ) instead of repeated string concatenations for elevenlab_tts, silero_tts, sd_api_pictures. This should be both faster and more robust in handling asterisks.

Reduced the memory footprint of send_pictures and sd_api_pictures by scaling the images in the chat to 300 pixels max-side wise. (The user already has the original in case of the sent picture and there's an option to save the SD generation).
This should fix history growing annoyingly large with multiple pictures present
 2023-03-22 11:51:00 +03:00
oobabooga 536d0a4d93
Add an import 2023-03-20 14:00:40 -03:00
oobabooga a90f507abe
Exit elevenlabs_tts if streaming is enabled 2023-03-20 11:49:42 -03:00