Commit graph

295 commits

Author SHA1 Message Date
matatonic 3e7feb699c
extensions/openai: Major openai extension updates & fixes (#3049)
* many openai updates

* total reorg & cleanup.

* fixups

* missing import os for images

* +moderations, custom_stopping_strings, more fixes

* fix bugs in completion streaming

* moderation fix (flagged)

* updated moderation categories

---------

Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-07-11 18:50:08 -03:00
Salvador E. Tropea 463aac2d65
[Added] google_translate activate param (#2961)
- So you can quickly enable/disable it, otherwise you must select
  English to disable it, and then your language to enable it again.
2023-07-09 01:08:20 -03:00
Chris Rude 70b088843d
fix for issue #2475: Streaming api deadlock (#3048) 2023-07-08 23:21:20 -03:00
Brandon McClure acf24ebb49
Whisper_stt params for model, language, and auto_submit (#3031) 2023-07-07 20:54:53 -03:00
oobabooga 70a4d5dbcf Update chat API (fixes #3006) 2023-07-04 17:36:47 -07:00
oobabooga 463ddfffd0 Fix start_with 2023-07-03 23:32:02 -07:00
oobabooga 4b1804a438
Implement sessions + add basic multi-user support (#2991) 2023-07-04 00:03:30 -03:00
oobabooga 3443219cbc
Add repetition penalty range parameter to transformers (#2916) 2023-06-29 13:40:13 -03:00
missionfloyd 5008daa0ff
Add exception handler to load_checkpoint() (#2904) 2023-06-27 22:00:29 -03:00
oobabooga 67a83f3ad9 Use DPM++ 2M Karras for Stable Diffusion 2023-06-27 18:47:35 -03:00
Minecrafter20 40bbd53640
Add custom prompt format for SD API pictures (#1964) 2023-06-27 17:49:18 -03:00
missionfloyd cb029cf65f
Get SD samplers from API (#2889) 2023-06-27 17:31:54 -03:00
GuizzyQC d7a7f7896b
Add SD checkpoint selection in sd_api_pictures (#2872) 2023-06-27 17:29:27 -03:00
oobabooga c52290de50
ExLlama with long context (#2875) 2023-06-25 22:49:26 -03:00
matatonic b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements (#2849) 2023-06-24 22:50:04 -03:00
rizerphe 77baf43f6d
Add CORS support to the API (#2718) 2023-06-24 10:16:06 -03:00
matatonic 1e97aaac95
extensions/openai: docs update, model loader, minor fixes (#2557) 2023-06-17 19:15:24 -03:00
oobabooga 7ef6a50e84
Reorganize model loading UI completely (#2720) 2023-06-16 19:00:37 -03:00
oobabooga 134430bbe2 Minor change 2023-06-14 11:34:42 -03:00
oobabooga 474dc7355a Allow API requests to use parameter presets 2023-06-14 11:32:20 -03:00
oobabooga c6552785af Minor cleanup 2023-06-09 00:30:22 -03:00
matatonic 7be6fe126b
extensions/api: models api for blocking_api (updated) (#2539) 2023-06-08 11:34:36 -03:00
bobzilla 643c44e975
Add ngrok shared URL ingress support (#1944) 2023-06-06 07:34:20 -03:00
matatonic 4a17a5db67
[extensions/openai] various fixes (#2533) 2023-06-06 01:43:04 -03:00
oobabooga d183c7d29e Fix streaming japanese/chinese characters
Credits to matasonic for the idea
2023-06-02 02:09:52 -03:00
matatonic a6d3f010a5
extensions/openai: include all available models in Model.list (#2368)
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-05-30 22:13:37 -03:00
matatonic e5b756ecfe
Fixes #2331, IndexError: string index out of range (#2383) 2023-05-30 22:07:40 -03:00
Yiximail 4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation (#2392) 2023-05-30 22:03:40 -03:00
matatonic ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) (#2423) 2023-05-30 21:54:24 -03:00
matatonic df50f077db
fixup missing tfs top_a params, defaults reorg (#2443) 2023-05-30 21:52:33 -03:00
oobabooga 8e0a997c60
Add new parameters to API extension 2023-05-29 22:03:08 -03:00
matatonic 2b7ba9586f
Fixes #2326, KeyError: 'assistant' (#2382) 2023-05-29 14:19:57 -03:00
Elias Vincent Simon 2cf711f35e
update SpeechRecognition dependency (#2345) 2023-05-26 00:34:57 -03:00
Luis Lopez 0dbc3d9b2c
Fix get_documents_ids_distances return error when n_results = 0 (#2347) 2023-05-25 23:25:36 -03:00
Luis Lopez ee674afa50
Add superbooga time weighted history retrieval (#2080) 2023-05-25 10:22:45 -03:00
Gabriel Terrien e50ade438a
FIX silero_tts/elevenlabs_tts activation/deactivation (#2313) 2023-05-24 10:06:38 -03:00
Anthony K 7dc87984a2
Fix spelling mistake in new name var of chat api (#2309) 2023-05-23 23:03:03 -03:00
matatonic 9714072692
[extensions/openai] use instruction templates with chat_completions (#2291) 2023-05-23 19:58:41 -03:00
oobabooga 74aae34beb Allow passing your name to the chat API 2023-05-23 19:39:18 -03:00
oobabooga 4d94a111d4 memoize load_character to speed up the chat API 2023-05-23 00:50:58 -03:00
oobabooga c0fd7f3257
Add mirostat parameters for llama.cpp (#2287) 2023-05-22 19:37:24 -03:00
oobabooga e116d31180 Prevent unwanted log messages from modules 2023-05-21 22:42:34 -03:00
oobabooga 8ac3636966
Add epsilon_cutoff/eta_cutoff parameters (#2258) 2023-05-21 15:11:57 -03:00
oobabooga 767a767989 Fix elevenlabs_tts too 2023-05-21 14:11:46 -03:00
oobabooga 1e5821bd9e Fix silero tts autoplay (attempt #2) 2023-05-21 13:25:11 -03:00
oobabooga a5d5bb9390 Fix silero tts autoplay 2023-05-21 12:11:59 -03:00
matatonic 78b2478d9c
assistant: space fix, system: prompt fix (#2219) 2023-05-20 23:32:34 -03:00
Luis Lopez 9c53517d2c
Fix superbooga error when querying empty DB (Issue #2160) (#2212) 2023-05-20 22:27:22 -03:00
oobabooga c5af549d4b
Add chat API (#2233) 2023-05-20 18:42:17 -03:00
oobabooga ad0b71af11 Add missing file 2023-05-17 00:37:34 -03:00
oobabooga a84f499718 Allow extensions to define custom CSS and JS 2023-05-17 00:30:54 -03:00
pixel 458a627ab9
fix: elevenlabs cloned voices do not show up in webui after entering API key (#2107) 2023-05-16 20:21:36 -03:00
Orbitoid 428261eede
fix: elevenlabs removed the need for the api key for refreshing voices (#2097) 2023-05-16 13:34:49 -03:00
atriantafy 26cf8c2545
add api port options (#1990) 2023-05-15 20:44:16 -03:00
oobabooga 897fa60069 Sort selected superbooga chunks by insertion order
For better coherence
2023-05-14 22:19:29 -03:00
Luis Lopez b07f849e41
Add superbooga chunk separator option (#2051) 2023-05-14 21:44:52 -03:00
matatonic ab08cf6465
[extensions/openai] clip extra leading space (#2042) 2023-05-14 12:57:52 -03:00
oobabooga 5f6cf39f36 Change the injection context string 2023-05-13 14:23:02 -03:00
oobabooga 7cc17e3f1f Refactor superbooga 2023-05-13 14:15:40 -03:00
oobabooga 826c74c201 Expand superbooga to instruct mode and change the chat implementation 2023-05-13 12:50:19 -03:00
oobabooga c746a5bd00 Add .rstrip(' ') to openai api 2023-05-12 14:40:48 -03:00
Damian Stewart 3f1bfba718
Clarify how to start server.py with multimodal API support (#2025) 2023-05-12 14:37:49 -03:00
oobabooga 146a9cb393 Allow superbooga to download URLs in parallel 2023-05-12 14:19:55 -03:00
matatonic f98fd01dcd
is_chat=False for /edits (#2011) 2023-05-11 19:15:11 -03:00
oobabooga 0d36c18f5d Always return only the new tokens in generation functions 2023-05-11 17:07:20 -03:00
matatonic c4f0e6d740
is_chat changes fix for openai extension (#2008) 2023-05-11 16:32:25 -03:00
oobabooga 638c6a65a2
Refactor chat functions (#2003) 2023-05-11 15:37:04 -03:00
matatonic 309b72e549
[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes (#1935) 2023-05-11 11:06:39 -03:00
oobabooga 943b5e5f80 Minor bug fix 2023-05-10 23:54:25 -03:00
oobabooga 9695bfe117 Add an option for cleaning up html in superbooga 2023-05-10 23:51:52 -03:00
oobabooga f1d10edcb7
Update README.md 2023-05-10 12:13:14 -03:00
oobabooga c35860ff2f Add a link to silero samples 2023-05-10 01:39:35 -03:00
oobabooga 3913155c1f
Style improvements (#1957) 2023-05-09 22:49:39 -03:00
missionfloyd fe4dfc647d
SileroTTS preview (#1934) 2023-05-09 20:28:59 -03:00
oobabooga 8fa5f651d6 Style changes 2023-05-09 20:20:35 -03:00
Wojtab e9e75a9ec7
Generalize multimodality (llava/minigpt4 7b and 13b now supported) (#1741) 2023-05-09 20:18:02 -03:00
Jeffrey Lin 791a38bad1
[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client (#1876) 2023-05-08 22:31:34 -03:00
kaiokendev 0e27b660e8
Fix issue where n_results/k > index size (#1929) 2023-05-08 21:16:00 -03:00
oobabooga b5260b24f1
Add support for custom chat styles (#1917) 2023-05-08 12:35:03 -03:00
oobabooga 82eb284a3f Fix a bug in silero tts 2023-05-07 23:59:43 -03:00
oobabooga b3bbda22d1 Exception handling 2023-05-07 16:50:45 -03:00
oobabooga 8515f19078 Fix typing error 2023-05-07 16:25:39 -03:00
oobabooga 6b67cb6611 Generalize superbooga to chat mode 2023-05-07 15:05:26 -03:00
oobabooga ec1cda0e1f Rename superbig to superbooga 2023-05-07 13:29:49 -03:00
oobabooga 8216c8f732 Handle multiline inputs 2023-05-07 11:54:26 -03:00
oobabooga a35a2fab02 Reorganize superbig ui 2023-05-07 11:30:16 -03:00
oobabooga befa307c42 Add support for loading multiple URLs into superbig 2023-05-07 11:08:02 -03:00
oobabooga 04eca9b65b Make chunk length/count customizable 2023-05-07 05:02:04 -03:00
oobabooga 8c06eeaf84 Add requirement 2023-05-07 04:50:12 -03:00
oobabooga 58f9a30be1 Add support for input file/url in superbig 2023-05-07 04:49:02 -03:00
oobabooga 6afba065a1 Only update the chroma database when necessary 2023-05-07 04:03:17 -03:00
kaiokendev 5a4bd3918c
Add SuperBIG extension (alpha) (#1548)
---------

Co-authored-by: kaiokendev <>
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-05-07 03:50:12 -03:00
oobabooga 85238de421 Remove unused variable 2023-05-06 11:03:12 -03:00
oobabooga de9c4e260e
Minor fixes to elevenlabs_tts 2023-05-06 10:57:34 -03:00
Steve Randall b03a2ac512
Elevenlabs Extension Improvement and migration to official API (#1830) 2023-05-06 10:56:31 -03:00
oobabooga 8aafb1f796
Refactor text_generation.py, add support for custom generation functions (#1817) 2023-05-05 18:53:03 -03:00
oobabooga 4bf7253ec5 Fix typing bug in api 2023-05-03 19:27:20 -03:00
Thireus ☠ 4883e20fa7
Fix openai extension script.py - TypeError: '_Environ' object is not callable (#1753) 2023-05-03 09:51:49 -03:00
Wojtab 80c2f25131
LLaVA: small fixes (#1664)
* change multimodal projector to the correct one

* remove reference to custom stopping strings from readme

* fix stopping strings if tokenizer extension adds/removes tokens

* add API example

* LLaVA 7B just dropped, add to readme that there is no support for it currently
2023-05-02 23:12:22 -03:00
oobabooga c31b0f15a7 Remove some spaces 2023-05-02 23:07:07 -03:00