oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-01-17 06:00:50 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
1693 commits 2 branches 92 tags 66 MiB
Commit graph

6 commits

Author SHA1 Message Date
oobabooga 638c6a65a2
Refactor chat functions (#2003) 2023-05-11 15:37:04 -03:00
oobabooga 3913155c1f
Style improvements (#1957) 2023-05-09 22:49:39 -03:00
oobabooga 8aafb1f796
Refactor text_generation.py, add support for custom generation functions (#1817) 2023-05-05 18:53:03 -03:00
oobabooga 88cdf6ed3d Prevent websocket from disconnecting 2023-05-02 19:03:19 -03:00
MajdajkD c86e9a3372
fix websocket batching (#1511) 2023-04-24 03:51:32 -03:00
Andy Salerno 654933c634
New universal API with streaming/blocking endpoints (#990) 
Previous title: Add api_streaming extension and update api-example-stream to use it

* Merge with latest main

* Add parameter capturing encoder_repetition_penalty

* Change some defaults, minor fixes

* Add --api, --public-api flags

* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.

* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'

* Update the API examples

* Change a comment

* Update README

* Remove the gradio API

* Remove unused import

* Minor change

* Remove unused import

---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-04-23 15:52:43 -03:00