Commit graph

44 commits

Author SHA1 Message Date
dsenanayake b6822c725d adding a parameter check for device. 2024-05-13 12:57:36 +10:00
Michael f709ae7af9 Modified how audio.wav_to_univnet_mel is called to prevent redundant init of stft 2024-02-12 15:46:55 -05:00
manmay-nakhashi ab270c7b31 add fast api for tortoise 2023-10-18 18:52:39 +05:30
Roberts Slisans 72eccabcb7 add tokenizer 2023-08-15 11:27:43 +03:00
manmay nakhashi 847b8f6e3a
Merge pull request #550 from Jerry-Master/main
Added MPS support
2023-08-11 20:47:06 +05:30
Roberts Slisans 50cd14fd3d
strict=False for transformers 4.31.0 2023-08-11 14:58:43 +03:00
Jerry-Master 8d67995ba7 Addes MPS support 2023-08-06 19:01:10 +02:00
Jerry-Master b4988c24b3 Added MPS support for do_tts 2023-08-06 17:41:30 +02:00
manmay-nakhashi 7000b899ec bug fixes and added kv_cache to do_tts 2023-07-30 13:02:50 +05:30
manmay-nakhashi 1aabb3cec1 fixes 2023-07-26 01:35:42 +05:30
manmay-nakhashi c4b5bcf3db add speaking rategit add tortoise/api.py! 2023-07-26 01:28:55 +05:30
manmay-nakhashi aaed65869a bug fix 2023-07-16 16:00:40 +05:30
manmay-nakhashi d8f028325b fix 2023-07-16 15:52:17 +05:30
manmay-nakhashi 45462c6cf1 pass half from TexttoSpeech args 2023-07-16 14:25:42 +05:30
manmay-nakhashi be7c5056f7 remove var 2023-07-16 01:06:19 +05:30
manmay-nakhashi 19f5250454 add half because kv_cache increases memory footprint 2023-07-16 00:49:17 +05:30
manmay-nakhashi a88534adb2 added kv_cache 2023-07-15 23:00:19 +05:30
manmay-nakhashi 5a9707d93c added deepspeed inference 2023-07-09 18:40:10 +05:30
Johan Nordberg de7c5ddec3 Typofix 2022-06-11 21:19:07 +09:00
Johan Nordberg b876a6b32c Allow running on CPU 2022-06-11 20:03:14 +09:00
Johan Nordberg 9f6ae0f0b3 Add tortoise_cli.py 2022-05-28 05:25:23 +00:00
Johan Nordberg b681fa9d11 Skip CLVP if cvvp_amount is 1
Also fixes formatting bug in log message
2022-05-25 11:12:53 +00:00
Johan Nordberg a52e3026ba Revive CVVP model 2022-05-25 10:22:50 +00:00
James Betker 1a8c9f741a Merge remote-tracking branch 'origin/main'
# Conflicts:
#	tortoise/read.py
2022-05-19 10:34:54 -06:00
Johan Nordberg 20220893af Allow setting models path from environment variable 2022-05-19 21:02:09 +09:00
James Betker 8139afd0e5 Remove CVVP
After training a similar model for a different purpose, I realized that
this model is faulty: the contrastive loss it uses only pays attention
to high-frequency details which do not contribute meaningfully to
output quality. I validated this by comparing a no-CVVP output with
a baseline using tts-scores and found no differences.
2022-05-17 12:21:25 -06:00
James Betker aef86d21bf Add a way to get deterministic behavior from tortoise and add debug states for reporting 2022-05-17 12:11:18 -06:00
James Betker 50690e4465 Automatically pick batch size based on available GPU memory 2022-05-13 10:30:02 -06:00
James Betker 1a4f0fa350 update model paths (including clvp2!) 2022-05-12 20:18:11 -06:00
James Betker 7d5e7dbba8 CLVP2! 2022-05-12 13:23:03 -06:00
Mark Baushenko cbccc5e953
Optimizing graphics card memory
During inference it does not store gradients, which take up most of the video memory
2022-05-11 16:35:11 +03:00
James Betker 317d55c252 re-enable redaction 2022-05-06 09:36:42 -06:00
James Betker 8672075914 temporarily disable redaction 2022-05-06 09:06:20 -06:00
James Betker ddb19f6b0f Enable redaction by default 2022-05-03 21:21:52 -06:00
James Betker c1d004aeb0 change quality presets 2022-05-03 21:01:26 -06:00
James Betker a4cda68ddf getting ready for 2.1 release 2022-05-02 20:20:50 -06:00
James Betker f499d66493 misc fixes 2022-05-02 18:00:57 -06:00
James Betker 2888ae0337 Fix bug with k>1 2022-05-02 18:00:22 -06:00
James Betker cdf44d7506 more fixes 2022-05-02 16:44:47 -06:00
James Betker 39ec1b0db5 Support totally random voices (and make fixes to previous changes) 2022-05-02 15:40:03 -06:00
James Betker 9007955d88 Add redaction support 2022-05-02 14:57:29 -06:00
James Betker cd2d4229bf Better error messages when inputs are out of bounds. 2022-05-01 17:39:36 -06:00
James Betker 0ffc191408 Add support for extracting and feeding conditioning latents directly into the model
- Adds a new script and API endpoints for doing this
- Reworks autoregressive and diffusion models so that the conditioning is computed separately (which will actually provide a mild performance boost)
- Updates README

This is untested. Need to do the following manual tests (and someday write unit tests for this behemoth before
it becomes a problem..)
1) Does get_conditioning_latents.py work?
2) Can I feed those latents back into the model by creating a new voice?
3) Can I still mix and match voices (both with conditioning latents and normal voices) with read.py?
2022-05-01 17:25:18 -06:00
James Betker f7c8decfdb Move everything into the tortoise/ subdirectory
For eventual packaging.
2022-05-01 16:24:24 -06:00
Renamed from api.py (Browse further)