Commit graph

5 commits

Author SHA1 Message Date
Ikko Eltociear Ashimine 03fa6922ed
Update tokenizer.py
transliterates -> transliterate
2023-06-09 03:06:51 +09:00
Johan Nordberg d8f98c07b4 Remove some assumptions about working directory
This allows cli tool to run when not standing in repository dir
2022-05-29 01:10:19 +00:00
James Betker 50690e4465 Automatically pick batch size based on available GPU memory 2022-05-13 10:30:02 -06:00
James Betker 9acce239d3 fix paths 2022-05-02 20:56:28 -06:00
James Betker f7c8decfdb Move everything into the tortoise/ subdirectory
For eventual packaging.
2022-05-01 16:24:24 -06:00
Renamed from utils/tokenizer.py (Browse further)