Commit graph

1109 commits

Author SHA1 Message Date
Nikita Skakun ff515ec2fe Improve progress bar visual style
This commit reverts the performance improvements of the previous commit for for improved visual style of multithreaded progress bars. The style of the progress bar has been modified to take up the same amount of size to align them.
2023-03-28 18:29:20 -07:00
Nikita Skakun 4d8e101006 Refactor download process to use multiprocessing
The previous implementation used threads to download files in parallel, which could lead to performance issues due to the Global Interpreter Lock (GIL).
This commit refactors the download process to use multiprocessing instead,
which allows for true parallelism across multiple CPUs.
This results in significantly faster downloads, particularly for large models.
2023-03-28 14:24:23 -07:00
oobabooga aebd3cf110
Merge pull request #616 from mayaeary/fix/api-convert-params
Fixes for api server - chat mode and integer temperature
2023-03-28 15:21:58 -03:00
Maya Eary d1377c37af Fixes for api server - chat mode and integer temperature 2023-03-28 20:57:16 +03:00
oobabooga cac577d99f Fix interface reloading 2023-03-28 13:25:58 -03:00
oobabooga 88ad86249d Remove unnecessary file 2023-03-28 13:19:52 -03:00
oobabooga 91aa5b460e If both .pt and .safetensors are present, download only safetensors 2023-03-28 13:08:38 -03:00
oobabooga 8579fe51dd Fix new lines in the HTML tab 2023-03-28 12:59:34 -03:00
oobabooga 46f6536fae
Merge pull request #570 from mcmonkey4eva/add-train-lora-tab
LoRA Training Tab
2023-03-28 02:53:51 -03:00
Alex "mcmonkey" Goodwin b0f05046b3 remove duplicate import 2023-03-27 22:50:37 -07:00
Alex "mcmonkey" Goodwin e817fac542 better defaults 2023-03-27 22:29:23 -07:00
Alex "mcmonkey" Goodwin 9cc811a0e6 fix LoRA path typo in #549 2023-03-27 22:16:40 -07:00
Alex "mcmonkey" Goodwin 2e08af4edf implement initial Raw Text File Input
also bump default Rank & Alpha for values that will make sense in testing if you don't know what you're doing and leave the defaults.
2023-03-27 22:15:32 -07:00
Alex "mcmonkey" Goodwin b749952fe3 change number minimums to 0
gradio calculates 'step' relative to the minimum, so at '1' the step values were all offset awkwardly. 0 isn't valid, but, uh, just don't slam the slider to the left.
2023-03-27 21:22:43 -07:00
Alex "mcmonkey" Goodwin ec6224f556 use new shared.args.lora_dir 2023-03-27 20:04:16 -07:00
Alex "mcmonkey" Goodwin 31f04dc615 Merge branch 'main' into add-train-lora-tab 2023-03-27 20:03:30 -07:00
oobabooga 966168bd2a
Merge pull request #602 from oobabooga/dependabot/pip/accelerate-0.18.0
Bump accelerate from 0.17.1 to 0.18.0
2023-03-27 23:53:26 -03:00
oobabooga c188975a01
Merge pull request #549 from catalpaaa/lora-and-model-dir
lora-dir, model-dir and login auth
2023-03-27 23:46:47 -03:00
oobabooga 53da672315 Fix FlexGen 2023-03-27 23:44:21 -03:00
oobabooga ee95e55df6 Fix RWKV tokenizer 2023-03-27 23:42:29 -03:00
oobabooga 036163a751 Change description 2023-03-27 23:39:26 -03:00
oobabooga 30585b3e71 Update README 2023-03-27 23:35:01 -03:00
oobabooga 005f552ea3 Some simplifications 2023-03-27 23:29:52 -03:00
oobabooga fde92048af Merge branch 'main' into catalpaaa-lora-and-model-dir 2023-03-27 23:16:44 -03:00
Alex "mcmonkey" Goodwin 8a97f6ba29 corrections per the PR comments 2023-03-27 18:39:06 -07:00
dependabot[bot] 1e02f75f2b
Bump accelerate from 0.17.1 to 0.18.0
Bumps [accelerate](https://github.com/huggingface/accelerate) from 0.17.1 to 0.18.0.
- [Release notes](https://github.com/huggingface/accelerate/releases)
- [Commits](https://github.com/huggingface/accelerate/compare/v0.17.1...v0.18.0)

---
updated-dependencies:
- dependency-name: accelerate
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-28 01:19:34 +00:00
oobabooga 37f11803e3
Merge pull request #603 from oobabooga/dependabot/pip/rwkv-0.7.1
Bump rwkv from 0.7.0 to 0.7.1
2023-03-27 22:19:08 -03:00
Alex "mcmonkey" Goodwin 7fab7ea1b6 couple missed camelCases 2023-03-27 18:19:06 -07:00
oobabooga 1fc7ff065d
Bump bitsandbytes from 0.37.1 to 0.37.2 2023-03-27 22:18:52 -03:00
Alex "mcmonkey" Goodwin 6368dad7db Fix camelCase to snake_case to match repo format standard 2023-03-27 18:17:42 -07:00
oobabooga 2f0571bfa4 Small style changes 2023-03-27 21:24:39 -03:00
oobabooga c2cad30772 Merge branch 'main' into mcmonkey4eva-add-train-lora-tab 2023-03-27 21:05:44 -03:00
dependabot[bot] e9c0226b09
Bump rwkv from 0.7.0 to 0.7.1
Bumps [rwkv](https://github.com/BlinkDL/ChatRWKV) from 0.7.0 to 0.7.1.
- [Release notes](https://github.com/BlinkDL/ChatRWKV/releases)
- [Commits](https://github.com/BlinkDL/ChatRWKV/commits)

---
updated-dependencies:
- dependency-name: rwkv
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-27 21:05:35 +00:00
dependabot[bot] 9c96919121
Bump bitsandbytes from 0.37.1 to 0.37.2
Bumps [bitsandbytes](https://github.com/TimDettmers/bitsandbytes) from 0.37.1 to 0.37.2.
- [Release notes](https://github.com/TimDettmers/bitsandbytes/releases)
- [Changelog](https://github.com/TimDettmers/bitsandbytes/blob/main/CHANGELOG.md)
- [Commits](https://github.com/TimDettmers/bitsandbytes/commits)

---
updated-dependencies:
- dependency-name: bitsandbytes
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-27 21:05:19 +00:00
oobabooga 9ec6c56680
Update stale.yml 2023-03-27 15:12:43 -03:00
Alex "mcmonkey" Goodwin 9ced75746d add total time estimate 2023-03-27 10:57:27 -07:00
oobabooga 641e1a09a7 Don't flash when selecting a new prompt 2023-03-27 14:48:43 -03:00
Alex "mcmonkey" Goodwin 16ea4fc36d interrupt button 2023-03-27 10:43:01 -07:00
Alex "mcmonkey" Goodwin 8fc723fc95 initial progress tracker in UI 2023-03-27 10:25:08 -07:00
oobabooga 48a6c9513e
Merge pull request #572 from clusterfudge/issues/571
Potential fix for issues/571
2023-03-27 14:06:38 -03:00
oobabooga 268abd1cba Add some space in notebook mode 2023-03-27 13:52:12 -03:00
Alex "mcmonkey" Goodwin c07bcd0850 add some outputs to indicate progress updates (sorta)
Actual progressbar still needed. Also minor formatting fixes.
2023-03-27 09:41:06 -07:00
oobabooga af65c12900 Change Stop button behavior 2023-03-27 13:23:59 -03:00
oobabooga addb9777f9 Increase size of GALACTICA equations 2023-03-27 12:59:07 -03:00
oobabooga 572bafcd24 Less verbose message 2023-03-27 12:43:37 -03:00
Alex "mcmonkey" Goodwin 2afe1c13c1 move Training to before Interface mode
as Interface Mode seems to be a core 'settings' page that naturally belongs at the very end
2023-03-27 08:32:32 -07:00
Alex "mcmonkey" Goodwin d911c22af9 use shared rows to make the LoRA Trainer interface a bit more compact / clean 2023-03-27 08:31:49 -07:00
oobabooga 202e981d00 Make Generate/Stop buttons smaller in notebook mode 2023-03-27 12:30:57 -03:00
Alex "mcmonkey" Goodwin e439228ed8 Merge branch 'main' into add-train-lora-tab 2023-03-27 08:21:19 -07:00
oobabooga 8e2d94a5a1 Add saved promtps to gitignore 2023-03-27 12:21:19 -03:00