oobabooga/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2026-04-20 22:13:43 +00:00
Code Issues Projects Releases Packages Wiki Activity

Docker: fix and clean up configs, update docs

Browse source
This commit is contained in:
oobabooga 2026-03-04 22:59:45 -03:00
parent 387cf9d8df
commit 5a22970ba8
12 changed files with 52 additions and 299 deletions
Download patch file Download diff file Expand all files Collapse all files

15
docker/.env.example
View file

@ -1,8 +1,8 @@
# by default the Dockerfile specifies these versions: 3.5;5.0;6.0;6.1;7.0;7.5;8.0;8.6+PTX
# however for me to work i had to specify the exact version for my card ( 2060 ) it was 7.5
# https://developer.nvidia.com/cuda-gpus you can find the version for your card here
# Or for a programatic approach run `nvidia-smi --query-gpu=name,compute_cap --format=csv`
TORCH_CUDA_ARCH_LIST=7.5
# specify which cuda arch version your card supports (NVIDIA only)
# https://developer.nvidia.com/cuda-gpus
# or run: nvidia-smi --query-gpu=name,compute_cap --format=csv
# default in docker-compose.yml covers RTX 3090 (8.6) and RTX 4090 (8.9)
TORCH_CUDA_ARCH_LIST=8.6;8.9+PTX
# the port the webui binds to on the host
HOST_PORT=7860
# the port the webui binds to inside the container
@ -13,12 +13,9 @@ HOST_API_PORT=5000
CONTAINER_API_PORT=5000
# Comma separated extensions to build
BUILD_EXTENSIONS=""
# Set APP_RUNTIME_GID to an appropriate host system group to enable access to mounted volumes
# Set APP_RUNTIME_GID to an appropriate host system group to enable access to mounted volumes
# You can find your current host user group id with the command `id -g`
APP_RUNTIME_GID=6972
# override default app build permissions (handy for deploying to cloud)
#APP_GID=6972
#APP_UID=6972
# Set cache env
TRANSFORMERS_CACHE=/home/app/text-generation-webui/cache/
HF_HOME=/home/app/text-generation-webui/cache/