ls250824/run-text-generation-webui

•Updated 4 months ago

LLM inference with oobabooga text-generation-webui on runpod.io

Image

Machine learning & AI

532

ls250824/run-text-generation-webui repository overview

Models are automatically downloaded based on the specified paths in the environment configuration.
Authentication credentials can be set via secrets for:
- Code server authentication (not possible to switch off).
- Hugging Face tokens for model access.
- text-generation-webui gradio authentication.

Token	Environment Variable	Example	Required
Hugging face	`HF_TOKEN`	token	Optional
Code Server	`PASSWORD`	password	✅ Yes
text-generation-webui	`GRADIO_AUTH`	user:password	Optional

Model Type	Hugging Face URL Variable	GGUF File Variable
GGUF Model	`HF_MODEL_GGUF[1-6]`	`HF_MODEL_GGUF_FILE[1-6]`

Model Type	Hugging Face URL Variable	GGUF File Variable
GGUF MMPROJ	`HF_MMPROJ_GGUF[1-6]`	`HF_MMPROJ_GGUF_FILE[1-6]`

Model Type	Hugging Face URL Variable	Destination Subfolder Variable
Transformers	`HF_MODEL[1-6]`	`HF_MODEL_DIR[1-6]`

Model Type	Hugging Face URL Variable	Revision	Destination Subfolder Variable
EXL	`HF_EXL1`	`HF_EXL_REVISION[1-6]`	`HF_EXL_DIR[1-6]`

Recent tags

Content type

Image

Digest

sha256:4690a8472…

Size

6 GB

Last updated

11 months ago

docker pull ls250824/run-text-generation-webui:18102025