fossengineer/oobabooga_vicuna_7b repository overview

A docker container that bundles together oobabooga gradio web UI⁠ with Vicuna 7B⁠ .

#conda init bash #conda activate textgen #pip install bitsandbytes #python ./text-generation-webui/server.py --listen

#cd text-generation-webui #python ./server.py --listen

version: '3.9'

services:
  my_python_dev_container:
    image: fossengineer/oobabooga_vicuna_7b
    ports:
      - "7860:7860"
    working_dir: /app
    command: tail -f /dev/null #keep it running

Access it at: localhost:7860