Sign inSign up

ruecat/ollama-telegram

By ruecat

•Updated about 1 year ago

🦙 Use your local LLM in telegram bot!

Image
Machine learning & AI
4

10K+

ruecat/ollama-telegram repository overview

  • Download .env.example⁠ file, rename it to .env and populate the variables.
  • Create docker-compose.yml (optionally: uncomment GPU part of the file to enable Nvidia GPU)
version: '3.8'
services:
  ollama-telegram:
    image: ruecat/ollama-telegram
    container_name: ollama-telegram
    restart: on-failure
    env_file:
      - ./.env
  
  ollama-server:
    image: ollama/ollama:latest
    container_name: ollama-server
    volumes:
      - ./ollama:/root/.ollama
    
    # Uncomment to enable NVIDIA GPU
    # Otherwise runs on CPU only:

    # deploy:
    #   resources:
    #     reservations:
    #       devices:
    #         - driver: nvidia
    #           count: all
    #           capabilities: [gpu]

    restart: always
    ports:
      - '11434:11434'
  • Start the containers
docker compose up -d

Tag summary

Content type

Image

Digest

sha256:b0bfe3f69…

Size

32.1 MB

Last updated

about 1 year ago

docker pull ruecat/ollama-telegram