Telegram Bot interface for using llama.cpp
268
This project aims to liberate using of LLM providing the most simple way for use and deploy your own instance of AI chatbot.
llama-telegram-bot is written in Go and built on top of go-llama.cpp which is binding to llama.cpp
docker run \
--name llama-telegram-bot \
-v /path/to/models:/models
-e MODEL_PATH=/models/model_name
-e TG_TOKEN=your_telegram_api_token \
-e Q_SIZE=1000 \ # task queue size (default: 1000)
-e N_TOKENS=1024 \ # tokens to predict (default: 1024)
-d \
thedmdim/llama-telegram-bot
Content type
Image
Digest
sha256:49c6d9212…
Size
71.3 MB
Last updated
almost 3 years ago
docker pull thedmdim/llama-telegram-bot