Sign inSign up

1lcb/ollama-gateway

By 1lcb

•Updated over 1 year ago

This container serves as a minimal API Gateway + Reverse Proxy to secure access to Ollama

Image
Security
Web servers
Monitoring & observability
0

1.6K

1lcb/ollama-gateway repository overview

This container serves as a minimal and highly efficient API Gateway + Reverse Proxy to secure access to Ollama. It provides features such as IP black/white listing, API keys, rate limiting, logging, and Prometheus metrics. All configurations are managed through a config.json file.

Usage:

  1. Create a config.json file with your desired settings.
  2. Mount the config.json file to the root folder of the container when starting it. Example:
docker run -d \
  -v /path/to/config.json:/config.json \
  -p 8080:8080 \
  1lcb/ollama-gateway:<tag>

Key Features:

  • Security: Control access via IP allow/deny lists and API keys.
  • Performance: Configurable rate limiting to prevent abuse.
  • Observability: Detailed logging and metrics ready for Prometheus.
  • Lightweight and Optimized: Built in Go with no external dependencies.

For an example of the config.json file, visit the GitHub repository: https://github.com/1LCB/ollama-gateway⁠

Tag summary

Content type

Image

Digest

sha256:b3f127b77…

Size

7.4 MB

Last updated

over 1 year ago

docker pull 1lcb/ollama-gateway