Sign inSign up

gegentic/gateway

By gegentic

•Updated 6 days ago

Gegentic AI Gateway — proxy LLM requests to 40+ providers

Image
Machine learning & AI
0

3.9K

gegentic/gateway repository overview

⁠Gegentic Gateway

Gegentic is an AI governance platform for organisations that want to enforce policy guardrails, compliance checks, and audit trails over their AI usage. This image (gegentic/gateway) is the LLM gateway component of a self-hosted Gegentic deployment — a stripped-down, license-gated build aimed at universities and training programs that want to teach AI governance concepts hands-on, without needing the full commercial platform.

This image is one piece of a multi-container stack. It will not run standalone — use the provided docker-compose.yml to bring up the full system.

⁠What this image is

gegentic/gateway is a forward-deployed LLM proxy (port 8787) that sits between client applications and upstream AI providers (OpenAI, Anthropic, Bedrock, Google, etc.). It validates API keys against gegentic/api, evaluates input/output guardrails via gegentic/guardian, forwards requests to the selected provider, and writes trace spans to gegentic/tracing.

⁠Full stack

The gateway does not run in isolation. A complete Gegentic deployment is a multi-container stack:

ServiceImageRole
dbpostgres:16-alpinePrimary relational store
supertokenssupertokens/supertokens-postgresqlSession/auth provider
migrategegentic/api-migrationRuns Prisma migrations + org seed, then exits
apigegentic/apiCore backend API
portalgegentic/portalFrontend governance UI
gatewaygegentic/gatewayThis image — LLM proxy with auth, guardrails, tracing
guardiangegentic/guardianGuardrail evaluation engine
clickhouseclickhouse/clickhouse-serverTrace storage
tracinggegentic/tracingLLM observability UI

Get the full docker-compose.yml and .env.example from the Gegentic repository⁠ or registration package.

⁠Quick start

# 1. Register to get a license key
#    https://gegentic.com/gegentic/edu/register

# 2. Copy and fill in the environment file
cp .env.example .env
# edit .env: LICENSE_KEY, ORG_NAME, DB credentials, encryption keys, etc.

# 3. Bring up the stack
docker compose up -d

# Portal:  http://localhost:3000
# API:     http://localhost:4001
# Gateway: http://localhost:8787
# Tracing: http://localhost:5001

⁠License

A LICENSE_KEY (JWT, issued after registering at gegentic.com/gegentic/edu/register⁠) is required at startup — the container will not boot without one. The corresponding public key used to verify the license is baked into the image at build time and cannot be overridden via environment variables or docker-compose.yml.

⁠Configuration

All runtime configuration is via environment variables — see .env.example for the full list, including:

  • LICENSE_KEY — required, ties the deployment to your registered instance
  • API_SERVICE_HOST — base URL of gegentic/api, used for API key validation
  • GUARDIAN_SERVICE_HOST — base URL of gegentic/guardian, used for guardrail evaluation
  • TRACING_SERVICE_HOST — base URL of gegentic/tracing, used for trace export
  • INTERNAL_SERVICE_SHARED_SECRET — optional; sent to gegentic/tracing so it can restrict trace uploads to your own services (see that image's TRACING_AUTH_MODE)
  • Upstream provider credentials, supplied per-request via x-gegentic-* headers or virtual keys configured in the portal

A handful of build-time-only settings (the license public key, the analytics key) are intentionally baked into the image and are not configurable at runtime — this keeps them from being tampered with or disabled by editing docker-compose.yml.

⁠Tags

  • latest — most recent stable release
  • <version> — matches the repo's semver release

⁠Documentation

For full documentation on configuring and using this image, refer to docs.gegentic.com⁠.

⁠Support

This image is intended for educational/training use. For issues with the Gegentic edition, see the documentation at gegentic.com⁠.

Tag summary

Content type

Image

Digest

sha256:ee7c86b0f…

Size

84.5 MB

Last updated

6 days ago

docker pull gegentic/gateway