avirtuos

A simple gateway for ollama that adds authentication and langfuse tracing.

A simple docker image for running llama.cpp distributed across multiple nodes.