mmoskal

HTTP server with constrained output and OpenAI-compatible REST APIs using TensorRT-LLM