A powerful endpoint for managing multiple prompt queues against multiple LLMs
860
This is a POWERFUL LLM Queue Manager with MCP tool support that will let your localLLM run all night. Fully opensource and documented at Let your LLM CODE ALL NIGHT. Run multiple LLM's concurrently with MCP Tool support!
Easily pull and run it with:
docker pull docker.io/cnmcdee/llmqueue:latest
docker run -d --name mcp-llmqueue --restart unless-stopped -p 0.0.0.0:5012:5012 cnmcdee/llmqueue:latest ```
Content type
Image
Digest
sha256:4123ae8a9…
Size
58.7 MB
Last updated
5 months ago
docker pull cnmcdee/llmqueue