Sign inSign up

cnmcdee/llmqueue

By cnmcdee

•Updated 5 months ago

A powerful endpoint for managing multiple prompt queues against multiple LLMs

Image
Machine learning & AI
Developer tools
0

860

cnmcdee/llmqueue repository overview

This is a POWERFUL LLM Queue Manager with MCP tool support that will let your localLLM run all night. Fully opensource and documented at Let your LLM CODE ALL NIGHT.⁠ Run multiple LLM's concurrently with MCP Tool support!

Easily pull and run it with:

docker pull docker.io/cnmcdee/llmqueue:latest
docker run -d --name mcp-llmqueue --restart unless-stopped -p 0.0.0.0:5012:5012 cnmcdee/llmqueue:latest ```

Tag summary

Content type

Image

Digest

sha256:4123ae8a9…

Size

58.7 MB

Last updated

5 months ago

docker pull cnmcdee/llmqueue