Sign inSign up

argentaios/ainode

By argentaios

•Updated 6 months ago

Local AI platform for any NVIDIA GPU. Chat, API, fine-tuning in browser. One command to install.

Image
Machine learning & AI
0

858

argentaios/ainode repository overview

AINode

⁠AINode

Turn any NVIDIA GPU into a local AI platform.
Inference + fine-tuning in your browser. One command to install.


⁠Install in 30 seconds

curl -fsSL https://ainode.dev/install | bash

That pulls this image, registers a systemd service, and opens the chat UI at http://localhost:3000.

⁠Pull directly

docker pull argentaios/ainode:latest

⁠What's inside

  • vLLM inference engine (patched NCCL for multi-GB10 clusters)
  • Ray for cross-node orchestration
  • aiohttp API server + chat UI on port 3000
  • OpenAI-compatible /v1 endpoints on port 8000
  • Auto-discovery over UDP for clustering
  • LoRA fine-tuning from the browser

⁠Distributed mode

Multi-node install bootstraps passwordless SSH and shards one model across every GPU in the cluster:

AINODE_PEERS="10.0.0.2,10.0.0.3" curl -fsSL https://ainode.dev/install | bash

Powered by argentos.ai⁠.

Tag summary

Content type

Image

Digest

sha256:1d4f04903…

Size

9.2 GB

Last updated

6 months ago

docker pull argentaios/ainode