dstackai/dstack repository overview

dstack is a streamlined alternative to Kubernetes, specifically designed for AI. It simplifies container orchestration for AI workloads both in the cloud and on-prem, speeding up the development, training, and deployment of AI models.

dstack supports NVIDIA GPU, AMD GPU, and Google Cloud TPU out of the box.

⁠Configure backends

To use dstack with your own cloud accounts, create the ~/.dstack/server/config.yml file and configure backends⁠.

⁠Start the server

Starting the dstack server via Docker can be done the following way:

docker run -p 3000:3000 -v $HOME/.dstack/server/:/root/.dstack/server dstackai/dstack

The dstack server is running at http://0.0.0.0:3000
The admin user token is 'bbae0f28-d3dd-4820-bf61-8f4bb40815da'

For more details on server configuration options, see the server deployment⁠ guide.

⁠Run with PostgreSQL and the SSH proxy

In production, the dstack server is usually run with PostgreSQL⁠ instead of the default SQLite, and with the SSH proxy⁠. The docker-compose.yml⁠ runs that combination locally, so you can try or test a production-like server on your own machine. A full production deployment would also configure external logs storage⁠ and file storage⁠.

docker compose -f docker/server/docker-compose.yml up

This starts PostgreSQL, the dstack server at http://localhost:3000, and the SSH proxy at localhost:30022. The admin token is printed to the logs (docker compose logs server).

To access the server from the CLI, add it as a project with dstack project add, using the admin token from the logs (see Set up the CLI⁠ below).

⁠Set up the CLI

To point the CLI to the dstack server, configure it with the server address, user token, and project name:

$ pip install dstack
$ dstack project add --name main \
    --url http://127.0.0.1:3000 \
    --token bbae0f28-d3dd-4820-bf61-8f4bb40815da
    
Configuration is updated at ~/.dstack/config.yml

⁠Create SSH fleets

If you want the dstack server to run containers on your on-prem servers, use fleets⁠.

⁠More information

For additional information and examples, see the following links:

• Docs⁠
• Examples⁠
• Changelog⁠
• Discord⁠

⁠License

Mozilla Public License 2.0⁠