Sign inSign up

tyang816/slurm

By tyang816

•Updated over 2 years ago

aiweb server

Image
0

932

tyang816/slurm repository overview

⁠On the top

install nvidia-docker first (see https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html⁠)

curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | \
  sudo apt-key add -
distribution=$(. /etc/os-release;echo $ID$VERSION_ID)
curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | \
  sudo tee /etc/apt/sources.list.d/nvidia-docker.list
sudo apt-get update
# Install nvidia-docker2 and reload the Docker daemon configuration
sudo apt-get install -y nvidia-docker2
sudo systemctl restart docker

pull and run

docker pull tyang:slurm:tagname
docker run --gpus all -it tyang:slurm:tagname

⁠v1.3

⁠add ssh

  • config: /etc/ssh/sshd_config
apt install openssh-server
service ssh restart

⁠v1.2

⁠add slurmdbd

apt-get install mariadb-server
apt-get install slurmdbd

# login and create database
sudo mysql -u root -p
CREATE DATABASE slurm_acct_db;
# note that the slurm_user and password should be modified to your settings
GRANT ALL ON slurm_acct_db.* TO '<slurm_user>'@'localhost' IDENTIFIED BY '<password>';
EXIT;

# test
# service mysql restart
service mariadb restart
service slurmdbd restart
sacct

⁠v1.1

⁠add zsh

  • theme: tyang (path: /root/..oh-my-zsh/themes/tyang.zsh-theme)
  • plugins: git, zsh-autosuggestions, zsh-syntax-highlighting

⁠add slurm

  • slurm config: /etc/slurm/slurm.conf
  • gres config: /etc/slurm/gres.conf
# start commend
sudo apt-get install munge
sudo apt-get install slurm-wlm

service munge restart
service slurmd restart
service slurmctld restart
  • modify NodeHostName and ControlMachine in slurm.conf to your docker machine name, e.g. 2e22c19e2950
  • test commend:
    • srun --gres=gpu:1 printenv

⁠add miniconda3

  • path: /root/miniconda3

⁠v1:

  • build raw enviroment

Tag summary

Content type

Image

Digest

sha256:bb964c978…

Size

214 MB

Last updated

almost 3 years ago

docker pull tyang816/slurm