dmiyamoto/ompi repository overview

⁠docker-openmpi

base package for docker cluster with openmpi

⁠with docker compose

1. set up docker-compose
2. generate ssh public key pair

   $ ./keygen.sh
   

   Copy
3. build and deploy MPI cluster

   $ docker-compose build
   $ docker-compose up -d scale node=4
   

   Copy
4. login to master node

   $ ./connect-master.sh
   

   Copy
5. run mpi program from master node

   $ ./make-hostfile.sh
   $ mpirun -np 16 hostname
   252f9f5abc18
   252f9f5abc18
   252f9f5abc18
   252f9f5abc18
   fa00f144c7be
   0ebd38ff982e
   fa00f144c7be
   0ebd38ff982e
   fa00f144c7be
   0ebd38ff982e
   fa00f144c7be
   0ebd38ff982e
   4c1364ddf9d9
   4c1364ddf9d9
   4c1364ddf9d9
   4c1364ddf9d9
   

   Copy
6. shutdown cluster

   $ docker-compose down -v
   

   Copy

⁠with swarm

⁠with kubernetes

1. set up kubernetes

2. start cluster

   $ kubectl create -f mpi-deployment.yml
   

   Copy

3. login to master node

   $ kubectl exec -it mpi-master /bin/bash
   

   Copy

4. set up hostfile.txt

5. run mpi program

   $ mpiexec -np 4 --hostfile hostfile.txt ./mpi_examples/bmt_L_2x2x1.out
   

   Copy

6. shutdown cluster