nbclosu/mvapich repository overview

⁠Introduction

The MVAPICH software, based on the MPI standard, delivers the best performance, scalability, and fault tolerance for high-end computing systems and servers using cutting-edge networking technologies. The MVAPICH software can optimize and accelerate your HPC, BigData, and Deep Learning applications with efficient communications.

This docker repository provides a containerized version of the latest MVAPICH software. Users can easily use this MVAPICH container to build, test, and benchmark their own MPI application and system.

⁠Usage

In this scenario, you can benchmark your environment with the MVAPICH container and OMB (OSU Micro-Benchmark) with the following instructions.

⁠Setting hostfile

Hostfile is for specifying the list of nodes/containers where the job is running. In the case of a single-node intra-container test, your hostname is the <container-id> and your hostfile has only one line of <\container-id>.

docker pull nbclosu/mvapich:4.1
docker run -it --privileged nbclosu/mvapich:4.1 /bin/bash
echo $HOSTNAME > /hostfile

⁠Run OMB

Now you can run OMB with specific benchmarks (osu_latency, osu_bw, osu_bibw …). You can also change the number of processors (-np) for benchmarks.
This command shows how you can run a single-container test.

docker exec <container-id> /mvapich-4.1-install/bin/mpirun -np 2 -hostfile /hostfile /mvapich-4.1-install/libexec/osu-micro-benchmarks/mpi/pt2pt/osu_latency

⁠Singularity (Apptainer) Support

Many HPC systems only support singularity for containerized applications. You can convert this MVAPICH docker container to SIF(Singularity Image File) with the following commands. In this case, your hostfile always contains the hostnames of your nodes, not <container-id>.

docker save nbclosu/mvapich:4.1 -o mvapich-4.1.tar
apptainer build mvapich-4.1.sif docker-archive://mvapich-4.1.tar

The following command shows how can you run MVAPICH singularity container on a multi-node environment. You need pre-installed MVAPICH in your environment, and use mpirun to run OMB in your container.

mpirun -np 2 -hostfile /hostfile apptainer exec mvapich-4.1.sif /mvapich-4.1-install/libexec/osu-micro-benchmarks/mpi/pt2pt/osu_latency

⁠Suggested Reading

For more information on MVAPICH and OMB documentation, visit the MVAPICH project page: https://mvapich.cse.ohio-state.edu⁠

⁠Licensing

By pulling and using the container, you accept the terms and conditions of this MVAPICH License