MPI support

Important

We recommend the use of Intel Distribution for Python, part of Intel oneAPI installation, whenever possible. It comes with its own Conda tools.

Mpi4py

Intel Distribution for Python installs (by default) the module mpi4py, linked against the Intel oneAPI MPI library. To import the mpi4py module load the environment module intel.universe:

module load intel.universe

and then run the Python code that imports mpi4py.

Note

The mpi4py module included in Intel Distribution for Python employs Intel oneAPI MPI library. That means UCX is your middleware in the MPI over IB communication.

Therefore, (at least) the following two declarations should be added to your Slurm batch script:

export FI_PROVIDER=verbs
export UCX_NET_DEVICES=mlx5_0:1

You may need to decide which of the environment variables specific to Intel oneAPI MPI to employ. Refer to Intel MPI Library Developer Guide for Linux OS for details.

Getting help

See Getting help