Susan A. Schwarz
2017-02-09 20:30:37 UTC
I am using OpenMPI 1.10.1 built with Intel compilers 16.0.3 on Centos 6.7. Our cluster has some cells where the nodes have infiniband and some cell with 10GB IP. I am hoping that I can build just one version of OpenMPI that can run on both infiniband and IP cells and not get any network-related warnings. I configured and built OpenMPI on a node with infiniband as follows:
./configure CXX=icpc CC=icc FC=ifort --prefix=/opt/openmpi/1.10.1-intel16.0 \
--enable-mpirun-prefix-by-default --with-threads --enable-mpi-thread-multiple \
--with-tm=/opt/torque/active --with-verbs=/usr --with-verbs-libdir=/usr/lib64
We are using OFED 3.2 that is part of the Centos distribution. When I run a program built with this version of OpenMPI and configured as described above on a cell with infiniband, the program runs without any warnings or errors. However, when I run on an IP-based cell, I get the following warning:
----------------------------------------------------------
A high-performance Open MPI point-to-point messaging module
was unable to find any relevant network interfaces:
Module: OpenFabrics (openib)
Host: k07
Another transport will be used instead, although this may result in
lower performance.
The program runs correctly but I am wondering if there is a way to get rid of the warning. I am aware of the MCA btl arguments that can be used with mpirun to specify ib or ip but I was hoping I didnt have to burden my users with those details. Is there a way to configure OpenMPI to run on either IB or IP without warnings.
Thank you,
Susan
Susan Schwarz
Research Software Engineer
Research Computing
Dartmouth College
Hanover, NH 03755
./configure CXX=icpc CC=icc FC=ifort --prefix=/opt/openmpi/1.10.1-intel16.0 \
--enable-mpirun-prefix-by-default --with-threads --enable-mpi-thread-multiple \
--with-tm=/opt/torque/active --with-verbs=/usr --with-verbs-libdir=/usr/lib64
We are using OFED 3.2 that is part of the Centos distribution. When I run a program built with this version of OpenMPI and configured as described above on a cell with infiniband, the program runs without any warnings or errors. However, when I run on an IP-based cell, I get the following warning:
----------------------------------------------------------
A high-performance Open MPI point-to-point messaging module
was unable to find any relevant network interfaces:
Module: OpenFabrics (openib)
Host: k07
Another transport will be used instead, although this may result in
lower performance.
The program runs correctly but I am wondering if there is a way to get rid of the warning. I am aware of the MCA btl arguments that can be used with mpirun to specify ib or ip but I was hoping I didnt have to burden my users with those details. Is there a way to configure OpenMPI to run on either IB or IP without warnings.
Thank you,
Susan
Susan Schwarz
Research Software Engineer
Research Computing
Dartmouth College
Hanover, NH 03755