Discussion:
[OMPI users] openmpi mgmt traffic
Michael Di Domenico
2017-10-11 13:34:51 UTC
Permalink
my cluster nodes are connected on 1g ethernet eth0/eth1 and via
infiniband rdma and ib0

my understanding is that openmpi will detect all these interfaces.
using eth0/eth1 for connection setup and use rdma for msg passing

what would be an appropriate to command line parameters to tell
openmpi to ipoib for connection setup and rdma for message passing?

i effectively want to ignore the 1g ethernet connections for anything
Gilles Gouaillardet
2017-10-11 14:16:36 UTC
Permalink
mpirun --mca oob_tcp_if_include ib0 --mca oob tcp ...

Note that if your cluster is large and ARP tables are not fully populated, IPoIB might not be the best idea.

Cheers,

Gilles
Post by Michael Di Domenico
my cluster nodes are connected on 1g ethernet eth0/eth1 and via
infiniband rdma and ib0
my understanding is that openmpi will detect all these interfaces.
using eth0/eth1 for connection setup and use rdma for msg passing
what would be an appropriate to command line parameters to tell
openmpi to ipoib for connection setup and rdma for message passing?
i effectively want to ignore the 1g ethernet connections for anything
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Loading...