Jeffrey A Cummings
2018-10-09 22:01:19 UTC
What are the allowable values for the âmca btl parameter on the mpirun command line?
â Jeff
Jeffrey A. Cummings
Engineering Specialist
Mission Analysis and Operations Department
Systems Analysis and Simulation Subdivision
Systems Engineering Division
Engineering and Technology Group
The Aerospace Corporation
571-304-7548
***@aero.org
From: users [mailto:users-***@lists.open-mpi.org] On Behalf Of Andy Riebs
Sent: Tuesday, October 09, 2018 2:34 PM
To: ***@lists.open-mpi.org
Subject: Re: [OMPI users] no openmpi over IB on new CentOS 7 system
Noam,
Start with the FAQ, etc., under "Getting Help/Support" in the left-column menu at https://www.open-mpi.org/
Andy
________________________________
From: Noam Bernstein <***@nrl.navy.mil><mailto:***@nrl.navy.mil>
Sent: Tuesday, October 09, 2018 2:26PM
To: Open Mpi Users <***@lists.open-mpi.org><mailto:***@lists.open-mpi.org>
Cc:
Subject: [OMPI users] no openmpi over IB on new CentOS 7 system
Hi - Iâm trying to get OpenMPI working on a newly configured CentOS 7 system, and Iâm not even sure what information would be useful to provide. Iâm using the CentOS built in libibverbs and/or libfabric, and I configure openmpi with just
âwith-verbs âwith-ofi âprefix=$DEST
also tried âwithout-ofi, no change. Basically, I can run with ââmca btl self,vaderâ, but if I try ââmca btl,openibâ I get an error from each process:
[compute-0-0][[24658,1],5][connect/btl_openib_connect_udcm.c:1245:udcm_rc_qp_to_rtr] error modifing QP to RTR errno says Invalid argument
If I donât specify the btl it appears to try to set up openib with the same errors, then crashes on some free() related segfault, presumably when it tries to actually use vader.
The machine seems to be able to see its IB interface, as reported by things like ibstatus or ibv_devinfo. Iâm not sure what else to look for. I also confirmed that âulimit -lâ reports unlimited.
Does anyone have any suggestions as to how to diagnose this issue?
thanks,
Noam
_______________________________________________
users mailing list
***@lists.open-mpi.org<mailto:***@lists.open-mpi.org>
https://lists.open-mpi.org/mailman/listinfo/users
â Jeff
Jeffrey A. Cummings
Engineering Specialist
Mission Analysis and Operations Department
Systems Analysis and Simulation Subdivision
Systems Engineering Division
Engineering and Technology Group
The Aerospace Corporation
571-304-7548
***@aero.org
From: users [mailto:users-***@lists.open-mpi.org] On Behalf Of Andy Riebs
Sent: Tuesday, October 09, 2018 2:34 PM
To: ***@lists.open-mpi.org
Subject: Re: [OMPI users] no openmpi over IB on new CentOS 7 system
Noam,
Start with the FAQ, etc., under "Getting Help/Support" in the left-column menu at https://www.open-mpi.org/
Andy
________________________________
From: Noam Bernstein <***@nrl.navy.mil><mailto:***@nrl.navy.mil>
Sent: Tuesday, October 09, 2018 2:26PM
To: Open Mpi Users <***@lists.open-mpi.org><mailto:***@lists.open-mpi.org>
Cc:
Subject: [OMPI users] no openmpi over IB on new CentOS 7 system
Hi - Iâm trying to get OpenMPI working on a newly configured CentOS 7 system, and Iâm not even sure what information would be useful to provide. Iâm using the CentOS built in libibverbs and/or libfabric, and I configure openmpi with just
âwith-verbs âwith-ofi âprefix=$DEST
also tried âwithout-ofi, no change. Basically, I can run with ââmca btl self,vaderâ, but if I try ââmca btl,openibâ I get an error from each process:
[compute-0-0][[24658,1],5][connect/btl_openib_connect_udcm.c:1245:udcm_rc_qp_to_rtr] error modifing QP to RTR errno says Invalid argument
If I donât specify the btl it appears to try to set up openib with the same errors, then crashes on some free() related segfault, presumably when it tries to actually use vader.
The machine seems to be able to see its IB interface, as reported by things like ibstatus or ibv_devinfo. Iâm not sure what else to look for. I also confirmed that âulimit -lâ reports unlimited.
Does anyone have any suggestions as to how to diagnose this issue?
thanks,
Noam
_______________________________________________
users mailing list
***@lists.open-mpi.org<mailto:***@lists.open-mpi.org>
https://lists.open-mpi.org/mailman/listinfo/users