[OMPI users] Issue With Setting Btl Parameters

[Sam Powell-Gill]

Hi All,

I am having some issues with setting the btl parameter. I have both openmpi
2.1.1 and 1.6.5 installed on the system. The 2.1.1 version was installed by
Rocks. I am using SGE to schedule jobs.

I have been setting the btl parameter in the execution command which is
working fine. But I would like to make the setting default. I tried to do
this by editing the openmpi-mca-params.conf file to include:
btl = openib,self,sm

I did this for the config file of both openmpi versions.

I found that this did not set the parameter when I run an mpi job. In order
to try and diagnose the issue, I wanted to check if the configuration file
was working correctly. I found that the environment variable OMPI_MCA_mca_
param_files contained nothing. I also found that running the command:

ompi_info --param mca mca_param_files

returns nothing. To me this implies that openmpi isn't looking for the
configuration file.

I have also tried setting the environment variable manually with a script
in profile.d, but it seems that the change is being overwritten later in
the login process. Im guessing openmpi sets environment variables to
default at some point as it sets up?

I am fairly new to this so if anyone has any suggestions of things I can do
to further diagnose then that would be great.

Thanks,
Sam