Discussion:
[OMPI users] OpenMPI installation issue or mpi4py compatibility problem
Tim Jim
2017-05-18 05:44:11 UTC
Permalink
Hello,

I have been having some issues with trying to get OpenMPI working with
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.

Following some troubleshooting in the following link:
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-mpi4py-with-openmpi-gives-error
-the mpi4py folks have suggested it an issue that might be better answered
here.

In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to the
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually added
the following to my .bashrc:
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH

I later became aware that Ubuntu may handle the LD_LIBRARY_PATH differently
and instead added a new file containing the library
path /opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf, in the style of everything else in
that directory.

I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo file
(as instructed in the link) to check the installation but I had permission
issues, since it was installed win opt. However, when I attempted to run
the previous with sudo, or sudo -E, in both cases, mpicc could not be
found. (Perhaps this is a separate issue with my sudo env)

To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the above
command, I receive the following error:

mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20)
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference to
`***@OPENCL_1.0'
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference to
`***@OPENCL_1.0'
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference to
`***@OPENCL_1.0'
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference to
`***@OPENCL_1.0'
collect2: error: ld returned 1 exit status

I am unsure if I have an installation or permission issues, and I'd be
grateful if anyone can shed some light based on the trials I've done so
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs of
this, so I may have missed something obvious. Please let me know if any
other info is required.

Many thanks and kind regards,
Tim
--
*Timothy Jim**PhD Researcher in Aerospace*

Creative Flow Research Division,
Institute of Fluid Science, Tohoku University

www.linkedin.com/in/timjim/
Reuti
2017-05-21 21:54:41 UTC
Permalink
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working with mpi4py. I've tried to break down my troubleshooting into a few chunks below, and I believe that there are a few, distinct issues that need solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-mpi4py-with-openmpi-gives-error
-the mpi4py folks have suggested it an issue that might be better answered here.
First approach would be to get Open MPI working, without CUDA and Python being involved.
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI itself. It might be a necessity for mpi4py though.

One pitfall might be that "lib" is sometimes being created as "lib64" by `libtool`. I forgot the details when this is happening, but it depends on the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH differently
I don't think that Ubuntu will do anything different than any other Linux.

Did you compile Open MPI on your own, or did you install any repository?

Are the CUDA application written by yourself or any freely available applications?

- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path /opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-0.conf, in the style of everything else in that directory.
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo file (as instructed in the link) to check the installation but I had permission issues, since it was installed win opt. However, when I attempted to run the previous with sudo, or sudo -E, in both cases, mpicc could not be found. (Perhaps this is a separate issue with my sudo env)
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no version information available (required by /opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20)
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd be grateful if anyone can shed some light based on the trials I've done so far. (I should add I also have a CUDA installation, which I'd like to leverage too, if possible). I'm still fairly new to the ins and outs of this, so I may have missed something obvious. Please let me know if any other info is required.
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
Tim Jim
2017-05-22 05:22:50 UTC
Permalink
Hello,

Thanks for your message. I'm trying to get this to work on a single
machine. How might you suggest getting OpenMPIworking without python and
CUDA? I don't recall setting anything for either, as the only command I had
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0" - did it possibly
pick up the paths by accident?

Regarding the lib directory, I checked that the path physically exists.
Regarding the final part of the email, is it a problem that 'undefined
reference' is appearing?

Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working with
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might be better
answered here.
First approach would be to get Open MPI working, without CUDA and Python being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to the
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually added
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being created as "lib64" by
`libtool`. I forgot the details when this is happening, but it depends on
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently
I don't think that Ubuntu will do anything different than any other Linux.
Did you compile Open MPI on your own, or did you install any repository?
Are the CUDA application written by yourself or any freely available applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-0.conf,
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo
file (as instructed in the link) to check the installation but I had
permission issues, since it was installed win opt. However, when I
attempted to run the previous with sudo, or sudo -E, in both cases, mpicc
could not be found. (Perhaps this is a separate issue with my sudo env)
Post by Tim Jim
To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the above
Post by Tim Jim
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by /opt/openmpi/openmpi-2.1.0/
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd be
grateful if anyone can shed some light based on the trials I've done so
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs of
this, so I may have missed something obvious. Please let me know if any
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*

Creative Flow Research Division,
Institute of Fluid Science, Tohoku University

www.linkedin.com/in/timjim/
Reuti
2017-05-22 10:39:42 UTC
Permalink
Hi,
Post by Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on a single
machine.
Ok.
Post by Tim Jim
How might you suggest getting OpenMPIworking without python and
CUDA?
It looks like it's detected automatically. It should be possible to disable it with the command line option:

$ ./configure --without-cuda …

At the end of the configure step out should liste some lines like:

Miscellaneous
-----------------------
CUDA support: no

The mpi4py seems unrelated to the compilation of Open MPI itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only command I had
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0" - did it possibly
pick up the paths by accident?
Regarding the lib directory, I checked that the path physically exists.
Regarding the final part of the email, is it a problem that 'undefined
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.

-- Reuti
Post by Tim Jim
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working with
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might be better
answered here.
First approach would be to get Open MPI working, without CUDA and Python being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to the
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually added
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being created as "lib64" by
`libtool`. I forgot the details when this is happening, but it depends on
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently
I don't think that Ubuntu will do anything different than any other Linux.
Did you compile Open MPI on your own, or did you install any repository?
Are the CUDA application written by yourself or any freely available applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-0.conf,
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo
file (as instructed in the link) to check the installation but I had
permission issues, since it was installed win opt. However, when I
attempted to run the previous with sudo, or sudo -E, in both cases, mpicc
could not be found. (Perhaps this is a separate issue with my sudo env)
Post by Tim Jim
To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the above
Post by Tim Jim
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by /opt/openmpi/openmpi-2.1.0/
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd be
grateful if anyone can shed some light based on the trials I've done so
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs of
this, so I may have missed something obvious. Please let me know if any
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
Tim Jim
2017-05-23 03:03:48 UTC
Permalink
Dear Reuti,

Thanks for the reply. What options do I have to test whether it has
successfully built?

Thanks and kind regards.
Tim
Post by Reuti
Hi,
Post by Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on a single
machine.
Ok.
Post by Tim Jim
How might you suggest getting OpenMPIworking without python and
CUDA?
It looks like it's detected automatically. It should be possible to
$ ./configure --without-cuda 

Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of Open MPI itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only command I had
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0" - did it
possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path physically exists.
Regarding the final part of the email, is it a problem that 'undefined
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.
-- Reuti
Post by Tim Jim
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working with
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might be better
answered here.
First approach would be to get Open MPI working, without CUDA and Python
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to the
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually added
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being created as "lib64" by
`libtool`. I forgot the details when this is happening, but it depends
on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently
I don't think that Ubuntu will do anything different than any other
Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you install any repository?
Are the CUDA application written by yourself or any freely available applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-0.conf,
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo
file (as instructed in the link) to check the installation but I had
permission issues, since it was installed win opt. However, when I
attempted to run the previous with sudo, or sudo -E, in both cases,
mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate issue with my sudo env)
Post by Tim Jim
To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the above
Post by Tim Jim
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by /opt/openmpi/openmpi-2.1.0/
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd be
grateful if anyone can shed some light based on the trials I've done so
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs of
this, so I may have missed something obvious. Please let me know if any
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*

Creative Flow Research Division,
Institute of Fluid Science, Tohoku University

www.linkedin.com/in/timjim/
Reuti
2017-05-23 21:27:39 UTC
Permalink
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test whether it has successfully built?
LIke before: can you compile and run mpihello.c this time – all as ordinary user in case you installed the Open MPI into something like $HOME/local/openmpi-2.1.1 and set paths accordingly. There is no need to be root to install a personal Open MPI version in your home directory.

-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
Hi,
Post by Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on a single
machine.
Ok.
Post by Tim Jim
How might you suggest getting OpenMPIworking without python and
CUDA?
$ ./configure --without-cuda …
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of Open MPI itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only command I had
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0" - did it possibly
pick up the paths by accident?
Regarding the lib directory, I checked that the path physically exists.
Regarding the final part of the email, is it a problem that 'undefined
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.
-- Reuti
Post by Tim Jim
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working with
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might be better
answered here.
First approach would be to get Open MPI working, without CUDA and Python
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to the
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually added
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being created as "lib64" by
`libtool`. I forgot the details when this is happening, but it depends on
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently
I don't think that Ubuntu will do anything different than any other Linux.
Did you compile Open MPI on your own, or did you install any repository?
Are the CUDA application written by yourself or any freely available applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-0.conf,
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo
file (as instructed in the link) to check the installation but I had
permission issues, since it was installed win opt. However, when I
attempted to run the previous with sudo, or sudo -E, in both cases, mpicc
could not be found. (Perhaps this is a separate issue with my sudo env)
Post by Tim Jim
To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the above
Post by Tim Jim
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by /opt/openmpi/openmpi-2.1.0/
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined reference
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd be
grateful if anyone can shed some light based on the trials I've done so
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs of
this, so I may have missed something obvious. Please let me know if any
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
Tim Jim
2017-05-24 00:12:45 UTC
Permalink
Thanks for the thoughts, I'll give it a go. For reference, I have installed
it in the opt directory, as that is where I have kept my installs
currently. Will this be a problem when calling mpi from other packages?

Thanks,
Tim
Post by Tim Jim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test whether it has
successfully built?
LIke before: can you compile and run mpihello.c this time – all as
ordinary user in case you installed the Open MPI into something like
$HOME/local/openmpi-2.1.1 and set paths accordingly. There is no need to be
root to install a personal Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
Hi,
Post by Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on a single
machine.
Ok.
Post by Tim Jim
How might you suggest getting OpenMPIworking without python and
CUDA?
It looks like it's detected automatically. It should be possible to
$ ./configure --without-cuda 

Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of Open MPI itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only command I had
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0" - did it
possibly
Post by Tim Jim
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path physically exists.
Regarding the final part of the email, is it a problem that 'undefined
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.
-- Reuti
Post by Tim Jim
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working
with
Post by Tim Jim
Post by Tim Jim
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might be better
answered here.
First approach would be to get Open MPI working, without CUDA and
Python
Post by Tim Jim
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to
the
Post by Tim Jim
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually
added
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being created as "lib64"
by
Post by Tim Jim
Post by Tim Jim
`libtool`. I forgot the details when this is happening, but it
depends on
Post by Tim Jim
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently
I don't think that Ubuntu will do anything different than any other
Linux.
Post by Tim Jim
Post by Tim Jim
Did you compile Open MPI on your own, or did you install any
repository?
Post by Tim Jim
Post by Tim Jim
Are the CUDA application written by yourself or any freely available
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-
0.conf,
Post by Tim Jim
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo
file (as instructed in the link) to check the installation but I had
permission issues, since it was installed win opt. However, when I
attempted to run the previous with sudo, or sudo -E, in both cases,
mpicc
Post by Tim Jim
Post by Tim Jim
could not be found. (Perhaps this is a separate issue with my sudo
env)
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the
above
no
Post by Tim Jim
Post by Tim Jim
version information available (required by /opt/openmpi/openmpi-2.1.0/
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd
be
Post by Tim Jim
Post by Tim Jim
grateful if anyone can shed some light based on the trials I've done
so
Post by Tim Jim
Post by Tim Jim
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs
of
Post by Tim Jim
Post by Tim Jim
this, so I may have missed something obvious. Please let me know if
any
Post by Tim Jim
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
Tim Jim
2017-09-21 06:04:56 UTC
Permalink
Hello,

Apologies to bring up this old thread - I finally had a chance to try again
with openmpi but I am still have trouble getting it to run. I downloaded
version 3.0.0 hoping it would solve some of the problems but on running
mpicc for the previous test case, I am still getting an undefined reference
error. I did as you suggested and also configured it to install without
cuda using

./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0

and at the end of the summary, CUDA support shows 'no'. Unfortunately, the
error is still the same, and for some reason, mpicc still seems to have
referenced my cuda targets.

***@DESKTOP-TA3P0PS:~/Documents$ mpicc
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
`***@OPENCL_1.0'
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
`***@OPENCL_1.0'
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
`***@OPENCL_1.0'
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
`***@OPENCL_1.0'
collect2: error: ld returned 1 exit status

I also attempted to test mpirun, as suggested in the readme, however I get
the following problem:

***@DESKTOP-TA3P0PS:~/Documents$ mpirun
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
mpirun: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
--------------------------------------------------------------------------
Open MPI tried to fork a new process via the "execve" system call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.

Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
Application name: /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun was unable to start the specified application as it encountered an
error:

Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS

when attempting to start process rank 0.
--------------------------------------------------------------------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help message
help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter "orte_base_help_aggregate" to 0
to see all help / error messages


Do you have any suggestions to what might have gone wrong on this install?
I'm not sure if this thread is still alive, so if you need a refresh on the
situation/any more info, please let me know.
Kind regards,
Tim
Post by Tim Jim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have kept my installs
currently. Will this be a problem when calling mpi from other packages?
Thanks,
Tim
Post by Tim Jim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test whether it has
successfully built?
LIke before: can you compile and run mpihello.c this time – all as
ordinary user in case you installed the Open MPI into something like
$HOME/local/openmpi-2.1.1 and set paths accordingly. There is no need to be
root to install a personal Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
Hi,
Post by Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on a single
machine.
Ok.
Post by Tim Jim
How might you suggest getting OpenMPIworking without python and
CUDA?
It looks like it's detected automatically. It should be possible to
$ ./configure --without-cuda 

Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of Open MPI itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only command I had
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0" - did it
possibly
Post by Tim Jim
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path physically
exists.
Post by Tim Jim
Post by Tim Jim
Regarding the final part of the email, is it a problem that 'undefined
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.
-- Reuti
Post by Tim Jim
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get OpenMPI working
with
Post by Tim Jim
Post by Tim Jim
mpi4py. I've tried to break down my troubleshooting into a few chunks
below, and I believe that there are a few, distinct issues that need
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might be better
answered here.
First approach would be to get Open MPI working, without CUDA and
Python
Post by Tim Jim
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to
the
Post by Tim Jim
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually
added
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR for Open MPI
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being created as
"lib64" by
Post by Tim Jim
Post by Tim Jim
`libtool`. I forgot the details when this is happening, but it
depends on
Post by Tim Jim
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently
I don't think that Ubuntu will do anything different than any other
Linux.
Post by Tim Jim
Post by Tim Jim
Did you compile Open MPI on your own, or did you install any
repository?
Post by Tim Jim
Post by Tim Jim
Are the CUDA application written by yourself or any freely available
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to /etc/ld.so.conf.d/openmpi-2-1-
0.conf,
Post by Tim Jim
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a test on a demo
file (as instructed in the link) to check the installation but I had
permission issues, since it was installed win opt. However, when I
attempted to run the previous with sudo, or sudo -E, in both cases,
mpicc
Post by Tim Jim
Post by Tim Jim
could not be found. (Perhaps this is a separate issue with my sudo
env)
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied helloworld.c to a
directory where I could execute mpicc without sudo. On running the
above
no
Post by Tim Jim
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
Post by Tim Jim
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib/libopen-pal.so.20: undefined
reference
Post by Tim Jim
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission issues, and I'd
be
Post by Tim Jim
Post by Tim Jim
grateful if anyone can shed some light based on the trials I've done
so
Post by Tim Jim
Post by Tim Jim
far. (I should add I also have a CUDA installation, which I'd like to
leverage too, if possible). I'm still fairly new to the ins and outs
of
Post by Tim Jim
Post by Tim Jim
this, so I may have missed something obvious. Please let me know if
any
Post by Tim Jim
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
Gilles Gouaillardet
2017-09-21 06:22:37 UTC
Permalink
Tim,


i am not familiar with CUDA, but that might help

can you please

export nvml_enable=no

and then re-configure and rebuild Open MPI ?


i hope this will help you


Cheers,


Gilles
Post by Tim Jim
Hello,
Apologies to bring up this old thread - I finally had a chance to try
again with openmpi but I am still have trouble getting it to run. I
downloaded version 3.0.0 hoping it would solve some of the problems
but on running mpicc for the previous test case, I am still getting an
undefined reference error. I did as you suggested and also configured
it to install without cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'. Unfortunately,
the error is still the same, and for some reason, mpicc still seems to
have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme, however I
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
--------------------------------------------------------------------------
Open MPI tried to fork a new process via the "execve" system call but
failed.  Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
  Local host:        DESKTOP-TA3P0PS
  Working dir:       /home/tjim/Documents
  Application name:  /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
  Error:             Exec format error
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun was unable to start the specified application as it encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
--------------------------------------------------------------------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help message
help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter "orte_base_help_aggregate"
to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on this
install? I'm not sure if this thread is still alive, so if you need a
refresh on the situation/any more info, please let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have kept my
installs currently. Will this be a problem when calling mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test whether
it has successfully built?
LIke before: can you compile and run mpihello.c this time –
all as ordinary user in case you installed the Open MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should be
$ ./configure  --without-cuda …
At the end of the configure step out should liste some lines
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only
command I had
Post by Tim Jim
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.
-- Reuti
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working, without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo -E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious. Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/ <http://www.linkedin.com/in/timjim/>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Tim Jim
2017-09-21 06:54:57 UTC
Permalink
Dear Gilles,

Thanks for the mail - where should I set export nvml_enable=no? Should I
reconfigure with default cuda support or keep the --without-cuda flag?

Kind regards,
Tim
Post by Gilles Gouaillardet
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Post by Tim Jim
Hello,
Apologies to bring up this old thread - I finally had a chance to try
again with openmpi but I am still have trouble getting it to run. I
downloaded version 3.0.0 hoping it would solve some of the problems but on
running mpicc for the previous test case, I am still getting an
undefined reference error. I did as you suggested and also configured it to
install without cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'. Unfortunately,
the error is still the same, and for some reason, mpicc still seems to have
referenced my cuda targets.
-o hello.bin
mpicc: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by /opt/openmpi/openmpi-3.0.0/lib
/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined reference to
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme, however I
/examples/hello_c.c
mpirun: /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
version information available (required by /opt/openmpi/openmpi-3.0.0/lib
/libopen-pal.so.40)
------------------------------------------------------------
--------------
Open MPI tried to fork a new process via the "execve" system call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
Application name: /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
------------------------------------------------------------
--------------
------------------------------------------------------------
--------------
mpirun was unable to start the specified application as it encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
------------------------------------------------------------
--------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help message
help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter "orte_base_help_aggregate" to 0
to see all help / error messages
Do you have any suggestions to what might have gone wrong on this
install? I'm not sure if this thread is still alive, so if you need a
refresh on the situation/any more info, please let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have kept my
installs currently. Will this be a problem when calling mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test whether
it has successfully built?
LIke before: can you compile and run mpihello.c this time –
all as ordinary user in case you installed the Open MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should be
$ ./configure --without-cuda 

At the end of the configure step out should liste some lines
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the only
command I had
Post by Tim Jim
run was "./configure --prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't succeed.
-- Reuti
Thanks and regards,
Tim
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a cluster?
Post by Tim Jim
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working, without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the library path
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin" as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo -E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious. Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/ <http://www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Gilles Gouaillardet
2017-09-21 07:12:37 UTC
Permalink
Tim,


do that in your shell, right before invoking configure.

export nvml_enable=no

./configure ...

make && make install


you can keep the --without-cuda flag (i think this is unrelated though)


Cheers,

Gilles
Post by Tim Jim
Dear Gilles,
Thanks for the mail - where should I set export nvml_enable=no? Should
I reconfigure with default cuda support or keep the --without-cuda flag?
Kind regards,
Tim
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
--------------------------------------------------------------------------
Open MPI tried to fork a new process via the "execve" system call but
failed.  Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
  Local host:        DESKTOP-TA3P0PS
  Working dir:       /home/tjim/Documents
 /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
  Error:             Exec format error
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun was unable to start the specified application as it encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
--------------------------------------------------------------------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
    Thanks for the thoughts, I'll give it a go. For reference,
I have
    installed it in the opt directory, as that is where I have
kept my
    installs currently. Will this be a problem when calling
mpi from
    other packages?
    Thanks,
    Tim
        Hi,
        > Dear Reuti,
        >
        > Thanks for the reply. What options do I have to test
whether
        it has successfully built?
        LIke before: can you compile and run mpihello.c this
time –
        all as ordinary user in case you installed the Open
MPI into
        something like $HOME/local/openmpi-2.1.1 and set paths
        accordingly. There is no need to be root to install a
personal
        Open MPI version in your home directory.
        -- Reuti
        >
        > Thanks and kind regards.
        > Tim
        >
        > On 22 May 2017 at 19:39, Reuti
        > Hi,
        >
        > > Am 22.05.2017 um 07:22 schrieb Tim Jim
        > >
        > > Hello,
        > >
        > > Thanks for your message. I'm trying to get this to
work on
        a single
        > > machine.
        >
        > Ok.
        >
        >
        > > How might you suggest getting OpenMPIworking without
        python and
        > > CUDA?
        >
        > It looks like it's detected automatically. It should be
        >
        > $ ./configure  --without-cuda …
        >
        > At the end of the configure step out should liste
some lines
        >
        > Miscellaneous
        > -----------------------
        > CUDA support: no
        >
        > The mpi4py seems unrelated to the compilation of
Open MPI
        itself AFAICS.
        >
        >
        > > I don't recall setting anything for either, as the
only
        command I had
        > > run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
        - did it possibly
        > > pick up the paths by accident?
        > >
        > > Regarding the lib directory, I checked that the path
        physically exists.
        > > Regarding the final part of the email, is it a problem
        that 'undefined
        > > reference' is appearing?
        >
        > Yes, it tries to resolve missing symbols and didn't
succeed.
        >
        > -- Reuti
        >
        >
        > >
        > > Thanks and regards,
        > > Tim
        > >
        > > On 22 May 2017 at 06:54, Reuti
        > >
        > >> -----BEGIN PGP SIGNED MESSAGE-----
        > >> Hash: SHA1
        > >>
        > >> Hi,
        > >>
        > >>
        > >>> Hello,
        > >>>
        > >>> I have been having some issues with trying to get
        OpenMPI working with
        > >> mpi4py. I've tried to break down my
troubleshooting into
        a few chunks
        > >> below, and I believe that there are a few, distinct
        issues that need
        > >> solving.
        > >>
        > >> Are you speaking here of a single machine or a
cluster?
        > >>
        > >>
        > >>> Following some troubleshooting in the following
        > >>>
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
       
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
        > >> mpi4py-with-openmpi-gives-error
        > >>> -the mpi4py folks have suggested it an issue
that might
        be better
        > >> answered here.
        > >>
        > >> First approach would be to get Open MPI working,
without
        CUDA and Python
        > >> being involved.
        > >>
        > >>
        > >>> In summary, I have attempted to install OpenMPI on
        Ubuntu 16.04 to the
        > >> following prefix: /opt/openmpi-openmpi-2.1.0. I
have also
        manually added
        > >>> export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
        > >>> MPI_DIR=/opt/openmpi/openmpi-2.1.0
        > >>> export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
        > >>
        > >> This looks fine, although I don't recall setting
MPI_DIR
        for Open MPI
        > >> itself. It might be a necessity for mpi4py though.
        > >>
        > >> One pitfall might be that "lib" is sometimes being
        created as "lib64" by
        > >> `libtool`. I forgot the details when this is
happening,
        but it depends on
        > >> the version of `libtool` being used.
        > >>
        > >>
        > >>> I later became aware that Ubuntu may handle the
        LD_LIBRARY_PATH
        > >> differently
        > >>
        > >> I don't think that Ubuntu will do anything
different than
        any other Linux.
        > >>
        > >> Did you compile Open MPI on your own, or did you
install
        any repository?
        > >>
        > >> Are the CUDA application written by yourself or any
        freely available
        > >> applications?
        > >>
        > >> - -- Reuti
        > >>
        > >>
        > >>> and instead added a new file containing the
library path
        > >> /opt/openmpi/openmpi-2.1.0/lib to
        /etc/ld.so.conf.d/openmpi-2-1-0.conf,
        > >> in the style of everything else in that directory.
        > >>>
        > >>> I tried to run "mpicc helloworld.c -o hello.bin"
as a
        test on a demo
        > >> file (as instructed in the link) to check the
        installation but I had
        > >> permission issues, since it was installed win opt.
        However, when I
        > >> attempted to run the previous with sudo, or sudo
-E, in
        both cases, mpicc
        > >> could not be found. (Perhaps this is a separate issue
        with my sudo env)
        > >>>
        > >>> To check that mpicc actually works, I have copied
        helloworld.c to a
        > >> directory where I could execute mpicc without
sudo. On
        running the above
        > >>>
       
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
        > >> version information available (required by
        /opt/openmpi/openmpi-2.1.0/
        > >> lib/libopen-pal.so.20)
        undefined reference
        undefined reference
        undefined reference
        undefined reference
        > >>> collect2: error: ld returned 1 exit status
        > >>>
        > >>> I am unsure if I have an installation or permission
        issues, and I'd be
        > >> grateful if anyone can shed some light based on the
        trials I've done so
        > >> far. (I should add I also have a CUDA
installation, which
        I'd like to
        > >> leverage too, if possible). I'm still fairly new
to the
        ins and outs of
        > >> this, so I may have missed something obvious.
Please let
        me know if any
        > >> other info is required.
        > >>>
        > >>> Many thanks and kind regards,
        > >>> Tim
        > >>>
        > >>> --
        > >>>
        > >>> Timothy Jim
        > >>> PhD Researcher in Aerospace
        > >>> Creative Flow Research Division,
        > >>> Institute of Fluid Science, Tohoku University
        > >>> www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
        > >>> _______________________________________________
        > >>> users mailing list
        > >>>
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
        > >>
        > >> -----BEGIN PGP SIGNATURE-----
        > >> Comment: GPGTools - https://gpgtools.org
        > >>
        > >>
       
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
        > >> RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
        > >> =R6up
        > >> -----END PGP SIGNATURE-----
        > >> _______________________________________________
        > >> users mailing list
        > >>
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
        > >>
        > >
        > >
        > >
        > > --
        > >
        > >
        > > *Timothy Jim**PhD Researcher in Aerospace*
        > >
        > > Creative Flow Research Division,
        > > Institute of Fluid Science, Tohoku University
        > >
        > > www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
        > > _______________________________________________
        > > users mailing list
        > >
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
        >
        > _______________________________________________
        > users mailing list
        >
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
        >
        >
        >
        > --
        >
        > Timothy Jim
        > PhD Researcher in Aerospace
        > Creative Flow Research Division,
        > Institute of Fluid Science, Tohoku University
        > www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
        > _______________________________________________
        > users mailing list
        >
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
        _______________________________________________
        users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Tim Jim
2017-09-21 07:32:13 UTC
Permalink
Hi,

I tried as you suggested: export nvml_enable=no, then reconfigured and ran
make all install again, but mpicc is still producing the same error. What
should I try next?

Many thanks,
Tim
Post by Gilles Gouaillardet
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is unrelated though)
Cheers,
Gilles
Post by Tim Jim
Dear Gilles,
Thanks for the mail - where should I set export nvml_enable=no? Should I
reconfigure with default cuda support or keep the --without-cuda flag?
Kind regards,
Tim
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
------------------------------------------------------------
--------------
Open MPI tried to fork a new process via the "execve" system call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
------------------------------------------------------------
--------------
------------------------------------------------------------
--------------
mpirun was unable to start the specified application as it encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
------------------------------------------------------------
--------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have kept my
installs currently. Will this be a problem when calling mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test
whether
it has successfully built?
LIke before: can you compile and run mpihello.c this time –
all as ordinary user in case you installed the Open MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
On 22 May 2017 at 19:39, Reuti
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to
work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should be
$ ./configure --without-cuda 

At the end of the configure step out should liste
some lines
Post by Tim Jim
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the
only
command I had
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't
succeed.
Post by Tim Jim
-- Reuti
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a
cluster?
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working,
without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I
have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$
LD_LIBRARY_PATH
Post by Tim Jim
This looks fine, although I don't recall setting
MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is
happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you
install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
library path
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin"
as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo
-E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without
sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new
to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious.
Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*

Creative Flow Research Division,
Institute of Fluid Science, Tohoku University

www.linkedin.com/in/timjim/
Jeff Squyres (jsquyres)
2017-09-21 14:54:13 UTC
Permalink
A few things:

0. Rather than go a few more rounds of "how was Open MPI configured", can you send all the information listed here:

https://www.open-mpi.org/community/help/

That will tell us a lot about exactly how your Open MPI was configured, installed, etc.

1. Your mpirun error is because you were trying to execute the C source code, not a binary:

mpirun /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c

In general, you first have to compile hello_c.c into an executable, and then you can run that (yes, I know that mpicc is currently failing for you because of the missing CUDA symbols; I'm just making the point that you can't proceed to the mpirun step until the mpicc step completes successfully).

2. I would not add/modify /etc/ld.so.conf.d files unless you really, really have to. LD_LIBRARY_PATH should be sufficient (that's a personal preference of mine -- modifying /etc/ld.so.conf.d should be an option of last resort and/or for fairly special circumstances)

3. Your CUDA problems may be indirectly due to one of Open MPI's plugins not properly disabling CUDA support when the user passes --without-cuda (per https://github.com/open-mpi/ompi/issues/4219). Specifically: it should be very possible to solve the CUDA unresolved symbols issue, but avoiding the issue altogether by disabling CUDA in Open MPI seems to have a bug at the moment. :-( A few possible workarounds:

3a. Make sure that Open MPI can't find the CUDA headers/libraries when it is configuring hwloc. This may be a little tricky if your CUDA libraries are in the default compiler/linker search paths. But it may be possible. For example, if you're not using CUDA on your systems, uninstall the CUDA headers/libraries (and then re-configure/build/install Open MPI).

3b. Add the appropriate -L and -l flags to your mpicc command line to find the CUDA libraries. This is a little cumbersome and exactly the type of thing that mpicc is supposed to hide from you, but due to #3, Open MPI is inadvertently still activating CUDA without realizing it (and therefore the wrapper isn't aware of the CUDA support in Open MPI / didn't add the appropriate -L / -l flags for CUDA for you). That will resolve the mpicc can't-find-symbols issue, and then you should be able to mpirun (presuming the CUDA libraries are findable either by linker default search paths, or you have them in a directory in your LD_LIBRARY_PATH).
Hi,
I tried as you suggested: export nvml_enable=no, then reconfigured and ran make all install again, but mpicc is still producing the same error. What should I try next?
Many thanks,
Tim
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is unrelated though)
Cheers,
Gilles
Dear Gilles,
Thanks for the mail - where should I set export nvml_enable=no? Should I reconfigure with default cuda support or keep the --without-cuda flag?
Kind regards,
Tim
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
--------------------------------------------------------------------------
Open MPI tried to fork a new process via the "execve" system call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun was unable to start the specified application as it encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
--------------------------------------------------------------------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have kept my
installs currently. Will this be a problem when calling mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test
whether
it has successfully built?
LIke before: can you compile and run mpihello.c this time –
all as ordinary user in case you installed the Open MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
On 22 May 2017 at 19:39, Reuti
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to
work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should be
$ ./configure --without-cuda …
At the end of the configure step out should liste
some lines
Post by Tim Jim
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the
only
command I had
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't
succeed.
Post by Tim Jim
-- Reuti
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a
cluster?
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working,
without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I
have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
This looks fine, although I don't recall setting
MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is
happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you
install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
library path
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin"
as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo
-E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without
sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new
to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious.
Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
Jeff Squyres
***@cisco.com
Sylvain Jeaugey
2017-09-21 16:10:37 UTC
Permalink
The issue is related to openCL, not NVML.

So the correct export would be "export enable_opencl=no" (you may want
to "export enable_nvml=no" as well).
Post by Tim Jim
Hi,
I tried as you suggested: export nvml_enable=no, then reconfigured and
ran make all install again, but mpicc is still producing the same
error. What should I try next?
Many thanks,
Tim
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is unrelated though)
Cheers,
Gilles
Dear Gilles,
Thanks for the mail - where should I set export
nvml_enable=no? Should I reconfigure with default cuda support
or keep the --without-cuda flag?
Kind regards,
Tim
On 21 September 2017 at 15:22, Gilles Gouaillardet
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda
--prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
--------------------------------------------------------------------------
Open MPI tried to fork a new process via the "execve"
system
call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be
indicative
of another problem on the target host, or even
something as
silly as
having specified a directory for your application.
Your job
will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun was unable to start the specified application as it
encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
--------------------------------------------------------------------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
On 24 May 2017 at 09:12, Tim Jim
Thanks for the thoughts, I'll give it a go. For
reference,
I have
installed it in the opt directory, as that is
where I have
kept my
installs currently. Will this be a problem when
calling
mpi from
other packages?
Thanks,
Tim
On 24 May 2017 06:30, "Reuti"
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have
to test
whether
it has successfully built?
LIke before: can you compile and run
mpihello.c this
time –
all as ordinary user in case you installed the
Open
MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to
install a
personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
On 22 May 2017 at 19:39, Reuti
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get
this to
work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting
OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically.
It should be
Post by Tim Jim
$ ./configure --without-cuda 

At the end of the configure step out should
liste
some lines
Post by Tim Jim
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for
either, as the
only
command I had
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked
that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is
it a problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and
didn't
succeed.
Post by Tim Jim
-- Reuti
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with
trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a
few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine
or a
cluster?
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the
following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>>
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI
working,
without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install
OpenMPI on
Ubuntu 16.04 to the
/opt/openmpi-openmpi-2.1.0. I
have also
manually added
Post by Tim Jim
Post by Tim Jim
export
PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
Post by Tim Jim
Post by Tim Jim
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export
LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
Post by Tim Jim
This looks fine, although I don't recall
setting
MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for
mpi4py though.
Post by Tim Jim
One pitfall might be that "lib" is
sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is
happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may
handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or
did you
install
any repository?
Post by Tim Jim
Are the CUDA application written by
yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
library path
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that
directory.
Post by Tim Jim
Post by Tim Jim
I tried to run "mpicc helloworld.c -o
hello.bin"
as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed
win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo,
or sudo
-E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a
separate issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I
have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without
sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or
permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light
based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still
fairly new
to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious.
Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku
University
Post by Tim Jim
Post by Tim Jim
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>>
_______________________________________________
Post by Tim Jim
Post by Tim Jim
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
Post by Tim Jim
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>>
_______________________________________________
Post by Tim Jim
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
<https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
<https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
--
*Timothy Jim
*/PhD Researcher in Aerospace/
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/ <http://www.linkedin.com/in/timjim/>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
-----------------------------------------------------------------------------------
This email message is for the sole use of the intended recipient(s) and may contain
confidential information. Any unauthorized review, use, disclosure or distribution
is prohibited. If you are not the intended recipient, please contact the sender by
reply email and destroy all copies of the original message.
-----------------------------------------------------------------------------------
Tim Jim
2017-09-22 06:33:18 UTC
Permalink
Thanks for the thoughts and comments. Here is the setup information:
OpenMPI Ver. 3.0.0. Please see attached for the compressed config.log and
ompi_info --all call.
In this compile, my install steps were:
1. declared "export nvml_enable=no" and "export enable_opencl=no" in the
terminal
and the rest as seen in the logs:
2. ./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
3. make all install

I ultimately would like CUDA to be utilised if it can speed up my
computation time - should I still attempt to get openMPI working without
CUDA first?

Thanks for the heads up about compiling the executables first - I tried
mpicc again with the compiled version but got the following output:

***@DESKTOP-TA3P0PS:~/Documents$ mpicc
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function `_start':
(.text+0x0): multiple definition of `_start'
/usr/lib/gcc/x86_64-linux-gnu/5/../../../x86_64-linux-gnu/crt1.o:(.text+0x0):
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function `_fini':
(.fini+0x0): multiple definition of `_fini'
/usr/lib/gcc/x86_64-linux-gnu/5/../../../x86_64-linux-gnu/crti.o:(.fini+0x0):
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c:(.rodata+0x0): multiple
definition of `_IO_stdin_used'
/usr/lib/gcc/x86_64-linux-gnu/5/../../../x86_64-linux-gnu/crt1.o:(.rodata.cst4+0x0):
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function `data_start':
(.data+0x0): multiple definition of `__data_start'
/usr/lib/gcc/x86_64-linux-gnu/5/../../../x86_64-linux-gnu/crt1.o:(.data+0x0):
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function `data_start':
(.data+0x8): multiple definition of `__dso_handle'
/usr/lib/gcc/x86_64-linux-gnu/5/crtbegin.o:(.data+0x0): first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function `_init':
(.init+0x0): multiple definition of `_init'
/usr/lib/gcc/x86_64-linux-gnu/5/../../../x86_64-linux-gnu/crti.o:(.init+0x0):
first defined here
/usr/lib/gcc/x86_64-linux-gnu/5/crtend.o:(.tm_clone_table+0x0): multiple
definition of `__TMC_END__'
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c:(.data+0x10): first defined
here
/usr/bin/ld: error in
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c(.eh_frame); no
.eh_frame_hdr table will be created.
collect2: error: ld returned 1 exit status

Is this due to a failed install?
Regards,
Tim
Post by Sylvain Jeaugey
The issue is related to openCL, not NVML.
So the correct export would be "export enable_opencl=no" (you may want to
"export enable_nvml=no" as well).
Hi,
I tried as you suggested: export nvml_enable=no, then reconfigured and ran
make all install again, but mpicc is still producing the same error. What
should I try next?
Many thanks,
Tim
Post by Gilles Gouaillardet
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is unrelated though)
Cheers,
Gilles
Post by Tim Jim
Dear Gilles,
Thanks for the mail - where should I set export nvml_enable=no? Should I
reconfigure with default cuda support or keep the --without-cuda flag?
Kind regards,
Tim
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
------------------------------------------------------------
--------------
Open MPI tried to fork a new process via the "execve" system call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
------------------------------------------------------------
--------------
------------------------------------------------------------
--------------
mpirun was unable to start the specified application as it
encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
------------------------------------------------------------
--------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have kept my
installs currently. Will this be a problem when calling mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test
whether
it has successfully built?
LIke before: can you compile and run mpihello.c this
time –
all as ordinary user in case you installed the Open MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
On 22 May 2017 at 19:39, Reuti
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to
work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should be
$ ./configure --without-cuda 

At the end of the configure step out should liste
some lines
Post by Tim Jim
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the
only
command I had
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a
problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't
succeed.
Post by Tim Jim
-- Reuti
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a
cluster?
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working,
without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I
have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$
LD_LIBRARY_PATH
Post by Tim Jim
This looks fine, although I don't recall setting
MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is
happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you
install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
library path
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin"
as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo
-E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate
issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without
sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new
to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious.
Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
*Timothy Jim **PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
------------------------------
This email message is for the sole use of the intended recipient(s) and
may contain confidential information. Any unauthorized review, use,
disclosure or distribution is prohibited. If you are not the intended
recipient, please contact the sender by reply email and destroy all copies
of the original message.
------------------------------
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Gilles Gouaillardet
2017-09-22 06:55:32 UTC
Permalink
Was there an error in the copy/paste ?

The mpicc command should be
mpicc /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c

Cheers,

Gilles
Post by Tim Jim
OpenMPI Ver. 3.0.0. Please see attached for the compressed config.log and
ompi_info --all call.
1. declared "export nvml_enable=no" and "export enable_opencl=no" in the
terminal
2. ./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
3. make all install
I ultimately would like CUDA to be utilised if it can speed up my
computation time - should I still attempt to get openMPI working without
CUDA first?
Thanks for the heads up about compiling the executables first - I tried
src/examples/hello_c
(.text+0x0): multiple definition of `_start'
first defined here
(.fini+0x0): multiple definition of `_fini'
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c:(.rodata+0x0): multiple
definition of `_IO_stdin_used'
first defined here
(.data+0x0): multiple definition of `__data_start'
first defined here
(.data+0x8): multiple definition of `__dso_handle'
/usr/lib/gcc/x86_64-linux-gnu/5/crtbegin.o:(.data+0x0): first defined here
(.init+0x0): multiple definition of `_init'
first defined here
/usr/lib/gcc/x86_64-linux-gnu/5/crtend.o:(.tm_clone_table+0x0): multiple
definition of `__TMC_END__'
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c:(.data+0x10): first
defined here
/usr/bin/ld: error in /opt/openmpi/openmpi-3.0.0_src/examples/hello_c(.eh_frame);
no .eh_frame_hdr table will be created.
collect2: error: ld returned 1 exit status
Is this due to a failed install?
Regards,
Tim
Post by Sylvain Jeaugey
The issue is related to openCL, not NVML.
So the correct export would be "export enable_opencl=no" (you may want to
"export enable_nvml=no" as well).
Hi,
I tried as you suggested: export nvml_enable=no, then reconfigured and
ran make all install again, but mpicc is still producing the same error.
What should I try next?
Many thanks,
Tim
Post by Gilles Gouaillardet
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is unrelated though)
Cheers,
Gilles
Post by Tim Jim
Dear Gilles,
Thanks for the mail - where should I set export nvml_enable=no? Should
I reconfigure with default cuda support or keep the --without-cuda flag?
Kind regards,
Tim
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
------------------------------------------------------------
--------------
Open MPI tried to fork a new process via the "execve" system call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as silly as
having specified a directory for your application. Your job will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
------------------------------------------------------------
--------------
------------------------------------------------------------
--------------
mpirun was unable to start the specified application as it
encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
------------------------------------------------------------
--------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference, I have
installed it in the opt directory, as that is where I have
kept my
installs currently. Will this be a problem when calling mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test
whether
it has successfully built?
LIke before: can you compile and run mpihello.c this
time –
all as ordinary user in case you installed the Open MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a
personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
On 22 May 2017 at 19:39, Reuti
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to
work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should
be
Post by Tim Jim
$ ./configure --without-cuda 

At the end of the configure step out should liste
some lines
Post by Tim Jim
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the
only
command I had
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a
problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't
succeed.
Post by Tim Jim
-- Reuti
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few, distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a
cluster?
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working,
without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I
have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1
.0/bin:$PATH"
Post by Tim Jim
Post by Tim Jim
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$
LD_LIBRARY_PATH
Post by Tim Jim
This looks fine, although I don't recall setting
MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is
happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you
install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
library path
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin"
as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo
-E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate
issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without
sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or
permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new
to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious.
Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz04
1OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
*Timothy Jim **PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
------------------------------
This email message is for the sole use of the intended recipient(s) and
may contain confidential information. Any unauthorized review, use,
disclosure or distribution is prohibited. If you are not the intended
recipient, please contact the sender by reply email and destroy all copies
of the original message.
------------------------------
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Tim Jim
2017-09-22 07:59:50 UTC
Permalink
Hi Gilles,

Yes, you're right. I wanted to double check the compile but didn't notice I
was pointing to the exec I compiled from a previous Make.

mpicc now seems to work, running mpirun hello_c gives:

Hello, world, I am 0 of 4, (Open MPI v3.0.0, package: Open MPI
***@DESKTOP-TA3P0PS Distribution, ident: 3.0.0, repo rev: v3.0.0, Sep 12,
2017, 115)
Hello, world, I am 3 of 4, (Open MPI v3.0.0, package: Open MPI
***@DESKTOP-TA3P0PS Distribution, ident: 3.0.0, repo rev: v3.0.0, Sep 12,
2017, 115)
Hello, world, I am 1 of 4, (Open MPI v3.0.0, package: Open MPI
***@DESKTOP-TA3P0PS Distribution, ident: 3.0.0, repo rev: v3.0.0, Sep 12,
2017, 115)
Hello, world, I am 2 of 4, (Open MPI v3.0.0, package: Open MPI
***@DESKTOP-TA3P0PS Distribution, ident: 3.0.0, repo rev: v3.0.0, Sep 12,
2017, 115)

- which I assume that means it's working?

Should I try a recompile with CUDA while declaring "export nvml_enable=no"
and "export enable_opencl=no"? What effects do these declarations have on
the normal functioning of mpi?

Many thanks.


On 22 September 2017 at 15:55, Gilles Gouaillardet <
Post by Gilles Gouaillardet
Was there an error in the copy/paste ?
The mpicc command should be
mpicc /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Cheers,
Gilles
Post by Tim Jim
OpenMPI Ver. 3.0.0. Please see attached for the compressed config.log and
ompi_info --all call.
1. declared "export nvml_enable=no" and "export enable_opencl=no" in the
terminal
2. ./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
3. make all install
I ultimately would like CUDA to be utilised if it can speed up my
computation time - should I still attempt to get openMPI working without
CUDA first?
Thanks for the heads up about compiling the executables first - I tried
/examples/hello_c
(.text+0x0): multiple definition of `_start'
first defined here
(.fini+0x0): multiple definition of `_fini'
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c:(.rodata+0x0): multiple
definition of `_IO_stdin_used'
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function
(.data+0x0): multiple definition of `__data_start'
first defined here
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c: In function
(.data+0x8): multiple definition of `__dso_handle'
/usr/lib/gcc/x86_64-linux-gnu/5/crtbegin.o:(.data+0x0): first defined here
(.init+0x0): multiple definition of `_init'
first defined here
/usr/lib/gcc/x86_64-linux-gnu/5/crtend.o:(.tm_clone_table+0x0): multiple
definition of `__TMC_END__'
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c:(.data+0x10): first
defined here
/usr/bin/ld: error in /opt/openmpi/openmpi-3.0.0_src/examples/hello_c(.eh_frame);
no .eh_frame_hdr table will be created.
collect2: error: ld returned 1 exit status
Is this due to a failed install?
Regards,
Tim
Post by Sylvain Jeaugey
The issue is related to openCL, not NVML.
So the correct export would be "export enable_opencl=no" (you may want
to "export enable_nvml=no" as well).
Hi,
I tried as you suggested: export nvml_enable=no, then reconfigured and
ran make all install again, but mpicc is still producing the same error.
What should I try next?
Many thanks,
Tim
Post by Gilles Gouaillardet
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is unrelated though)
Cheers,
Gilles
Post by Tim Jim
Dear Gilles,
Thanks for the mail - where should I set export nvml_enable=no? Should
I reconfigure with default cuda support or keep the --without-cuda flag?
Kind regards,
Tim
Tim,
i am not familiar with CUDA, but that might help
can you please
export nvml_enable=no
and then re-configure and rebuild Open MPI ?
i hope this will help you
Cheers,
Gilles
Hello,
Apologies to bring up this old thread - I finally had a chance
to try again with openmpi but I am still have trouble getting
it to run. I downloaded version 3.0.0 hoping it would solve
some of the problems but on running mpicc for the previous
test case, I am still getting an undefined reference error. I
did as you suggested and also configured it to install without
cuda using
./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
and at the end of the summary, CUDA support shows 'no'.
Unfortunately, the error is still the same, and for some
reason, mpicc still seems to have referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40: undefined
collect2: error: ld returned 1 exit status
I also attempted to test mpirun, as suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
------------------------------------------------------------
--------------
Open MPI tried to fork a new process via the "execve" system
call but
failed. Open MPI checks many things before attempting to launch a
child process, but nothing is perfect. This error may be indicative
of another problem on the target host, or even something as
silly as
having specified a directory for your application. Your job
will now
abort.
Local host: DESKTOP-TA3P0PS
Working dir: /home/tjim/Documents
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Error: Exec format error
------------------------------------------------------------
--------------
------------------------------------------------------------
--------------
mpirun was unable to start the specified application as it
encountered an
Error code: 1
Error name: (null)
Node: DESKTOP-TA3P0PS
when attempting to start process rank 0.
------------------------------------------------------------
--------------
4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have sent help
message help-orte-odls-default.txt / execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages
Do you have any suggestions to what might have gone wrong on
this install? I'm not sure if this thread is still alive, so
if you need a refresh on the situation/any more info, please
let me know.
Kind regards,
Tim
Thanks for the thoughts, I'll give it a go. For reference,
I have
installed it in the opt directory, as that is where I have
kept my
installs currently. Will this be a problem when calling
mpi from
other packages?
Thanks,
Tim
Hi,
Post by Tim Jim
Dear Reuti,
Thanks for the reply. What options do I have to test
whether
it has successfully built?
LIke before: can you compile and run mpihello.c this
time –
all as ordinary user in case you installed the Open
MPI into
something like $HOME/local/openmpi-2.1.1 and set paths
accordingly. There is no need to be root to install a
personal
Open MPI version in your home directory.
-- Reuti
Post by Tim Jim
Thanks and kind regards.
Tim
On 22 May 2017 at 19:39, Reuti
Hi,
Am 22.05.2017 um 07:22 schrieb Tim Jim
Hello,
Thanks for your message. I'm trying to get this to
work on
a single
Post by Tim Jim
machine.
Ok.
How might you suggest getting OpenMPIworking
without
python and
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It should
be
Post by Tim Jim
$ ./configure --without-cuda 

At the end of the configure step out should liste
some lines
Post by Tim Jim
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
Open MPI
itself AFAICS.
Post by Tim Jim
I don't recall setting anything for either, as the
only
command I had
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
- did it possibly
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that the
path
physically exists.
Post by Tim Jim
Regarding the final part of the email, is it a
problem
that 'undefined
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't
succeed.
Post by Tim Jim
-- Reuti
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying to get
OpenMPI working with
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
a few chunks
Post by Tim Jim
below, and I believe that there are a few,
distinct
issues that need
Post by Tim Jim
solving.
Are you speaking here of a single machine or a
cluster?
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
that might
be better
Post by Tim Jim
answered here.
First approach would be to get Open MPI working,
without
CUDA and Python
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install OpenMPI
on
Ubuntu 16.04 to the
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I
have also
manually added
Post by Tim Jim
Post by Tim Jim
export PATH="/opt/openmpi/openmpi-2.1
.0/bin:$PATH"
Post by Tim Jim
Post by Tim Jim
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$
LD_LIBRARY_PATH
Post by Tim Jim
This looks fine, although I don't recall setting
MPI_DIR
for Open MPI
Post by Tim Jim
itself. It might be a necessity for mpi4py though.
One pitfall might be that "lib" is sometimes being
created as "lib64" by
Post by Tim Jim
`libtool`. I forgot the details when this is
happening,
but it depends on
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
different than
any other Linux.
Post by Tim Jim
Did you compile Open MPI on your own, or did you
install
any repository?
Post by Tim Jim
Are the CUDA application written by yourself or
any
freely available
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
library path
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Tim Jim
in the style of everything else in that directory.
Post by Tim Jim
I tried to run "mpicc helloworld.c -o hello.bin"
as a
test on a demo
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Tim Jim
permission issues, since it was installed win opt.
However, when I
Post by Tim Jim
attempted to run the previous with sudo, or sudo
-E, in
both cases, mpicc
Post by Tim Jim
could not be found. (Perhaps this is a separate
issue
with my sudo env)
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have copied
helloworld.c to a
Post by Tim Jim
directory where I could execute mpicc without
sudo. On
running the above
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1: no
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Tim Jim
lib/libopen-pal.so.20)
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib
undefined reference
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib
undefined reference
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib
undefined reference
Post by Tim Jim
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib
undefined reference
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or
permission
issues, and I'd be
Post by Tim Jim
grateful if anyone can shed some light based on
the
trials I've done so
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Tim Jim
leverage too, if possible). I'm still fairly new
to the
ins and outs of
Post by Tim Jim
this, so I may have missed something obvious.
Please let
me know if any
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz04
1OMP
Post by Tim Jim
RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
=R6up
-----END PGP SIGNATURE-----
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
*Timothy Jim**PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
Post by Tim Jim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
Post by Tim Jim
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
*Timothy Jim **PhD Researcher in Aerospace*
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
_______________________________________________
------------------------------
This email message is for the sole use of the intended recipient(s) and
may contain confidential information. Any unauthorized review, use,
disclosure or distribution is prohibited. If you are not the intended
recipient, please contact the sender by reply email and destroy all copies
of the original message.
------------------------------
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
*Timothy Jim**PhD Researcher in Aerospace*

Creative Flow Research Division,
Institute of Fluid Science, Tohoku University

www.linkedin.com/in/timjim/
Gilles Gouaillardet
2017-09-22 08:14:07 UTC
Permalink
Great it is finally working !


nvml and opencl are only used by hwloc, and i do not think Open MPI is
using these features,

so i suggest you go ahead, reconfigure and rebuild Open MPI and see how
things go


Cheers,


Gilles
Post by Tim Jim
Hi Gilles,
Yes, you're right. I wanted to double check the compile but didn't
notice I was pointing to the exec I compiled from a previous Make.
Hello, world, I am 0 of 4, (Open MPI v3.0.0, package: Open MPI
12, 2017, 115)
Hello, world, I am 3 of 4, (Open MPI v3.0.0, package: Open MPI
12, 2017, 115)
Hello, world, I am 1 of 4, (Open MPI v3.0.0, package: Open MPI
12, 2017, 115)
Hello, world, I am 2 of 4, (Open MPI v3.0.0, package: Open MPI
12, 2017, 115)
- which I assume that means it's working?
Should I try a recompile with CUDA while declaring "export
nvml_enable=no" and "export enable_opencl=no"? What effects do these
declarations have on the normal functioning of mpi?
Many thanks.
On 22 September 2017 at 15:55, Gilles Gouaillardet
Was there an error in the copy/paste ?
The mpicc command should be
mpicc  /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
Cheers,
Gilles
OpenMPI Ver. 3.0.0. Please see attached for the compressed
config.log and ompi_info --all call.
1. declared  "export nvml_enable=no" and "export
enable_opencl=no" in the terminal
2. ./configure --without-cuda --prefix=/opt/openmpi/openmpi-3.0.0
3. make all install
I ultimately would like CUDA to be utilised if it can speed up
my computation time - should I still attempt to get openMPI
working without CUDA first?
Thanks for the heads up about compiling the executables first
- I tried mpicc again with the compiled version but got the
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c
(.text+0x0): multiple definition of `_start'
first defined here
(.fini+0x0): multiple definition of `_fini'
first defined here
multiple definition of `_IO_stdin_used'
first defined here
(.data+0x0): multiple definition of `__data_start'
first defined here
(.data+0x8): multiple definition of `__dso_handle'
/usr/lib/gcc/x86_64-linux-gnu/5/crtbegin.o:(.data+0x0): first defined here
(.init+0x0): multiple definition of `_init'
first defined here
multiple definition of `__TMC_END__'
first defined here
/usr/bin/ld: error in
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c(.eh_frame); no
.eh_frame_hdr table will be created.
collect2: error: ld returned 1 exit status
Is this due to a failed install?
Regards,
Tim
On 22 September 2017 at 01:10, Sylvain Jeaugey
The issue is related to openCL, not NVML.
So the correct export would be "export enable_opencl=no"
(you may want to "export enable_nvml=no" as well).
Post by Tim Jim
Hi,
I tried as you suggested: export nvml_enable=no, then
reconfigured and ran make all install again, but mpicc is
still producing the same error. What should I try next?
Many thanks,
Tim
On 21 September 2017 at 16:12, Gilles Gouaillardet
Tim,
do that in your shell, right before invoking configure.
export nvml_enable=no
./configure ...
make && make install
you can keep the --without-cuda flag (i think this is
unrelated though)
Cheers,
Gilles
Dear Gilles,
Thanks for the mail - where should I set export
nvml_enable=no? Should I reconfigure with default
cuda support or keep the --without-cuda flag?
Kind regards,
Tim
On 21 September 2017 at 15:22, Gilles
    Tim,
    i am not familiar with CUDA, but that might help
    can you please
    export nvml_enable=no
    and then re-configure and rebuild Open MPI ?
    i hope this will help you
    Cheers,
    Gilles
        Hello,
        Apologies to bring up this old thread - I
finally had a chance
        to try again with openmpi but I am still
have trouble getting
        it to run. I downloaded version 3.0.0
hoping it would solve
        some of the problems but on running
mpicc for the previous
        test case, I am still getting an
undefined reference error. I
        did as you suggested and also configured
it to install without
        cuda using
./configure --without-cuda
--prefix=/opt/openmpi/openmpi-3.0.0
        and at the end of the summary, CUDA
support shows 'no'.
Unfortunately, the error is still the same, and
for some
        reason, mpicc still seems to have
referenced my cuda targets.
/opt/mpi4py/mpi4py_src/demo/helloworld.c -o hello.bin
        no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
undefined
        reference to
undefined
undefined
undefined
        collect2: error: ld returned 1 exit status
        I also attempted to test mpirun, as
suggested in the readme,
/opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
        no version information available (required by
/opt/openmpi/openmpi-3.0.0/lib/libopen-pal.so.40)
--------------------------------------------------------------------------
        Open MPI tried to fork a new process via
the "execve" system
        call but
        failed. Open MPI checks many things
before attempting to launch a
        child process, but nothing is perfect.
This error may be
        indicative
        of another problem on the target host, or
even something as
        silly as
        having specified a directory for your
application. Your job
        will now
        abort.
          Local host:  DESKTOP-TA3P0PS
          Working dir: /home/tjim/Documents
 /opt/openmpi/openmpi-3.0.0_src/examples/hello_c.c
          Error:           Exec format error
--------------------------------------------------------------------------
--------------------------------------------------------------------------
        mpirun was unable to start the specified
application as it
encountered an
        Error code: 1
        Error name: (null)
        Node: DESKTOP-TA3P0PS
        when attempting to start process rank 0.
--------------------------------------------------------------------------
        4 total processes failed to start
[DESKTOP-TA3P0PS:15231] 3 more processes have
sent help
        message help-orte-odls-default.txt /
execve error
[DESKTOP-TA3P0PS:15231] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help /
error messages
        Do you have any suggestions to what might
have gone wrong on
        this install? I'm not sure if this thread
is still alive, so
        if you need a refresh on the
situation/any more info, please
        let me know.
        Kind regards,
        Tim
        On 24 May 2017 at 09:12, Tim Jim
            Thanks for the thoughts, I'll give it
a go. For reference,
        I have
installed it in the opt directory, as that is
where I have
        kept my
            installs currently. Will this be a
problem when calling
        mpi from
            other packages?
            Thanks,
            Tim
            On 24 May 2017 06:30, "Reuti"
                Hi,
                Am 23.05.2017 um 05:03 schrieb
                > Dear Reuti,
                >
                > Thanks for the reply. What
options do I have to test
        whether
                it has successfully built?
                LIke before: can you compile and
run mpihello.c this
        time –
                all as ordinary user in case you
installed the Open
        MPI into
something like $HOME/local/openmpi-2.1.1 and set
paths
accordingly. There is no need to be root to install a
        personal
                Open MPI version in your home
directory.
                -- Reuti
                >
                > Thanks and kind regards.
                > Tim
                >
                > On 22 May 2017 at 19:39, Reuti
                > Hi,
                >
                > > Am 22.05.2017 um 07:22
schrieb Tim Jim
Post by Reuti
Post by Tim Jim
Hello,
Thanks for your message. I'm trying to get
this to
        work on
                a single
Post by Reuti
Post by Tim Jim
machine.
Ok.
Post by Tim Jim
How might you suggest getting OpenMPIworking
without
python and
Post by Reuti
Post by Tim Jim
CUDA?
It looks like it's detected automatically. It
should be
Post by Reuti
$ ./configure --without-cuda …
At the end of the configure step out should liste
        some lines
Post by Reuti
Miscellaneous
-----------------------
CUDA support: no
The mpi4py seems unrelated to the compilation of
        Open MPI
itself AFAICS.
Post by Reuti
Post by Tim Jim
I don't recall setting anything for either,
as the
        only
command I had
Post by Reuti
Post by Tim Jim
run was "./configure
--prefix=/opt/openmpi/openmpi-2.1.0"
                - did it possibly
Post by Reuti
Post by Tim Jim
pick up the paths by accident?
Regarding the lib directory, I checked that
the path
physically exists.
Post by Reuti
Post by Tim Jim
Regarding the final part of the email, is it
a problem
that 'undefined
Post by Reuti
Post by Tim Jim
reference' is appearing?
Yes, it tries to resolve missing symbols and didn't
        succeed.
Post by Reuti
-- Reuti
Post by Tim Jim
Thanks and regards,
Tim
On 22 May 2017 at 06:54, Reuti
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
Post by Tim Jim
Hello,
I have been having some issues with trying
to get
OpenMPI working with
Post by Reuti
Post by Tim Jim
mpi4py. I've tried to break down my
troubleshooting into
                a few chunks
Post by Reuti
Post by Tim Jim
below, and I believe that there are a few,
distinct
issues that need
Post by Reuti
Post by Tim Jim
solving.
Are you speaking here of a single machine or a
        cluster?
Post by Reuti
Post by Tim Jim
Post by Tim Jim
Following some troubleshooting in the following
https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
       
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>
       
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->
       
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building-
<https://bitbucket.org/mpi4py/mpi4py/issues/69/building->>>
Post by Reuti
Post by Tim Jim
mpi4py-with-openmpi-gives-error
Post by Tim Jim
-the mpi4py folks have suggested it an issue
        that might
                be better
Post by Reuti
Post by Tim Jim
answered here.
First approach would be to get Open MPI working,
        without
CUDA and Python
Post by Reuti
Post by Tim Jim
being involved.
Post by Tim Jim
In summary, I have attempted to install
OpenMPI on
Ubuntu 16.04 to the
Post by Reuti
Post by Tim Jim
following prefix: /opt/openmpi-openmpi-2.1.0. I
        have also
manually added
Post by Reuti
Post by Tim Jim
Post by Tim Jim
export
PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
Post by Reuti
Post by Tim Jim
Post by Tim Jim
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export
LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
Post by Reuti
Post by Tim Jim
This looks fine, although I don't recall setting
        MPI_DIR
for Open MPI
Post by Reuti
Post by Tim Jim
itself. It might be a necessity for mpi4py
though.
Post by Reuti
Post by Tim Jim
One pitfall might be that "lib" is sometimes
being
created as "lib64" by
Post by Reuti
Post by Tim Jim
`libtool`. I forgot the details when this is
        happening,
but it depends on
Post by Reuti
Post by Tim Jim
the version of `libtool` being used.
Post by Tim Jim
I later became aware that Ubuntu may handle the
LD_LIBRARY_PATH
Post by Reuti
Post by Tim Jim
differently
I don't think that Ubuntu will do anything
        different than
any other Linux.
Post by Reuti
Post by Tim Jim
Did you compile Open MPI on your own, or did you
        install
any repository?
Post by Reuti
Post by Tim Jim
Are the CUDA application written by yourself
or any
freely available
Post by Reuti
Post by Tim Jim
applications?
- -- Reuti
Post by Tim Jim
and instead added a new file containing the
        library path
Post by Reuti
Post by Tim Jim
/opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf,
Post by Reuti
Post by Tim Jim
in the style of everything else in that
directory.
Post by Reuti
Post by Tim Jim
Post by Tim Jim
I tried to run "mpicc helloworld.c -o
hello.bin"
        as a
test on a demo
Post by Reuti
Post by Tim Jim
file (as instructed in the link) to check the
installation but I had
Post by Reuti
Post by Tim Jim
permission issues, since it was installed
win opt.
However, when I
Post by Reuti
Post by Tim Jim
attempted to run the previous with sudo, or sudo
        -E, in
both cases, mpicc
Post by Reuti
Post by Tim Jim
could not be found. (Perhaps this is a
separate issue
with my sudo env)
Post by Reuti
Post by Tim Jim
Post by Tim Jim
To check that mpicc actually works, I have
copied
helloworld.c to a
Post by Reuti
Post by Tim Jim
directory where I could execute mpicc without
        sudo. On
running the above
no
Post by Reuti
Post by Tim Jim
version information available (required by
/opt/openmpi/openmpi-2.1.0/
Post by Reuti
Post by Tim Jim
lib/libopen-pal.so.20)
undefined reference
undefined reference
undefined reference
undefined reference
Post by Reuti
Post by Tim Jim
Post by Tim Jim
collect2: error: ld returned 1 exit status
I am unsure if I have an installation or
permission
issues, and I'd be
Post by Reuti
Post by Tim Jim
grateful if anyone can shed some light based
on the
trials I've done so
Post by Reuti
Post by Tim Jim
far. (I should add I also have a CUDA
installation, which
I'd like to
Post by Reuti
Post by Tim Jim
leverage too, if possible). I'm still fairly new
        to the
ins and outs of
Post by Reuti
Post by Tim Jim
this, so I may have missed something obvious.
        Please let
                me know if any
Post by Reuti
Post by Tim Jim
other info is required.
Post by Tim Jim
Many thanks and kind regards,
Tim
--
Timothy Jim
PhD Researcher in Aerospace
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
               
<http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>>
                > >>>
_______________________________________________
                > >>> users mailing list
                > >>>
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
                > >>
                > >> -----BEGIN PGP SIGNATURE-----
                > >> Comment: GPGTools -
https://gpgtools.org
                > >>
                > >>
iEYEARECAAYFAlkiDKIACgkQo/GbGkBRnRou3wCeNztodNKHRxXBAp5ylz041OMP
                > >> RIwAoLWkjzK1Qr8eWle/PdZGVUsvdN1M
                > >> =R6up
                > >> -----END PGP SIGNATURE-----
                > >>
_______________________________________________
                > >> users mailing list
                > >>
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
                > >>
                > >
                > >
                > >
                > > --
                > >
                > >
                > > *Timothy Jim**PhD Researcher
in Aerospace*
                > >
                > > Creative Flow Research Division,
                > > Institute of Fluid Science,
Tohoku University
                > >
                > > www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
  <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>>
                > >
_______________________________________________
                > > users mailing list
                > >
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
                >
                >
_______________________________________________
                > users mailing list
                >
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
                >
                >
                >
                > --
                >
                > Timothy Jim
                > PhD Researcher in Aerospace
                > Creative Flow Research Division,
                > Institute of Fluid Science,
Tohoku University
                > www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
        <http://www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>>>
                >
_______________________________________________
                > users mailing list
                >
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>
       
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users
<https://rfd.newmexicoconsortium.org/mailman/listinfo/users>>>
_______________________________________________
        users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
       
<https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>>
_______________________________________________
    users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
   
<https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
--
*Timothy Jim
*/PhD Researcher in Aerospace/
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/
<http://www.linkedin.com/in/timjim/>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
------------------------------------------------------------------------
This email message is for the sole use of the intended
recipient(s) and may contain confidential information. 
Any unauthorized review, use, disclosure or distribution
is prohibited.  If you are not the intended recipient,
please contact the sender by reply email and destroy all
copies of the original message.
------------------------------------------------------------------------
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
<https://lists.open-mpi.org/mailman/listinfo/users>
--
*Timothy Jim
*/PhD Researcher in Aerospace/
Creative Flow Research Division,
Institute of Fluid Science, Tohoku University
www.linkedin.com/in/timjim/ <http://www.linkedin.com/in/timjim/>
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Gilles Gouaillardet
2017-05-24 00:13:26 UTC
Permalink
Tim,
Post by Tim Jim
In summary, I have attempted to install OpenMPI on Ubuntu 16.04 to the
following prefix: /opt/openmpi-openmpi-2.1.0. I have also manually
export PATH="/opt/openmpi/openmpi-2.1.0/bin:$PATH"
MPI_DIR=/opt/openmpi/openmpi-2.1.0
export LD_LIBRARY_PATH=$MPI_DIR/lib:$LD_LIBRARY_PATH
I later became aware that Ubuntu may handle the LD_LIBRARY_PATH
differently and instead added a new file containing the library
path /opt/openmpi/openmpi-2.1.0/lib to
/etc/ld.so.conf.d/openmpi-2-1-0.conf, in the style of everything else
in that directory.
about that specific issue, from a linux point of view, you have two options
- have LD_LIBRARY_PATH set in your environment (manually on a per shell
basis, via .bashrc on a per user basis, via /etc/profile.d/ompi.sh on a
node basis)
- system wide via /etc/ld.so.conf.d/openmpi-2-1-0.conf (note you must
run 'ldconfig' after this file is created/updated)

Open MPI gives you an other option (that i always use and usually
recommends) :
configure with --enable-mpirun-prefix-by-default
as long as you do not plan to relocate the openmpi install directory,
you can use this option and you will not need to worry about LD_LIBRARY_PATH
any more (and if you have several install of openmpi, they will live
together in harmony)

fwiw, on HPC clusters, sysadmin usually install 'modules' or 'lmod',
which is a user friendly way to set your environment with what you need.


Cheers,

Gilles
Loading...