[OMPI users] mpi4py+OpenMPI: Qs about submitting bugs and examples

[Jason Maldonis]

Hello everyone,

I am using mpi4py with OpenMPI for a simulation that uses dynamic resource
allocation via `mpi_spawn_multiple`. I've been working on this problem for
about 6 months now and I have some questions and potential bugs I'd like to
submit.

Is this mailing list a good spot to submit bugs for OpenMPI? Or do I use
github? Are previous versions (like 1.10.2) still being developed for
bugfixes, or do I need to reproduce bugs for 2.x only?

I may also submit bugs to mpi4py, but I don't yet know exactly where the
bugs are originating from. Do any of you know if github is the correct
place to submit bugs for mpi4py?

I have also learned some cool things that are not well documented on the
web, and I'd like to provide nice examples or something similar. Can I
contribute examples to either mpi4py or OpenMPI?

As a side note, OpenMPI 1.10.2 seems to be much more stable than 2.x for
the dynamic resource allocation code I am writing.

Thanks in advance,
Jason Maldonis

[r***@open-mpi.org]

Post by Jason Maldonis
Hello everyone,
I am using mpi4py with OpenMPI for a simulation that uses dynamic resource allocation via `mpi_spawn_multiple`. I've been working on this problem for about 6 months now and I have some questions and potential bugs I'd like to submit.
Is this mailing list a good spot to submit bugs for OpenMPI? Or do I use github?

You can use either - I would encourage the use of github “issues” when you have a specific bug, and the mailing list for general questions

Post by Jason Maldonis
Are previous versions (like 1.10.2) still being developed for bugfixes, or do I need to reproduce bugs for 2.x only?

The 1.10 series is still being supported - it has proven fairly stable and so the release rate has slowed down considerably in the last year. Primary development focus in on 2.x

Post by Jason Maldonis
I may also submit bugs to mpi4py, but I don't yet know exactly where the bugs are originating from. Do any of you know if github is the correct place to submit bugs for mpi4py?

I honestly don’t know, but I do believe mpi4py is on github as well

Post by Jason Maldonis
I have also learned some cool things that are not well documented on the web, and I'd like to provide nice examples or something similar. Can I contribute examples to either mpi4py or OpenMPI?

Please do!

Post by Jason Maldonis
As a side note, OpenMPI 1.10.2 seems to be much more stable than 2.x for the dynamic resource allocation code I am writing.

Yes, there has been an outstanding bug on the 2.x series for dynamic operations. We just finally found the missing code change and it is being ported at this time.

Post by Jason Maldonis
Thanks in advance,
Jason Maldonis
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users

[Dave Love]

Post by r***@open-mpi.org

Post by Jason Maldonis
Is this mailing list a good spot to submit bugs for OpenMPI? Or do I use github?

You can use either - I would encourage the use of github “issues” when
you have a specific bug, and the mailing list for general questions

I was told not to do that, and to send here instead; README was even
changed to say so. It doesn't seem a good way of getting issues
addressed.

[Lisandro Dalcin]

Post by Jason Maldonis
I may also submit bugs to mpi4py, but I don't yet know exactly where the
bugs are originating from. Do any of you know if github is the correct
place to submit bugs for mpi4py?

https://bitbucket.org/mpi4py/mpi4py/issues

You can also write to the mailing list in Google Groups
https://groups.google.com/forum/#!forum/mpi4py

If you are not sure your issue is mpi4py's fault, I think is better to ask
in the mailing list.

Post by Jason Maldonis
I have also learned some cool things that are not well documented on the
web, and I'd like to provide nice examples or something similar. Can I
contribute examples to either mpi4py or OpenMPI?

Indeed, mpi4py documentation is poor. Maybe we could start by adding your
examples in the wiki https://bitbucket.org/mpi4py/mpi4py/wiki/Home . Do you
have them online in some repo to take a look?
--
Lisandro Dalcin
============
Research Scientist
Computer, Electrical and Mathematical Sciences & Engineering (CEMSE)
Extreme Computing Research Center (ECRC)
King Abdullah University of Science and Technology (KAUST)
http://ecrc.kaust.edu.sa/

4700 King Abdullah University of Science and Technology
al-Khawarizmi Bldg (Bldg 1), Office # 0109
Thuwal 23955-6900, Kingdom of Saudi Arabia
http://www.kaust.edu.sa

Office Phone: [phone]

[Jason Maldonis]

Thanks for the responses, and it's great to know that you found the OMPIP
bug in 2.x for dynamic process management. I tried some of the other MPI
libraries for my project as well, but Open MPI seemed to be by far the best
in terms of being bug-free for my code!


Lisandro, I will subscribe and check out the mailing list, thanks for the
link.

At the moment my examples need to be cleaned up quite a bit. I will be the
examples here <https://github.com/jjmaldonis/mpi-parallelization>, and I
can let you know when they are much better (and better organized).

The files testmpi.f90 and spawn_multiple_loop.py that I wrote were very
helpful once I learned how to write them. The fortran program uses split
communicators to run multiple executables at once on different data (MPMD),
and the spawn_multiple_loop.py file uses mpi4py to call those executables
simultaneously and collect the results.

At the moment I am thinking I'll split this up into 2-3 examples that build
on each other to explain how it works. I definitely need to clean them up
first though, and I'll let you know when they are better.

Thanks,
Jason


Jason Maldonis
Research Assistant of Professor Paul Voyles
Materials Science Grad Student
University of Wisconsin, Madison
1509 University Ave, Rm 202
Madison, WI 53706

Post by Lisandro Dalcin

Post by Jason Maldonis
I may also submit bugs to mpi4py, but I don't yet know exactly where the
bugs are originating from. Do any of you know if github is the correct
place to submit bugs for mpi4py?

https://bitbucket.org/mpi4py/mpi4py/issues
You can also write to the mailing list in Google Groups
https://groups.google.com/forum/#!forum/mpi4py
If you are not sure your issue is mpi4py's fault, I think is better to ask
in the mailing list.

Post by Jason Maldonis
I have also learned some cool things that are not well documented on the
web, and I'd like to provide nice examples or something similar. Can I
contribute examples to either mpi4py or OpenMPI?

Indeed, mpi4py documentation is poor. Maybe we could start by adding your
examples in the wiki https://bitbucket.org/mpi4py/mpi4py/wiki/Home . Do
you have them online in some repo to take a look?
--
Lisandro Dalcin
============
Research Scientist
Computer, Electrical and Mathematical Sciences & Engineering (CEMSE)
Extreme Computing Research Center (ECRC)
King Abdullah University of Science and Technology (KAUST)
http://ecrc.kaust.edu.sa/
4700 King Abdullah University of Science and Technology
al-Khawarizmi Bldg (Bldg 1), Office # 0109
Thuwal 23955-6900, Kingdom of Saudi Arabia
http://www.kaust.edu.sa
Office Phone: [phone]
_______________________________________________
users mailing list
https://rfd.newmexicoconsortium.org/mailman/listinfo/users