Discussion:
[OMPI users] Building OpenMPI with Lustre support using PGI fails
Raymond Muno
2018-11-14 01:59:04 UTC
Permalink
I am trying  to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).

It builds successfully with Intel compilers, but fails to find the
necessary  Lustre components with the PGI compiler.

I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can build
OpenMPI, but configure does not find the proper Lustre files.

Lustre is installed from current client RPMS, version 2.10.5

Include files are in /usr/include/lustre

When specifying --with-lustre, I get:

--- MCA component fs:lustre (m4 configuration macro)
checking for MCA component fs:lustre compile mode... dso
checking --with-lustre value... simple ok (unspecified value)
looking for header without includes
checking lustre/lustreapi.h usability... yes
checking lustre/lustreapi.h presence... yes
checking for lustre/lustreapi.h... yes
checking for library containing llapi_file_create... -llustreapi
checking if liblustreapi requires libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
Ray Muno
IT Manager


University of Minnesota
Aerospace Engineering and Mechanics Mechanical Engineering
110 Union St. S.E. 111 Church Street SE
Minneapolis, MN 55455 Minneapolis, MN 55455
g***@rist.or.jp
2018-11-14 03:57:17 UTC
Permalink
Raymond,

can you please compress and post your config.log ?


Cheers,

Gilles

----- Original Message -----
Post by Raymond Muno
I am trying  to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary  Lustre components with the PGI compiler.
I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
--- MCA component fs:lustre (m4 configuration macro)
checking for MCA component fs:lustre compile mode... dso
checking --with-lustre value... simple ok (unspecified value)
looking for header without includes
checking lustre/lustreapi.h usability... yes
checking lustre/lustreapi.h presence... yes
checking for lustre/lustreapi.h... yes
checking for library containing llapi_file_create... -llustreapi
checking if liblustreapi requires libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
Ray Muno
IT Manager
University of Minnesota
Aerospace Engineering and Mechanics Mechanical Engineering
110 Union St. S.E. 111 Church Street SE
Minneapolis, MN 55455 Minneapolis, MN 55455
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Latham, Robert J. via users
2018-11-27 20:02:44 UTC
Permalink
Post by g***@rist.or.jp
Raymond,
can you please compress and post your config.log ?
I didn't see the config.log in response to this. Maybe Ray and Giles
took the discusison off list? As someone who might have introduced the
offending configure-time checks, I'm particularly interested in fixing
lustre detection.

==rob
Post by g***@rist.or.jp
Cheers,
Gilles
----- Original Message -----
I am trying to build OpenMPI with Lustre support using PGI 18.7
on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary Lustre components with the PGI compiler.
I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can
build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
--- MCA component fs:lustre (m4 configuration macro)
checking for MCA component fs:lustre compile mode... dso
checking --with-lustre value... simple ok (unspecified value)
looking for header without includes
checking lustre/lustreapi.h usability... yes
checking lustre/lustreapi.h presence... yes
checking for lustre/lustreapi.h... yes
checking for library containing llapi_file_create... -llustreapi
checking if liblustreapi requires libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
Ray Muno
IT Manager
University of Minnesota
Aerospace Engineering and Mechanics Mechanical
Engineering
110 Union St. S.E. 111 Church Street SE
Minneapolis, MN 55455 Minneapolis, MN 55455
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Gabriel, Edgar
2018-11-27 21:04:58 UTC
Permalink
Gilles submitted a patch for that, and I approved it a couple of days back, I *think* it has not been merged however. This was a bug in the Open MPI Lustre configure logic, should be fixed after this one however.

https://github.com/open-mpi/ompi/pull/6080

Thanks
Edgar
-----Original Message-----
Robert J. via users
Sent: Tuesday, November 27, 2018 2:03 PM
Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Post by g***@rist.or.jp
Raymond,
can you please compress and post your config.log ?
I didn't see the config.log in response to this. Maybe Ray and Giles took the
discusison off list? As someone who might have introduced the offending
configure-time checks, I'm particularly interested in fixing lustre detection.
==rob
Post by g***@rist.or.jp
Cheers,
Gilles
----- Original Message -----
I am trying to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary Lustre components with the PGI compiler.
I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can
build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
--- MCA component fs:lustre (m4 configuration macro) checking for
MCA component fs:lustre compile mode... dso checking --with-lustre
value... simple ok (unspecified value) looking for header without
includes checking lustre/lustreapi.h usability... yes checking
lustre/lustreapi.h presence... yes checking for
lustre/lustreapi.h... yes checking for library containing
llapi_file_create... -llustreapi checking if liblustreapi requires
libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
Ray Muno
IT Manager
University of Minnesota
Aerospace Engineering and Mechanics Mechanical
Engineering
110 Union St. S.E. 111 Church Street SE
Minneapolis, MN 55455 Minneapolis, MN 55455
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Gilles Gouaillardet
2018-11-28 01:55:16 UTC
Permalink
Folks,


sorry for the late follow-up. The config.log was indeed sent offline.


Here is the relevant part :


configure:294375: checking for required lustre data structures
configure:294394: pgcc -O -DNDEBUG   -Iyes/include -c conftest.c
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 157)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 157)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 158)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 158)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 159)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 159)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 160)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 160)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 161)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 161)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 162)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 162)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 163)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 163)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 164)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 164)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 211)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 211)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 212)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 212)
PGC/x86-64 Linux 18.7-0: compilation completed with severe errors
configure:294401: $? = 2
configure:294415: result: no
configure:294424: error: Lustre support requested but not found. Aborting


Here is the conftest.c that triggers the error

#include "lustre/lustreapi.h"
void alloc_lum()
{
  int v1, v3;
  v1 = sizeof(struct lov_user_md_v1) +
   LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
  v3 = sizeof(struct lov_user_md_v3) +
    LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
}


The same code was reported to work with gcc compiler, so at that stage,
this looks like

a PGI or an environment issue (sometimes the sysadmin has to re-run
makelocalrc if some dependencies have changed),

so I recommend this error is submitted to PGI support.


I reviewed the code and filled a PR that get rids of the "-Iyes/include"
flag.

Merged or not, that does not fix the real issue here.


Cheers,


Gilles
Post by Gabriel, Edgar
Gilles submitted a patch for that, and I approved it a couple of days back, I *think* it has not been merged however. This was a bug in the Open MPI Lustre configure logic, should be fixed after this one however.
https://github.com/open-mpi/ompi/pull/6080
Thanks
Edgar
-----Original Message-----
Robert J. via users
Sent: Tuesday, November 27, 2018 2:03 PM
Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Post by g***@rist.or.jp
Raymond,
can you please compress and post your config.log ?
I didn't see the config.log in response to this. Maybe Ray and Giles took the
discusison off list? As someone who might have introduced the offending
configure-time checks, I'm particularly interested in fixing lustre detection.
==rob
Post by g***@rist.or.jp
Cheers,
Gilles
----- Original Message -----
I am trying to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary Lustre components with the PGI compiler.
I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can
build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
--- MCA component fs:lustre (m4 configuration macro) checking for
MCA component fs:lustre compile mode... dso checking --with-lustre
value... simple ok (unspecified value) looking for header without
includes checking lustre/lustreapi.h usability... yes checking
lustre/lustreapi.h presence... yes checking for
lustre/lustreapi.h... yes checking for library containing
llapi_file_create... -llustreapi checking if liblustreapi requires
libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
Ray Muno
IT Manager
University of Minnesota
Aerospace Engineering and Mechanics Mechanical
Engineering
110 Union St. S.E. 111 Church Street SE
Minneapolis, MN 55455 Minneapolis, MN 55455
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
Raymond Muno
2018-11-28 03:41:11 UTC
Permalink
I apologize. I did not realize that I did not reply to the list.

Going with the view this is a PGI problem,  I noticed they recently
released version 18.10. I had just installed 18.7 within the last couple
weeks.

The problem is resolved in 18.10.

-Ray Muno
Post by Gilles Gouaillardet
Folks,
sorry for the late follow-up. The config.log was indeed sent offline.
configure:294375: checking for required lustre data structures
configure:294394: pgcc -O -DNDEBUG   -Iyes/include -c conftest.c
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 157)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 157)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 158)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 158)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 159)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 159)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 160)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 160)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 161)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 161)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 162)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 162)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 163)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 163)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 164)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 164)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 211)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 211)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 212)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 212)
PGC/x86-64 Linux 18.7-0: compilation completed with severe errors
configure:294401: $? = 2
configure:294415: result: no
configure:294424: error: Lustre support requested but not found. Aborting
Here is the conftest.c that triggers the error
#include "lustre/lustreapi.h"
void alloc_lum()
{
  int v1, v3;
  v1 = sizeof(struct lov_user_md_v1) +
   LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
  v3 = sizeof(struct lov_user_md_v3) +
    LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
}
The same code was reported to work with gcc compiler, so at that
stage, this looks like
a PGI or an environment issue (sometimes the sysadmin has to re-run
makelocalrc if some dependencies have changed),
so I recommend this error is submitted to PGI support.
I reviewed the code and filled a PR that get rids of the
"-Iyes/include" flag.
Merged or not, that does not fix the real issue here.
Cheers,
Gilles
Post by Gabriel, Edgar
Gilles submitted a patch for that, and I approved it a couple of days
back, I *think* it has not been merged however. This was a bug in the
Open MPI Lustre configure logic, should be fixed after this one however.
https://github.com/open-mpi/ompi/pull/6080
Thanks
Edgar
-----Original Message-----
Robert J. via users
Sent: Tuesday, November 27, 2018 2:03 PM
Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Post by g***@rist.or.jp
Raymond,
can you please compress and post your config.log ?
I didn't see the config.log in response to this.  Maybe Ray and
Giles took the
discusison off list?  As someone who might have introduced the
offending
configure-time checks, I'm particularly interested in fixing lustre detection.
==rob
Post by g***@rist.or.jp
Cheers,
Gilles
----- Original Message -----
Post by Raymond Muno
I am trying  to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary  Lustre components with the PGI compiler.
I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
--- MCA component fs:lustre (m4 configuration macro) checking for
MCA component fs:lustre compile mode... dso checking --with-lustre
value... simple ok (unspecified value) looking for header without
includes checking lustre/lustreapi.h usability... yes checking
lustre/lustreapi.h presence... yes checking for
lustre/lustreapi.h... yes checking for library containing
llapi_file_create... -llustreapi checking if liblustreapi requires
libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
   Ray Muno
   IT Manager
                            University of Minnesota
   Aerospace Engineering and Mechanics         Mechanical
Engineering
   110 Union St. S.E.                          111 Church Street SE
   Minneapolis, MN 55455 Minneapolis, MN 55455
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________
users mailing list
https://lists.open-mpi.org/mailman/listinfo/users
--
Ray Muno
IT Manager
e-mail: ***@aem.umn.edu
Phone: (612) 625-9531

University of Minnesota
Aerospace Engineering and Mechanics Mechanical Engineering
110 Union St. S.E. 111 Church Street SE
Minneapolis, MN 55455 Minneapolis, MN 55455
Loading...