Job spawning using mpirun with ibv-conduit fails

[Aditya Bandla]

UPC launches jobs properly when using the mpi-conduit, but fails when using the ibv-conduit with the following warning:

WARNING: Don't know how to control process->node layout with your mpirun

WARNING: PROCESS LAYOUT MIGHT NOT MATCH YOUR REQUEST

I am not sure why mpirun gets (possibly?) misconfigured when using ibv

[Paul Hargrove]

Aditya,

You say "fails when using the ibv-conduit" but provide only a (non-fatal) warning message.

Does it run or not?

Does it run with the requested layout?

If you could tell us what MPI implementation you are using, we might be able to help.

-Paul

--
You received this message because you are subscribed to the Google Groups "upc-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to upc-users+...@lbl.gov.
To view this discussion on the web visit https://groups.google.com/a/lbl.gov/d/msgid/upc-users/f4633d1f-0a85-4388-aefd-12ba1b6f0ed4%40lbl.gov.

--

Paul H. Hargrove <PHHar...@lbl.gov>

Computer Languages & Systems Software (CLaSS) Group

Computer Science Department

Lawrence Berkeley National Laboratory

[aditya bandla]

Hi Paul

The program runs, but spawns all processes on one node, something which has been reported earlier on this group. But unfortunately none of the solutions worked for me.

I am using openmpi 1.10.2 running on a x86_64 linux HPC, using icc version 16.0.1 (gcc version 4.9.3 compatibility)

ibv_devices gives me mlx5_0

mpirun command defaults to mpirun -np %N %C

Aditya

[Paul Hargrove]

Aditya,

I believe recent changes in GASNet should improve the execution with Open MPI 1.10.x.  You may be able to fix your problem by replacing gasnet/mpi/contrib/gasnetrun_mpi.pl in with this one:

   https://bitbucket.org/berkeleylab/gasnet/raw/gex-2019.6.0/other/spawner/gasnetrun_mpi.pl

To avoid rebuilding, it should be sufficient to replace all instances (there are more than one) of gasnetrun_mpi.pl in the install directory.

Hope this helps,

-Paul