[slurm-users] Slurm and pmix trouble

[Andrej Prsa]

Hello list,

I have openmpi 4.1.0 built with internal pmix and installed. I then
built slurm 20.11.3 with --with-pmix=/usr/local and configure found it
(i.e. no complaints on stderr) and built the plugin:

./configure --prefix=/usr/local --sysconfdir=/etc --with-hdf5=no
--with-ofed=no --without-datawarp --without-netloc --with-pmix=/usr/local

Relevant exerpt from the output:

checking for pmix installation... /usr/local
config.status: creating src/plugins/mpi/pmix/Makefile

But when running srun, I am not seeing pmix:

andrej@terra:~/system/slurm-20.11.3$ srun --mpi=list
srun: MPI types are...
srun: cray_shasta
srun: none
srun: pmi2

Any ideas what might be the issue here?

Thanks,
Andrej

[Gennaro Oliva]

Hi Andrej,

please have a look here:

https://bugs.schedmd.com/show_bug.cgi?id=10683

> Any ideas what might be the issue here?

The patch solved the issue in my build env.
Best regards,
--
Gennaro Oliva

[Andrej Prsa]

Hi Gennaro,

Thanks a bunch for a quick response! I patched it with:

patch -p1 < pmix.diff

and that worked well; configuring/building/installing went well as well,
but srun still doesn't show pmix as an option. Am I missing anything?

Cheers,
Andrej

[Andrej Prsa]

Hi again,

The global make didn't build it but when I ran make/make install in
src/plugins/mpi/pmix, it did work! Now srun shows me pmix:

andrej@terra:~/system/slurm-20.11.3/src/plugins/mpi/pmix$ srun --mpi=list

srun: MPI types are...
srun: cray_shasta
srun: none
srun: pmi2

srun: pmix
srun: pmix_v4

Thanks a bunch!

Cheers,
Andrej

[Gennaro Oliva]

Hi Andrej,

On Mon, Feb 01, 2021 at 04:04:54PM -0500, Andrej Prsa wrote:
> Thanks a bunch for a quick response! I patched it with:
>
> patch -p1 < pmix.diff
>
> and that worked well; configuring/building/installing went well as well, but
> srun still doesn't show pmix as an option. Am I missing anything?

I don't know: in my case, after the patch, the pmix v4 lib was detected,
and I was able to use it with a simple test, but it looks like more code
is needed for full support:

https://bugs.schedmd.com/show_bug.cgi?id=7263

Best
--
Gennaro Oliva