Run errors of NWchem 7.2 on ubuntu

172 views
Skip to first unread message

Jibiao Li

unread,
Jun 13, 2023, 10:23:21 AM6/13/23
to nwchem...@googlegroups.com
Hi, All

My test calculation with h2o-scf.nwc under the example directory goes smoothly, but as I tried to run another input file by parallel running, errors below appeared, 

Help is highly required!

--------------------------------------------------------------------------
No OpenFabrics connection schemes reported that they were able to be
used on a specific port.  As such, the openib BTL (OpenFabrics
support) will be disabled for this port.

  Local host:           ubuntue
  Local device:         irdma3
  Local port:           1
  CPCs attempted:       udcm
--------------------------------------------------------------------------
 argument  1 = top.nwc
libi40iw-i40iw_ureg_mr: Failed to register memory
free(): double free detected in tcache 2
malloc_consolidate(): invalid chunk size
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FAF4F7153C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FAF4F711877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FAF46C809BC  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FAF4C1CE0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FAF4E73E854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FAF4F57D905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FAF4F5E05B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FAF4F595730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007FAF4E8030B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F2606A2A3C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F25FDFDF99B  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F25FF4E30DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F2605A53854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F2606892905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F26068F55B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F26068AA730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007F2605B180B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FC45B4043C0  Unknown               Unknown  Unknown
mca_coll_libnbc.s  00007FC453E4D9F0  ompi_coll_libnbc_     Unknown  Unknown
libopen-pal.so.40  00007FC45A42D854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007FC458053F15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007FC45B2A33E5  MPI_Recv              Unknown  Unknown
nwchem             0000000005E63EB1  Unknown               Unknown  Unknown
nwchem             0000000005E70952  Unknown               Unknown  Unknown
nwchem             0000000005E6FBAD  Unknown               Unknown  Unknown
nwchem             0000000005E34A32  Unknown               Unknown  Unknown
nwchem             0000000005E0BF0D  Unknown               Unknown  Unknown
nwchem             0000000005E0B803  Unknown               Unknown  Unknown
nwchem             0000000005E0A78D  Unknown               Unknown  Unknown
nwchem             0000000000418A5F  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007FC45A4F20B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F27B38993C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F27B3895877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007F27AAE22A41  Unknown               Unknown  Unknown
librxm-fi.so       00007F27AAE3ACDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F27AAE3BAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F27B03740DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F27B28C2854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F27B3701905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F27B37645B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F27B3719730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007F27B29870B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F78879143C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFEBF35AA69  clock_gettime         Unknown  Unknown
libc-2.31.so       00007F7886ABB0E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007F787EEB4DC1  Unknown               Unknown  Unknown
librxm-fi.so       00007F787EEB4E19  Unknown               Unknown  Unknown
librxm-fi.so       00007F787EEAE8EA  Unknown               Unknown  Unknown
librxm-fi.so       00007F787EEAEA49  Unknown               Unknown  Unknown
librxm-fi.so       00007F787EEC6CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F787EEC7AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F78843CD0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F788693D854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F788777C905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F78877DF5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F7887794730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007F7886A020B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FDEA30C93C0  Unknown               Unknown  Unknown
libverbs-fi.so     00007FDE9B3DBFC5  Unknown               Unknown  Unknown
librxm-fi.so       00007FDE9A6628A4  Unknown               Unknown  Unknown
librxm-fi.so       00007FDE9A662A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FDE9A67ACDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FDE9A67BAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FDEA00A60DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FDEA20F2854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007FDEA00B7F15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007FDEA2F8C366  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FDEA2F47411  PMPI_Allreduce        Unknown  Unknown
nwchem             0000000005E36DA3  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D4E  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007FDEA21B70B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F21416143C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F2141610877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007F213CBC99BC  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F213E0CD0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F214063D854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F214147C905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F21414DF5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F2141494730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007F21407020B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FE98A95B3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FE98A957877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FE981F10CBE  Unknown               Unknown  Unknown
librxm-fi.so       00007FE981F11AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FE9880080DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FE989984854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FE98A7C3905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FE98A8265B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FE98A7DB730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007FE989A490B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F6CC8C6A3C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFF301BAA16  clock_gettime         Unknown  Unknown
libc-2.31.so       00007F6CC7E110E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007F6CC420CDC1  Unknown               Unknown  Unknown
librxm-fi.so       00007F6CC420CE19  Unknown               Unknown  Unknown
librxm-fi.so       00007F6CC42068EA  Unknown               Unknown  Unknown
librxm-fi.so       00007F6CC4206A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F6CC421ECDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F6CC421FAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F6CC57230DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F6CC7C93854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F6CC8AD2905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F6CC8B355B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F6CC8AEA730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007F6CC7D580B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FB2FBADF3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FB2FBADB8B0  pthread_spin_unlo     Unknown  Unknown
libi40iw-rdmav25.  00007FB2F8773DBC  Unknown               Unknown  Unknown
libverbs-fi.so     00007FB2F3DB4D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007FB2F3DB4FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007FB2F306B8A4  Unknown               Unknown  Unknown
librxm-fi.so       00007FB2F306BA49  Unknown               Unknown  Unknown
librxm-fi.so       00007FB2F3083CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FB2F3084AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FB2F85980DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FB2FAB08854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FB2FB947905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FB2FB9AA5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FB2FB95F730  MPI_Barrier           Unknown  Unknown
nwchem             0000000005E492D2  Unknown               Unknown  Unknown
nwchem             0000000005E36D89  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D7C  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007FB2FABCD0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000086B626B  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FE080E213C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FE080E202CF  write                 Unknown  Unknown
librdmacm.so.1.2.  00007FE07D0E474E  Unknown               Unknown  Unknown
libverbs-fi.so     00007FE07D12F19E  Unknown               Unknown  Unknown
librxm-fi.so       00007FE07C3B31F4  Unknown               Unknown  Unknown
librxm-fi.so       00007FE07C3B378B  Unknown               Unknown  Unknown
librxm-fi.so       00007FE07C3B3995  Unknown               Unknown  Unknown
librxm-fi.so       00007FE07C3B91B8  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FE07D8D5AF8  Unknown               Unknown  Unknown
mca_pml_cm.so      00007FE07D8ED584  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007FE080CE3824  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007FE080CE4042  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FE080C9F411  PMPI_Allreduce        Unknown  Unknown
nwchem             0000000005E36DA3  Unknown               Unknown  Unknown
nwchem             0000000005E371A1  Unknown               Unknown  Unknown
nwchem             0000000005E29D4E  Unknown               Unknown  Unknown
nwchem             0000000000418BC7  Unknown               Unknown  Unknown
nwchem             00000000004189E2  Unknown               Unknown  Unknown
libc-2.31.so       00007FE07FF0F0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188EE  Unknown               Unknown  Unknown
--------------------------------------------------------------------------
mpirun noticed that process rank 3 with PID 0 on node ubuntue exited on signal 6 (Aborted).
--------------------------------------------------------------------------
[ubuntue:980676] 11 more processes have sent help message help-mpi-btl-openib-cpc-base.txt / no cpcs for port
[ubuntue:980676] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages


start cluster_top

title "cluster_top, Def2-TZVP basis, optimized geometry"

geometry units angstroms
O             1.2612663660        2.1845774270       11.3694929670
C             1.2612663660        2.1845774270       10.2171954095
Cu           -0.0121442003       -0.0181624245        8.2581987614
Cu            2.5346769303       -0.0181624245        8.2581987614
Cu            5.0450654620        0.0000000000        8.2787244011
Cu            1.2612663660        2.1845774270        8.3671243521
Cu            3.8056003181        2.1831414533        8.2581987614
Cu            2.5321897518        4.3887532522        8.2581987614
Cu            2.5097112051        2.9053673915        6.2120527736
Cu            3.7812762676        0.7296490323        6.1914257666
Cu            1.2612663660        0.7429974989        6.2120527736
Cu            2.5225327310        1.4563849510        4.1192787010
end

basis
O  library Def2-TZVP
H  library Def2-TZVP
Cu library Def2-TZVP
end

scf
   thresh 1.0e-8
end

task scf

Edoardo Aprà

unread,
Jun 13, 2023, 1:47:29 PM6/13/23
to NWChem Forum
mkdir -p ~/.openmpi/

echo "btl=^openib,ofi" > ~/.openmpi/mca-params.conf

Jibiao Li

unread,
Jun 14, 2023, 3:08:49 AM6/14/23
to nwchem...@googlegroups.com
Dear Prof. Edoardo Aprà,

I followed your suggestion and try to run mpirun -np 16 nwchem top.nwc>& top.out&, but the errors remain. I need your help. 

jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ more top.out
 argument  1 = top.nwc
libi40iw-i40iw_ureg_mr: Failed to register memory
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source             
nwchem             00000000048D287A  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1A41FE33C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F1A3B24F60D  Unknown               Unknown  Unknown
mca_pml_cm.so      00007F1A4002B584  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007F1A420F6824  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F1A420F7042  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F1A420B2411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1A417140B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F7E61E433C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F7E59A48AA2  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F7E600BE0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F7E614AF854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F7E61EFC905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F7E61F5F5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F7E61F14730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F7E615740B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F0A3AAF23C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F0A32710E10  Unknown               Unknown  Unknown
librxm-fi.so       00007F0A32711AA2  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F0A3818B0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F0A3A15E854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F0A3ABAB905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F0A3AC0E5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F0A3ABC3730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F0A3A2230B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F4E967A73C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F4E8E3A3CA0  Unknown               Unknown  Unknown
librxm-fi.so       00007F4E8E3A4AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F4E8FA2B0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F4E95E13854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007F4E8FA3CF15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007F4E968BB366  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F4E96876411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F4E95ED80B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FC1AC9AC3C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFF469ECA64  clock_gettime         Unknown  Unknown
libc-2.31.so       00007FC1AC1960E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007FC1A8596DC1  Unknown               Unknown  Unknown
librxm-fi.so       00007FC1A8596E19  Unknown               Unknown  Unknown
librxm-fi.so       00007FC1A85908EA  Unknown               Unknown  Unknown
librxm-fi.so       00007FC1A8590A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FC1A85A8CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FC1A85A9AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FC1A9C220DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FC1AC018854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FC1ACA65905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FC1ACABF83C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007FC1ACAC0042  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FC1ACA7B411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FC1AC0DD0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F19628773C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F195A476AB3  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F19600130DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F1961EE3854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F1962930905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F19629935B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F1962948730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1961FA80B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8CA8CAC3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F8CA8CA8877  pthread_spin_lock     Unknown  Unknown
libi40iw-rdmav25.  00007F8CA560FCE7  Unknown               Unknown  Unknown
libverbs-fi.so     00007F8CA577ED80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F8CA577EFC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F8CA48908A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F8CA4890A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F8CA48A8CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F8CA48A9AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F8CA5F220DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F8CA8318854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F8CA8D65905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F8CA8DC85B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F8CA8D7D730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F8CA83DD0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FF99B3543C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FF99B350877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FF992F34A41  Unknown               Unknown  Unknown
librxm-fi.so       00007FF992F4CCDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FF992F4DAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FF9985CA0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FF99A9C0854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007FF998617F15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007FF99B468366  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FF99B423411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FF99AA850B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FB98B0163C0  Unknown               Unknown  Unknown
librxm-fi.so       00007FB982C15CF3  Unknown               Unknown  Unknown
librxm-fi.so       00007FB982C16AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FB98828C0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FB98A682854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FB98B0CF905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FB98B1325B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FB98B0E7730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FB98A7470B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FEBEE2EC3C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FEBEC185186  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FEBED958854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FEBEE3A5905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FEBEE4085B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FEBEE3BD730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FEBEDA1D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F71AE1D33C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F71AE1D22CF  write                 Unknown  Unknown
librdmacm.so.1.2.  00007F71A6C5874E  Unknown               Unknown  Unknown
libverbs-fi.so     00007F71A6CA319E  Unknown               Unknown  Unknown
librxm-fi.so       00007F71A5DA51F4  Unknown               Unknown  Unknown
librxm-fi.so       00007F71A5DA578B  Unknown               Unknown  Unknown
librxm-fi.so       00007F71A5DA5995  Unknown               Unknown  Unknown
librxm-fi.so       00007F71A5DAB1B8  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F71AC045AF8  Unknown               Unknown  Unknown
mca_pml_cm.so      00007F71AC099584  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007F71AE2E6824  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F71AE2E7042  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F71AE2A2411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F71AD9040B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F46B98783C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F46B8015121  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F46B8EE4854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007F46B803EF15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007F46B99683E5  MPI_Recv              Unknown  Unknown
nwchem             000000000484D2C1  Unknown               Unknown  Unknown
nwchem             0000000004859E62  Unknown               Unknown  Unknown
nwchem             00000000048590BD  Unknown               Unknown  Unknown
nwchem             000000000481DE42  Unknown               Unknown  Unknown
nwchem             00000000047F531D  Unknown               Unknown  Unknown
nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F46B8FA90B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F2224EEF3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F2224EEB877  pthread_spin_lock     Unknown  Unknown
libi40iw-rdmav25.  00007F2221852CE7  Unknown               Unknown  Unknown
libverbs-fi.so     00007F22219C1D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F22219C1FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F2220AD38A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F2220AD3A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F2220AEBCDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F2220AECAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F22221650DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F222455B854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F2224FA8905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F222500B5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F2224FC0730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F22246200B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F084DACB3C0  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F0846435CCC  Unknown               Unknown  Unknown
libverbs-fi.so     00007F0846525D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F0846525FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F08456B68A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F08456B6A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F08456CECDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F08456CFAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F084C1460DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F084D137854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F084DB84905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F084DBE75B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F084DB9C730  MPI_Barrier           Unknown  Unknown
nwchem             00000000048326E2  Unknown               Unknown  Unknown
nwchem             0000000004820199  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481318C  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F084D1FC0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FB63F5DA3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FB63F5D6877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FB6371BDA41  Unknown               Unknown  Unknown
librxm-fi.so       00007FB6371D5CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FB6371D6AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FB63C8500DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FB63EC46854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007FB63C89DF15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007FB63F6EE366  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FB63F6A9411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FB63ED0B0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FDE0F14B3C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FDE0C3C10A8  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FDE0E7B7854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FDE0F204905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FDE0F25E83C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007FDE0F25F042  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FDE0F21A411  PMPI_Allreduce        Unknown  Unknown
nwchem             00000000048201B3  Unknown               Unknown  Unknown
nwchem             00000000048205B1  Unknown               Unknown  Unknown
nwchem             000000000481315E  Unknown               Unknown  Unknown
nwchem             0000000000418B87  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FDE0E87C0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004188AE  Unknown               Unknown  Unknown
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:

  Process name: [[13441,1],11]
  Exit code:    174
--------------------------------------------------------------------------

Regards

Jibiao Li

--
You received this message because you are subscribed to the Google Groups "NWChem Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nwchem-forum...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nwchem-forum/28e807f2-722d-4ce4-90be-0a513e99b490n%40googlegroups.com.

Edoardo Aprà

unread,
Jun 14, 2023, 1:24:58 PM6/14/23
to NWChem Forum
What is the output of the commands

ldd /usr/bin/nwchem

env | grep LD_LIBRARY_PATH

/usr/bin/mpirun.openmpi -mca pml_base_verbose 100 -mca btl ^openib,ofi  -mca btl_base_verbose 100 -np 16 /usr/bin/nwchem top.nwc

Jibiao Li

unread,
Jun 14, 2023, 8:46:16 PM6/14/23
to nwchem...@googlegroups.com
Hi， Edoardo,

As you can see below, there is no output of the command. 
jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ mpirun -np 16 nwchem top.nwc>& top.out&
[1] 1777814

As I try to run ldd /usr/bin/nwchem, it shows "ldd: /usr/bin/nwchem: No such file or directory" because my nwchem was not installed there

so I try to run  ldd /home/jibiaoli/codes/nwchem-7-2-0/bin/nwchem, it shows the following message:
jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ ldd /home/jibiaoli/codes/nwchem-7-2-0/bin/nwchem
linux-vdso.so.1 (0x00007ffe86c5d000)
libmkl_intel_ilp64.so.1 => /home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_ilp64.so.1 (0x00007fc1b757d000)
libmkl_intel_thread.so.1 => /home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_thread.so.1 (0x00007fc1b3c63000)
libmkl_core.so.1 => /home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so.1 (0x00007fc1af5f2000)
libiomp5.so => /home/jibiaoli/intel/oneapi/compiler/latest/linux/compiler/lib/intel64_lin/libiomp5.so (0x00007fc1af1dd000)
libmpi_usempif08.so.40 => /lib/x86_64-linux-gnu/libmpi_usempif08.so.40 (0x00007fc1af17f000)
libmpi_usempi_ignore_tkr.so.40 => /lib/x86_64-linux-gnu/libmpi_usempi_ignore_tkr.so.40 (0x00007fc1af173000)
libmpi_mpifh.so.40 => /lib/x86_64-linux-gnu/libmpi_mpifh.so.40 (0x00007fc1af10e000)
libmpi.so.40 => /lib/x86_64-linux-gnu/libmpi.so.40 (0x00007fc1aefe9000)
libhwloc.so.15 => /lib/x86_64-linux-gnu/libhwloc.so.15 (0x00007fc1aef96000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007fc1aef8c000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007fc1aef69000)
libpython3.8.so.1.0 => /lib/x86_64-linux-gnu/libpython3.8.so.1.0 (0x00007fc1aea13000)
libcrypt.so.1 => /lib/x86_64-linux-gnu/libcrypt.so.1 (0x00007fc1ae9d8000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007fc1ae9d2000)
libutil.so.1 => /lib/x86_64-linux-gnu/libutil.so.1 (0x00007fc1ae9cb000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007fc1ae87c000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007fc1ae68a000)
/lib64/ld-linux-x86-64.so.2 (0x00007fc1b8279000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007fc1ae66f000)
libopen-pal.so.40 => /lib/x86_64-linux-gnu/libopen-pal.so.40 (0x00007fc1ae5c1000)
libopen-rte.so.40 => /lib/x86_64-linux-gnu/libopen-rte.so.40 (0x00007fc1ae505000)
libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 (0x00007fc1ae4d8000)
libltdl.so.7 => /lib/x86_64-linux-gnu/libltdl.so.7 (0x00007fc1ae4cd000)
libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1 (0x00007fc1ae49f000)
libz.so.1 => /home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/oclfpga/host/linux64/lib/libz.so.1 (0x00007fc1ae282000)
libevent-2.1.so.7 => /lib/x86_64-linux-gnu/libevent-2.1.so.7 (0x00007fc1ae22c000)
libevent_pthreads-2.1.so.7 => /lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7 (0x00007fc1ae225000)


jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ env | grep LD_LIBRARY_PATH
LD_LIBRARY_PATH=/home/jibiaoli/codes/nwchem-7-2-0/src/tools/install/lib:/home/jibiaoli/intel/oneapi/compiler/latest/linux/compiler/lib/intel64_lin:/home/jibiaoli/codes/openmpi-4.0.0/lib/openmpi:/home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64:/home/jibiaoli/intel/oneapi/mkl/2021.3.0/lib/intel64:/home/jibiaoli/intel/oneapi/tbb/2021.3.0/env/../lib/intel64/gcc4.8:/home/jibiaoli/intel/oneapi/mpi/2021.3.0//libfabric/lib:/home/jibiaoli/intel/oneapi/mpi/2021.3.0//lib/release:/home/jibiaoli/intel/oneapi/mpi/2021.3.0//lib:/home/jibiaoli/intel/oneapi/mkl/2021.3.0/lib/intel64:/home/jibiaoli/intel/oneapi/debugger/10.1.2/gdb/intel64/lib:/home/jibiaoli/intel/oneapi/debugger/10.1.2/libipt/intel64/lib:/home/jibiaoli/intel/oneapi/debugger/10.1.2/dep/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/x64:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/emu:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/oclfpga/host/linux64/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/oclfpga/linux64/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/compiler/lib/intel64_lin

jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ which mpirun
/home/jibiaoli/codes/openmpi-4.0.0/bin/mpirun

As I try to run the command below, it shows the output of the command below 
jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ mpirun -mca pml_base_verbose 100 -mca btl ^openib,ofi  -mca btl_base_verbose 100 -np 16 /home/jibiaoli/codes/nwchem-7-2-0/bin/nwchem top.nwc
[ubuntue:1778167] mca: base: components_register: registering framework btl components
[ubuntue:1778167] mca: base: components_register: found loaded component self
[ubuntue:1778167] mca: base: components_register: component self register function successful
[ubuntue:1778167] mca: base: components_register: found loaded component sm
[ubuntue:1778162] mca: base: components_register: registering framework btl components
[ubuntue:1778162] mca: base: components_register: found loaded component self
[ubuntue:1778158] mca: base: components_register: registering framework btl components
[ubuntue:1778158] mca: base: components_register: found loaded component self
[ubuntue:1778167] mca: base: components_register: found loaded component vader
[ubuntue:1778156] mca: base: components_register: registering framework btl components
[ubuntue:1778156] mca: base: components_register: found loaded component self
[ubuntue:1778162] mca: base: components_register: component self register function successful
[ubuntue:1778162] mca: base: components_register: found loaded component sm
[ubuntue:1778165] mca: base: components_register: registering framework btl components
[ubuntue:1778165] mca: base: components_register: found loaded component self
[ubuntue:1778155] mca: base: components_register: registering framework btl components
[ubuntue:1778155] mca: base: components_register: found loaded component self
[ubuntue:1778160] mca: base: components_register: registering framework btl components
[ubuntue:1778160] mca: base: components_register: found loaded component self
[ubuntue:1778162] mca: base: components_register: found loaded component vader
[ubuntue:1778158] mca: base: components_register: component self register function successful
[ubuntue:1778158] mca: base: components_register: found loaded component sm
[ubuntue:1778158] mca: base: components_register: found loaded component vader
[ubuntue:1778165] mca: base: components_register: component self register function successful
[ubuntue:1778165] mca: base: components_register: found loaded component sm
[ubuntue:1778165] mca: base: components_register: found loaded component vader
[ubuntue:1778167] mca: base: components_register: component vader register function successful
[ubuntue:1778156] mca: base: components_register: component self register function successful
[ubuntue:1778155] mca: base: components_register: component self register function successful
[ubuntue:1778155] mca: base: components_register: found loaded component sm
[ubuntue:1778155] mca: base: components_register: found loaded component vader
[ubuntue:1778167] mca: base: components_register: found loaded component tcp
[ubuntue:1778156] mca: base: components_register: found loaded component sm
[ubuntue:1778156] mca: base: components_register: found loaded component vader
[ubuntue:1778160] mca: base: components_register: component self register function successful
[ubuntue:1778160] mca: base: components_register: found loaded component sm
[ubuntue:1778160] mca: base: components_register: found loaded component vader
[ubuntue:1778162] mca: base: components_register: component vader register function successful
[ubuntue:1778162] mca: base: components_register: found loaded component tcp
[ubuntue:1778158] mca: base: components_register: component vader register function successful
[ubuntue:1778158] mca: base: components_register: found loaded component tcp
[ubuntue:1778165] mca: base: components_register: component vader register function successful
[ubuntue:1778165] mca: base: components_register: found loaded component tcp
[ubuntue:1778155] mca: base: components_register: component vader register function successful
[ubuntue:1778155] mca: base: components_register: found loaded component tcp
[ubuntue:1778167] mca: base: components_register: component tcp register function successful
[ubuntue:1778167] mca: base: components_open: opening btl components
[ubuntue:1778156] mca: base: components_register: component vader register function successful
[ubuntue:1778156] mca: base: components_register: found loaded component tcp
[ubuntue:1778167] mca: base: components_open: found loaded component self
[ubuntue:1778167] mca: base: components_open: component self open function successful
[ubuntue:1778167] mca: base: components_open: found loaded component vader
[ubuntue:1778167] mca: base: components_open: component vader open function successful
[ubuntue:1778167] mca: base: components_open: found loaded component tcp
[ubuntue:1778167] mca: base: components_open: component tcp open function successful
[ubuntue:1778167] select: initializing btl component self
[ubuntue:1778167] select: init of component self returned success
[ubuntue:1778167] select: initializing btl component vader
[ubuntue:1778160] mca: base: components_register: component vader register function successful
[ubuntue:1778160] mca: base: components_register: found loaded component tcp
[ubuntue:1778162] mca: base: components_register: component tcp register function successful
[ubuntue:1778162] mca: base: components_open: opening btl components
[ubuntue:1778162] mca: base: components_open: found loaded component self
[ubuntue:1778162] mca: base: components_open: component self open function successful
[ubuntue:1778162] mca: base: components_open: found loaded component vader
[ubuntue:1778162] mca: base: components_open: component vader open function successful
[ubuntue:1778162] mca: base: components_open: found loaded component tcp
[ubuntue:1778162] mca: base: components_open: component tcp open function successful
[ubuntue:1778162] select: initializing btl component self
[ubuntue:1778162] select: init of component self returned success
[ubuntue:1778162] select: initializing btl component vader
[ubuntue:1778158] mca: base: components_register: component tcp register function successful
[ubuntue:1778158] mca: base: components_open: opening btl components
[ubuntue:1778158] mca: base: components_open: found loaded component self
[ubuntue:1778158] mca: base: components_open: component self open function successful
[ubuntue:1778158] mca: base: components_open: found loaded component vader
[ubuntue:1778158] mca: base: components_open: component vader open function successful
[ubuntue:1778158] mca: base: components_open: found loaded component tcp
[ubuntue:1778165] mca: base: components_register: component tcp register function successful
[ubuntue:1778165] mca: base: components_open: opening btl components
[ubuntue:1778165] mca: base: components_open: found loaded component self
[ubuntue:1778165] mca: base: components_open: component self open function successful
[ubuntue:1778165] mca: base: components_open: found loaded component vader
[ubuntue:1778165] mca: base: components_open: component vader open function successful
[ubuntue:1778165] mca: base: components_open: found loaded component tcp
[ubuntue:1778165] mca: base: components_open: component tcp open function successful
[ubuntue:1778165] select: initializing btl component self
[ubuntue:1778165] select: init of component self returned success
[ubuntue:1778165] select: initializing btl component vader
[ubuntue:1778158] mca: base: components_open: component tcp open function successful
[ubuntue:1778158] select: initializing btl component self
[ubuntue:1778158] select: init of component self returned success
[ubuntue:1778158] select: initializing btl component vader
[ubuntue:1778155] mca: base: components_register: component tcp register function successful
[ubuntue:1778155] mca: base: components_open: opening btl components
[ubuntue:1778155] mca: base: components_open: found loaded component self
[ubuntue:1778155] mca: base: components_open: component self open function successful
[ubuntue:1778155] mca: base: components_open: found loaded component vader
[ubuntue:1778155] mca: base: components_open: component vader open function successful
[ubuntue:1778155] mca: base: components_open: found loaded component tcp
[ubuntue:1778155] mca: base: components_open: component tcp open function successful
[ubuntue:1778155] select: initializing btl component self
[ubuntue:1778155] select: init of component self returned success
[ubuntue:1778155] select: initializing btl component vader
[ubuntue:1778156] mca: base: components_register: component tcp register function successful
[ubuntue:1778156] mca: base: components_open: opening btl components
[ubuntue:1778156] mca: base: components_open: found loaded component self
[ubuntue:1778156] mca: base: components_open: component self open function successful
[ubuntue:1778156] mca: base: components_open: found loaded component vader
[ubuntue:1778156] mca: base: components_open: component vader open function successful
[ubuntue:1778156] mca: base: components_open: found loaded component tcp
[ubuntue:1778156] mca: base: components_open: component tcp open function successful
[ubuntue:1778156] select: initializing btl component self
[ubuntue:1778156] select: init of component self returned success
[ubuntue:1778156] select: initializing btl component vader
[ubuntue:1778160] mca: base: components_register: component tcp register function successful
[ubuntue:1778160] mca: base: components_open: opening btl components
[ubuntue:1778160] mca: base: components_open: found loaded component self
[ubuntue:1778160] mca: base: components_open: component self open function successful
[ubuntue:1778160] mca: base: components_open: found loaded component vader
[ubuntue:1778160] mca: base: components_open: component vader open function successful
[ubuntue:1778160] mca: base: components_open: found loaded component tcp
[ubuntue:1778160] mca: base: components_open: component tcp open function successful
[ubuntue:1778160] select: initializing btl component self
[ubuntue:1778160] select: init of component self returned success
[ubuntue:1778160] select: initializing btl component vader
[ubuntue:1778167] select: init of component vader returned success
[ubuntue:1778167] select: initializing btl component tcp
[ubuntue:1778167] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778167] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778159] mca: base: components_register: registering framework btl components
[ubuntue:1778159] mca: base: components_register: found loaded component self
[ubuntue:1778158] select: init of component vader returned success
[ubuntue:1778158] select: initializing btl component tcp
[ubuntue:1778162] select: init of component vader returned success
[ubuntue:1778162] select: initializing btl component tcp
[ubuntue:1778165] select: init of component vader returned success
[ubuntue:1778165] select: initializing btl component tcp
[ubuntue:1778167] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778167] btl:tcp: Successfully bound to AF_INET port 1024
[ubuntue:1778167] btl:tcp: my listening v4 socket is 0.0.0.0:1024
[ubuntue:1778155] select: init of component vader returned success
[ubuntue:1778155] select: initializing btl component tcp
[ubuntue:1778167] btl:tcp: examining interface enp97s0f2
[ubuntue:1778167] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778167] select: init of component tcp returned success
[ubuntue:1778156] select: init of component vader returned success
[ubuntue:1778156] select: initializing btl component tcp
[ubuntue:1778157] mca: base: components_register: registering framework btl components
[ubuntue:1778157] mca: base: components_register: found loaded component self
[ubuntue:1778160] select: init of component vader returned success
[ubuntue:1778160] select: initializing btl component tcp
[ubuntue:1778158] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778158] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778162] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778162] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778165] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778165] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778155] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778155] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778160] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778160] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778156] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778156] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778158] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778158] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778158] btl:tcp: Successfully bound to AF_INET port 1025
[ubuntue:1778158] btl:tcp: my listening v4 socket is 0.0.0.0:1025
[ubuntue:1778158] btl:tcp: examining interface enp97s0f2
[ubuntue:1778162] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778162] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778162] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778162] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778162] btl:tcp: Successfully bound to AF_INET port 1027
[ubuntue:1778165] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778165] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778165] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778165] btl:tcp: Successfully bound to AF_INET port 1026
[ubuntue:1778165] btl:tcp: my listening v4 socket is 0.0.0.0:1026
[ubuntue:1778158] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778158] select: init of component tcp returned success
[ubuntue:1778162] btl:tcp: my listening v4 socket is 0.0.0.0:1027
[ubuntue:1778162] btl:tcp: examining interface enp97s0f2
[ubuntue:1778162] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778155] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778155] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778155] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778155] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778155] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778155] btl:tcp: Successfully bound to AF_INET port 1028
[ubuntue:1778155] btl:tcp: my listening v4 socket is 0.0.0.0:1028
[ubuntue:1778155] btl:tcp: examining interface enp97s0f2
[ubuntue:1778155] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778160] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778160] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778160] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778160] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778160] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778160] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778160] btl:tcp: Successfully bound to AF_INET port 1029
[ubuntue:1778160] btl:tcp: my listening v4 socket is 0.0.0.0:1029
[ubuntue:1778160] btl:tcp: examining interface enp97s0f2
[ubuntue:1778160] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778156] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778156] btl:tcp: Successfully bound to AF_INET port 1030
[ubuntue:1778165] btl:tcp: examining interface enp97s0f2
[ubuntue:1778165] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778165] select: init of component tcp returned success
[ubuntue:1778159] mca: base: components_register: component self register function successful
[ubuntue:1778159] mca: base: components_register: found loaded component sm
[ubuntue:1778159] mca: base: components_register: found loaded component vader
[ubuntue:1778157] mca: base: components_register: component self register function successful
[ubuntue:1778157] mca: base: components_register: found loaded component sm
[ubuntue:1778162] select: init of component tcp returned success
[ubuntue:1778155] select: init of component tcp returned success
[ubuntue:1778156] btl:tcp: my listening v4 socket is 0.0.0.0:1030
[ubuntue:1778156] btl:tcp: examining interface enp97s0f2
[ubuntue:1778156] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778156] select: init of component tcp returned success
[ubuntue:1778157] mca: base: components_register: found loaded component vader
[ubuntue:1778160] select: init of component tcp returned success
[ubuntue:1778159] mca: base: components_register: component vader register function successful
[ubuntue:1778159] mca: base: components_register: found loaded component tcp
[ubuntue:1778157] mca: base: components_register: component vader register function successful
[ubuntue:1778157] mca: base: components_register: found loaded component tcp
[ubuntue:1778167] mca: base: components_register: registering framework pml components
[ubuntue:1778167] mca: base: components_register: found loaded component v
[ubuntue:1778167] mca: base: components_register: component v register function successful
[ubuntue:1778167] mca: base: components_register: found loaded component monitoring
[ubuntue:1778167] mca: base: components_register: component monitoring register function successful
[ubuntue:1778167] mca: base: components_register: found loaded component ob1
[ubuntue:1778158] mca: base: components_register: registering framework pml components
[ubuntue:1778158] mca: base: components_register: found loaded component v
[ubuntue:1778165] mca: base: components_register: registering framework pml components
[ubuntue:1778165] mca: base: components_register: found loaded component v
[ubuntue:1778158] mca: base: components_register: component v register function successful
[ubuntue:1778159] mca: base: components_register: component tcp register function successful
[ubuntue:1778159] mca: base: components_open: opening btl components
[ubuntue:1778159] mca: base: components_open: found loaded component self
[ubuntue:1778159] mca: base: components_open: component self open function successful
[ubuntue:1778159] mca: base: components_open: found loaded component vader
[ubuntue:1778159] mca: base: components_open: component vader open function successful
[ubuntue:1778159] mca: base: components_open: found loaded component tcp
[ubuntue:1778162] mca: base: components_register: registering framework pml components
[ubuntue:1778162] mca: base: components_register: found loaded component v
[ubuntue:1778158] mca: base: components_register: found loaded component monitoring
[ubuntue:1778157] mca: base: components_register: component tcp register function successful
[ubuntue:1778157] mca: base: components_open: opening btl components
[ubuntue:1778157] mca: base: components_open: found loaded component self
[ubuntue:1778157] mca: base: components_open: component self open function successful
[ubuntue:1778157] mca: base: components_open: found loaded component vader
[ubuntue:1778159] mca: base: components_open: component tcp open function successful
[ubuntue:1778159] select: initializing btl component self
[ubuntue:1778159] select: init of component self returned success
[ubuntue:1778159] select: initializing btl component vader
[ubuntue:1778155] mca: base: components_register: registering framework pml components
[ubuntue:1778155] mca: base: components_register: found loaded component v
[ubuntue:1778155] mca: base: components_register: component v register function successful
[ubuntue:1778165] mca: base: components_register: component v register function successful
[ubuntue:1778165] mca: base: components_register: found loaded component monitoring
[ubuntue:1778160] mca: base: components_register: registering framework pml components
[ubuntue:1778160] mca: base: components_register: found loaded component v
[ubuntue:1778160] mca: base: components_register: component v register function successful
[ubuntue:1778167] mca: base: components_register: component ob1 register function successful
[ubuntue:1778167] mca: base: components_register: found loaded component cm
[ubuntue:1778167] mca: base: components_register: component cm register function successful
[ubuntue:1778167] mca: base: components_open: opening pml components
[ubuntue:1778167] mca: base: components_open: found loaded component v
[ubuntue:1778158] mca: base: components_register: component monitoring register function successful
[ubuntue:1778158] mca: base: components_register: found loaded component ob1
[ubuntue:1778156] mca: base: components_register: registering framework pml components
[ubuntue:1778156] mca: base: components_register: found loaded component v
[ubuntue:1778156] mca: base: components_register: component v register function successful
[ubuntue:1778156] mca: base: components_register: found loaded component monitoring
[ubuntue:1778157] mca: base: components_open: component vader open function successful
[ubuntue:1778157] mca: base: components_open: found loaded component tcp
[ubuntue:1778157] mca: base: components_open: component tcp open function successful
[ubuntue:1778157] select: initializing btl component self
[ubuntue:1778157] select: init of component self returned success
[ubuntue:1778157] select: initializing btl component vader
[ubuntue:1778162] mca: base: components_register: component v register function successful
[ubuntue:1778162] mca: base: components_register: found loaded component monitoring
[ubuntue:1778162] mca: base: components_register: component monitoring register function successful
[ubuntue:1778155] mca: base: components_register: found loaded component monitoring
[ubuntue:1778160] mca: base: components_register: found loaded component monitoring
[ubuntue:1778165] mca: base: components_register: component monitoring register function successful
[ubuntue:1778165] mca: base: components_register: found loaded component ob1
[ubuntue:1778155] mca: base: components_register: component monitoring register function successful
[ubuntue:1778160] mca: base: components_register: component monitoring register function successful
[ubuntue:1778160] mca: base: components_register: found loaded component ob1
[ubuntue:1778162] mca: base: components_register: found loaded component ob1
[ubuntue:1778155] mca: base: components_register: found loaded component ob1
[ubuntue:1778165] mca: base: components_register: component ob1 register function successful
[ubuntue:1778165] mca: base: components_register: found loaded component cm
[ubuntue:1778158] mca: base: components_register: component ob1 register function successful
[ubuntue:1778158] mca: base: components_register: found loaded component cm
[ubuntue:1778158] mca: base: components_register: component cm register function successful
[ubuntue:1778158] mca: base: components_open: opening pml components
[ubuntue:1778158] mca: base: components_open: found loaded component v
[ubuntue:1778156] mca: base: components_register: component monitoring register function successful
[ubuntue:1778156] mca: base: components_register: found loaded component ob1
[ubuntue:1778165] mca: base: components_register: component cm register function successful
[ubuntue:1778165] mca: base: components_open: opening pml components
[ubuntue:1778165] mca: base: components_open: found loaded component v
[ubuntue:1778160] mca: base: components_register: component ob1 register function successful
[ubuntue:1778160] mca: base: components_register: found loaded component cm
[ubuntue:1778162] mca: base: components_register: component ob1 register function successful
[ubuntue:1778155] mca: base: components_register: component ob1 register function successful
[ubuntue:1778155] mca: base: components_register: found loaded component cm
[ubuntue:1778155] mca: base: components_register: component cm register function successful
[ubuntue:1778160] mca: base: components_register: component cm register function successful
[ubuntue:1778162] mca: base: components_register: found loaded component cm
[ubuntue:1778156] mca: base: components_register: component ob1 register function successful
[ubuntue:1778156] mca: base: components_register: found loaded component cm
[ubuntue:1778156] mca: base: components_register: component cm register function successful
[ubuntue:1778156] mca: base: components_open: opening pml components
[ubuntue:1778156] mca: base: components_open: found loaded component v
[ubuntue:1778157] select: init of component vader returned success
[ubuntue:1778157] select: initializing btl component tcp
[ubuntue:1778159] select: init of component vader returned success
[ubuntue:1778159] select: initializing btl component tcp
[ubuntue:1778155] mca: base: components_open: opening pml components
[ubuntue:1778155] mca: base: components_open: found loaded component v
[ubuntue:1778160] mca: base: components_open: opening pml components
[ubuntue:1778160] mca: base: components_open: found loaded component v
[ubuntue:1778167] mca: base: components_open: component v open function successful
[ubuntue:1778167] mca: base: components_open: found loaded component monitoring
[ubuntue:1778167] mca: base: components_open: component monitoring open function successful
[ubuntue:1778167] mca: base: components_open: found loaded component ob1
[ubuntue:1778167] mca: base: components_open: component ob1 open function successful
[ubuntue:1778167] mca: base: components_open: found loaded component cm
[ubuntue:1778162] mca: base: components_register: component cm register function successful
[ubuntue:1778162] mca: base: components_open: opening pml components
[ubuntue:1778163] mca: base: components_register: registering framework btl components
[ubuntue:1778163] mca: base: components_register: found loaded component self
[ubuntue:1778162] mca: base: components_open: found loaded component v
[ubuntue:1778159] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778159] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778157] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778157] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778158] mca: base: components_open: component v open function successful
[ubuntue:1778158] mca: base: components_open: found loaded component monitoring
[ubuntue:1778158] mca: base: components_open: component monitoring open function successful
[ubuntue:1778158] mca: base: components_open: found loaded component ob1
[ubuntue:1778158] mca: base: components_open: component ob1 open function successful
[ubuntue:1778158] mca: base: components_open: found loaded component cm
[ubuntue:1778163] mca: base: components_register: component self register function successful
[ubuntue:1778163] mca: base: components_register: found loaded component sm
[ubuntue:1778163] mca: base: components_register: found loaded component vader
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778165] mca: base: components_open: component v open function successful
[ubuntue:1778165] mca: base: components_open: found loaded component monitoring
[ubuntue:1778165] mca: base: components_open: component monitoring open function successful
[ubuntue:1778165] mca: base: components_open: found loaded component ob1
[ubuntue:1778165] mca: base: components_open: component ob1 open function successful
[ubuntue:1778165] mca: base: components_open: found loaded component cm
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778159] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778159] btl:tcp: Successfully bound to AF_INET port 1031
[ubuntue:1778159] btl:tcp: my listening v4 socket is 0.0.0.0:1031
[ubuntue:1778160] mca: base: components_open: component v open function successful
[ubuntue:1778160] mca: base: components_open: found loaded component monitoring
[ubuntue:1778160] mca: base: components_open: component monitoring open function successful
[ubuntue:1778160] mca: base: components_open: found loaded component ob1
[ubuntue:1778160] mca: base: components_open: component ob1 open function successful
[ubuntue:1778160] mca: base: components_open: found loaded component cm
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778157] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778157] btl:tcp: Successfully bound to AF_INET port 1032
[ubuntue:1778155] mca: base: components_open: component v open function successful
[ubuntue:1778155] mca: base: components_open: found loaded component monitoring
[ubuntue:1778155] mca: base: components_open: component monitoring open function successful
[ubuntue:1778155] mca: base: components_open: found loaded component ob1
[ubuntue:1778155] mca: base: components_open: component ob1 open function successful
[ubuntue:1778155] mca: base: components_open: found loaded component cm
[ubuntue:1778156] mca: base: components_open: component v open function successful
[ubuntue:1778156] mca: base: components_open: found loaded component monitoring
[ubuntue:1778156] mca: base: components_open: component monitoring open function successful
[ubuntue:1778156] mca: base: components_open: found loaded component ob1
[ubuntue:1778156] mca: base: components_open: component ob1 open function successful
[ubuntue:1778156] mca: base: components_open: found loaded component cm
[ubuntue:1778157] btl:tcp: my listening v4 socket is 0.0.0.0:1032
[ubuntue:1778157] btl:tcp: examining interface enp97s0f2
[ubuntue:1778157] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778157] select: init of component tcp returned success
[ubuntue:1778159] btl:tcp: examining interface enp97s0f2
[ubuntue:1778159] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778159] select: init of component tcp returned success
[ubuntue:1778163] mca: base: components_register: component vader register function successful
[ubuntue:1778163] mca: base: components_register: found loaded component tcp
[ubuntue:1778162] mca: base: components_open: component v open function successful
[ubuntue:1778162] mca: base: components_open: found loaded component monitoring
[ubuntue:1778162] mca: base: components_open: component monitoring open function successful
[ubuntue:1778162] mca: base: components_open: found loaded component ob1
[ubuntue:1778162] mca: base: components_open: component ob1 open function successful
[ubuntue:1778162] mca: base: components_open: found loaded component cm
[ubuntue:1778163] mca: base: components_register: component tcp register function successful
[ubuntue:1778163] mca: base: components_open: opening btl components
[ubuntue:1778163] mca: base: components_open: found loaded component self
[ubuntue:1778163] mca: base: components_open: component self open function successful
[ubuntue:1778163] mca: base: components_open: found loaded component vader
[ubuntue:1778163] mca: base: components_open: component vader open function successful
[ubuntue:1778163] mca: base: components_open: found loaded component tcp
[ubuntue:1778163] mca: base: components_open: component tcp open function successful
[ubuntue:1778163] select: initializing btl component self
[ubuntue:1778163] select: init of component self returned success
[ubuntue:1778163] select: initializing btl component vader
[ubuntue:1778163] select: init of component vader returned success
[ubuntue:1778163] select: initializing btl component tcp
[ubuntue:1778163] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778163] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778163] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778163] btl:tcp: Successfully bound to AF_INET port 1033
[ubuntue:1778163] btl:tcp: my listening v4 socket is 0.0.0.0:1033
[ubuntue:1778163] btl:tcp: examining interface enp97s0f2
[ubuntue:1778163] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778163] select: init of component tcp returned success
[ubuntue:1778157] mca: base: components_register: registering framework pml components
[ubuntue:1778157] mca: base: components_register: found loaded component v
[ubuntue:1778159] mca: base: components_register: registering framework pml components
[ubuntue:1778159] mca: base: components_register: found loaded component v
[ubuntue:1778159] mca: base: components_register: component v register function successful
[ubuntue:1778157] mca: base: components_register: component v register function successful
[ubuntue:1778157] mca: base: components_register: found loaded component monitoring
[ubuntue:1778159] mca: base: components_register: found loaded component monitoring
[ubuntue:1778159] mca: base: components_register: component monitoring register function successful
[ubuntue:1778157] mca: base: components_register: component monitoring register function successful
[ubuntue:1778157] mca: base: components_register: found loaded component ob1
[ubuntue:1778159] mca: base: components_register: found loaded component ob1
[ubuntue:1778163] mca: base: components_register: registering framework pml components
[ubuntue:1778163] mca: base: components_register: found loaded component v
[ubuntue:1778163] mca: base: components_register: component v register function successful
[ubuntue:1778157] mca: base: components_register: component ob1 register function successful
[ubuntue:1778159] mca: base: components_register: component ob1 register function successful
[ubuntue:1778163] mca: base: components_register: found loaded component monitoring
[ubuntue:1778157] mca: base: components_register: found loaded component cm
[ubuntue:1778159] mca: base: components_register: found loaded component cm
[ubuntue:1778159] mca: base: components_register: component cm register function successful
[ubuntue:1778157] mca: base: components_register: component cm register function successful
[ubuntue:1778157] mca: base: components_open: opening pml components
[ubuntue:1778157] mca: base: components_open: found loaded component v
[ubuntue:1778163] mca: base: components_register: component monitoring register function successful
[ubuntue:1778163] mca: base: components_register: found loaded component ob1
[ubuntue:1778159] mca: base: components_open: opening pml components
[ubuntue:1778159] mca: base: components_open: found loaded component v
[ubuntue:1778163] mca: base: components_register: component ob1 register function successful
[ubuntue:1778163] mca: base: components_register: found loaded component cm
[ubuntue:1778163] mca: base: components_register: component cm register function successful
[ubuntue:1778163] mca: base: components_open: opening pml components
[ubuntue:1778163] mca: base: components_open: found loaded component v
[ubuntue:1778172] mca: base: components_register: registering framework btl components
[ubuntue:1778172] mca: base: components_register: found loaded component self
[ubuntue:1778172] mca: base: components_register: component self register function successful
[ubuntue:1778172] mca: base: components_register: found loaded component sm
[ubuntue:1778172] mca: base: components_register: found loaded component vader
[ubuntue:1778163] mca: base: components_open: component v open function successful
[ubuntue:1778163] mca: base: components_open: found loaded component monitoring
[ubuntue:1778163] mca: base: components_open: component monitoring open function successful
[ubuntue:1778163] mca: base: components_open: found loaded component ob1
[ubuntue:1778163] mca: base: components_open: component ob1 open function successful
[ubuntue:1778163] mca: base: components_open: found loaded component cm
[ubuntue:1778159] mca: base: components_open: component v open function successful
[ubuntue:1778159] mca: base: components_open: found loaded component monitoring
[ubuntue:1778159] mca: base: components_open: component monitoring open function successful
[ubuntue:1778159] mca: base: components_open: found loaded component ob1
[ubuntue:1778159] mca: base: components_open: component ob1 open function successful
[ubuntue:1778159] mca: base: components_open: found loaded component cm
[ubuntue:1778172] mca: base: components_register: component vader register function successful
[ubuntue:1778172] mca: base: components_register: found loaded component tcp
[ubuntue:1778157] mca: base: components_open: component v open function successful
[ubuntue:1778157] mca: base: components_open: found loaded component monitoring
[ubuntue:1778157] mca: base: components_open: component monitoring open function successful
[ubuntue:1778157] mca: base: components_open: found loaded component ob1
[ubuntue:1778157] mca: base: components_open: component ob1 open function successful
[ubuntue:1778157] mca: base: components_open: found loaded component cm
[ubuntue:1778161] mca: base: components_register: registering framework btl components
[ubuntue:1778161] mca: base: components_register: found loaded component self
[ubuntue:1778172] mca: base: components_register: component tcp register function successful
[ubuntue:1778172] mca: base: components_open: opening btl components
[ubuntue:1778172] mca: base: components_open: found loaded component self
[ubuntue:1778172] mca: base: components_open: component self open function successful
[ubuntue:1778172] mca: base: components_open: found loaded component vader
[ubuntue:1778172] mca: base: components_open: component vader open function successful
[ubuntue:1778172] mca: base: components_open: found loaded component tcp
[ubuntue:1778172] mca: base: components_open: component tcp open function successful
[ubuntue:1778172] select: initializing btl component self
[ubuntue:1778172] select: init of component self returned success
[ubuntue:1778172] select: initializing btl component vader
[ubuntue:1778161] mca: base: components_register: component self register function successful
[ubuntue:1778161] mca: base: components_register: found loaded component sm
[ubuntue:1778161] mca: base: components_register: found loaded component vader
[ubuntue:1778172] select: init of component vader returned success
[ubuntue:1778172] select: initializing btl component tcp
[ubuntue:1778161] mca: base: components_register: component vader register function successful
[ubuntue:1778161] mca: base: components_register: found loaded component tcp
[ubuntue:1778172] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778172] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778161] mca: base: components_register: component tcp register function successful
[ubuntue:1778172] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:1778172] btl:tcp: Successfully bound to AF_INET port 1034
[ubuntue:1778172] btl:tcp: my listening v4 socket is 0.0.0.0:1034
[ubuntue:1778172] btl:tcp: examining interface enp97s0f2
[ubuntue:1778172] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778161] mca: base: components_open: opening btl components
[ubuntue:1778161] mca: base: components_open: found loaded component self
[ubuntue:1778161] mca: base: components_open: component self open function successful
[ubuntue:1778161] mca: base: components_open: found loaded component vader
[ubuntue:1778161] mca: base: components_open: component vader open function successful
[ubuntue:1778161] mca: base: components_open: found loaded component tcp
[ubuntue:1778161] mca: base: components_open: component tcp open function successful
[ubuntue:1778161] select: initializing btl component self
[ubuntue:1778161] select: init of component self returned success
[ubuntue:1778161] select: initializing btl component vader
[ubuntue:1778172] select: init of component tcp returned success
[ubuntue:1778161] select: init of component vader returned success
[ubuntue:1778161] select: initializing btl component tcp
[ubuntue:1778161] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778161] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:1778161] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:1778161] btl:tcp: Successfully bound to AF_INET port 1035
[ubuntue:1778161] btl:tcp: my listening v4 socket is 0.0.0.0:1035
[ubuntue:1778161] btl:tcp: examining interface enp97s0f2
[ubuntue:1778161] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778161] select: init of component tcp returned success
[ubuntue:1778172] mca: base: components_register: registering framework pml components
[ubuntue:1778172] mca: base: components_register: found loaded component v
[ubuntue:1778172] mca: base: components_register: component v register function successful
[ubuntue:1778172] mca: base: components_register: found loaded component monitoring
[ubuntue:1778172] mca: base: components_register: component monitoring register function successful
[ubuntue:1778172] mca: base: components_register: found loaded component ob1
[ubuntue:1778172] mca: base: components_register: component ob1 register function successful
[ubuntue:1778172] mca: base: components_register: found loaded component cm
[ubuntue:1778172] mca: base: components_register: component cm register function successful
[ubuntue:1778172] mca: base: components_open: opening pml components
[ubuntue:1778172] mca: base: components_open: found loaded component v
[ubuntue:1778161] mca: base: components_register: registering framework pml components
[ubuntue:1778161] mca: base: components_register: found loaded component v
[ubuntue:1778161] mca: base: components_register: component v register function successful
[ubuntue:1778161] mca: base: components_register: found loaded component monitoring
[ubuntue:1778172] mca: base: components_open: component v open function successful
[ubuntue:1778172] mca: base: components_open: found loaded component monitoring
[ubuntue:1778172] mca: base: components_open: component monitoring open function successful
[ubuntue:1778172] mca: base: components_open: found loaded component ob1
[ubuntue:1778172] mca: base: components_open: component ob1 open function successful
[ubuntue:1778172] mca: base: components_open: found loaded component cm
[ubuntue:1778161] mca: base: components_register: component monitoring register function successful
[ubuntue:1778161] mca: base: components_register: found loaded component ob1
[ubuntue:1778161] mca: base: components_register: component ob1 register function successful
[ubuntue:1778161] mca: base: components_register: found loaded component cm
[ubuntue:1778161] mca: base: components_register: component cm register function successful
[ubuntue:1778161] mca: base: components_open: opening pml components
[ubuntue:1778161] mca: base: components_open: found loaded component v
[ubuntue:1778161] mca: base: components_open: component v open function successful
[ubuntue:1778161] mca: base: components_open: found loaded component monitoring
[ubuntue:1778161] mca: base: components_open: component monitoring open function successful
[ubuntue:1778161] mca: base: components_open: found loaded component ob1
[ubuntue:1778161] mca: base: components_open: component ob1 open function successful
[ubuntue:1778161] mca: base: components_open: found loaded component cm
[ubuntue:1778177] mca: base: components_register: registering framework btl components
[ubuntue:1778177] mca: base: components_register: found loaded component self
[ubuntue:1778177] mca: base: components_register: component self register function successful
[ubuntue:1778177] mca: base: components_register: found loaded component sm
[ubuntue:1778177] mca: base: components_register: found loaded component vader
[ubuntue:1778177] mca: base: components_register: component vader register function successful
[ubuntue:1778177] mca: base: components_register: found loaded component tcp
[ubuntue:1778177] mca: base: components_register: component tcp register function successful
[ubuntue:1778177] mca: base: components_open: opening btl components
[ubuntue:1778177] mca: base: components_open: found loaded component self
[ubuntue:1778177] mca: base: components_open: component self open function successful
[ubuntue:1778177] mca: base: components_open: found loaded component vader
[ubuntue:1778177] mca: base: components_open: component vader open function successful
[ubuntue:1778177] mca: base: components_open: found loaded component tcp
[ubuntue:1778177] mca: base: components_open: component tcp open function successful
[ubuntue:1778177] select: initializing btl component self
[ubuntue:1778177] select: init of component self returned success
[ubuntue:1778177] select: initializing btl component vader
[ubuntue:1778177] select: init of component vader returned success
[ubuntue:1778177] select: initializing btl component tcp
[ubuntue:1778177] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778177] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:1778177] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:1778177] btl:tcp: Successfully bound to AF_INET port 1036
[ubuntue:1778177] btl:tcp: my listening v4 socket is 0.0.0.0:1036
[ubuntue:1778177] btl:tcp: examining interface enp97s0f2
[ubuntue:1778177] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778177] select: init of component tcp returned success
[ubuntue:1778177] mca: base: components_register: registering framework pml components
[ubuntue:1778177] mca: base: components_register: found loaded component v
[ubuntue:1778177] mca: base: components_register: component v register function successful
[ubuntue:1778177] mca: base: components_register: found loaded component monitoring
[ubuntue:1778177] mca: base: components_register: component monitoring register function successful
[ubuntue:1778177] mca: base: components_register: found loaded component ob1
[ubuntue:1778177] mca: base: components_register: component ob1 register function successful
[ubuntue:1778177] mca: base: components_register: found loaded component cm
[ubuntue:1778177] mca: base: components_register: component cm register function successful
[ubuntue:1778177] mca: base: components_open: opening pml components
[ubuntue:1778177] mca: base: components_open: found loaded component v
[ubuntue:1778164] mca: base: components_register: registering framework btl components
[ubuntue:1778164] mca: base: components_register: found loaded component self
[ubuntue:1778177] mca: base: components_open: component v open function successful
[ubuntue:1778177] mca: base: components_open: found loaded component monitoring
[ubuntue:1778177] mca: base: components_open: component monitoring open function successful
[ubuntue:1778177] mca: base: components_open: found loaded component ob1
[ubuntue:1778177] mca: base: components_open: component ob1 open function successful
[ubuntue:1778177] mca: base: components_open: found loaded component cm
[ubuntue:1778164] mca: base: components_register: component self register function successful
[ubuntue:1778164] mca: base: components_register: found loaded component sm
[ubuntue:1778164] mca: base: components_register: found loaded component vader
[ubuntue:1778164] mca: base: components_register: component vader register function successful
[ubuntue:1778164] mca: base: components_register: found loaded component tcp
[ubuntue:1778164] mca: base: components_register: component tcp register function successful
[ubuntue:1778164] mca: base: components_open: opening btl components
[ubuntue:1778164] mca: base: components_open: found loaded component self
[ubuntue:1778164] mca: base: components_open: component self open function successful
[ubuntue:1778164] mca: base: components_open: found loaded component vader
[ubuntue:1778164] mca: base: components_open: component vader open function successful
[ubuntue:1778164] mca: base: components_open: found loaded component tcp
[ubuntue:1778164] mca: base: components_open: component tcp open function successful
[ubuntue:1778164] select: initializing btl component self
[ubuntue:1778164] select: init of component self returned success
[ubuntue:1778164] select: initializing btl component vader
[ubuntue:1778164] select: init of component vader returned success
[ubuntue:1778164] select: initializing btl component tcp
[ubuntue:1778164] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778164] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:1778164] btl:tcp: Attempting to bind to AF_INET port 1037
[ubuntue:1778164] btl:tcp: Successfully bound to AF_INET port 1037
[ubuntue:1778164] btl:tcp: my listening v4 socket is 0.0.0.0:1037
[ubuntue:1778164] btl:tcp: examining interface enp97s0f2
[ubuntue:1778164] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778164] select: init of component tcp returned success
[ubuntue:1778164] mca: base: components_register: registering framework pml components
[ubuntue:1778164] mca: base: components_register: found loaded component v
[ubuntue:1778164] mca: base: components_register: component v register function successful
[ubuntue:1778164] mca: base: components_register: found loaded component monitoring
[ubuntue:1778164] mca: base: components_register: component monitoring register function successful
[ubuntue:1778164] mca: base: components_register: found loaded component ob1
[ubuntue:1778164] mca: base: components_register: component ob1 register function successful
[ubuntue:1778164] mca: base: components_register: found loaded component cm
[ubuntue:1778164] mca: base: components_register: component cm register function successful
[ubuntue:1778164] mca: base: components_open: opening pml components
[ubuntue:1778164] mca: base: components_open: found loaded component v
[ubuntue:1778164] mca: base: components_open: component v open function successful
[ubuntue:1778164] mca: base: components_open: found loaded component monitoring
[ubuntue:1778164] mca: base: components_open: component monitoring open function successful
[ubuntue:1778164] mca: base: components_open: found loaded component ob1
[ubuntue:1778164] mca: base: components_open: component ob1 open function successful
[ubuntue:1778164] mca: base: components_open: found loaded component cm
[ubuntue:1778166] mca: base: components_register: registering framework btl components
[ubuntue:1778166] mca: base: components_register: found loaded component self
[ubuntue:1778166] mca: base: components_register: component self register function successful
[ubuntue:1778166] mca: base: components_register: found loaded component sm
[ubuntue:1778166] mca: base: components_register: found loaded component vader
[ubuntue:1778166] mca: base: components_register: component vader register function successful
[ubuntue:1778166] mca: base: components_register: found loaded component tcp
[ubuntue:1778166] mca: base: components_register: component tcp register function successful
[ubuntue:1778166] mca: base: components_open: opening btl components
[ubuntue:1778166] mca: base: components_open: found loaded component self
[ubuntue:1778166] mca: base: components_open: component self open function successful
[ubuntue:1778166] mca: base: components_open: found loaded component vader
[ubuntue:1778166] mca: base: components_open: component vader open function successful
[ubuntue:1778166] mca: base: components_open: found loaded component tcp
[ubuntue:1778166] mca: base: components_open: component tcp open function successful
[ubuntue:1778166] select: initializing btl component self
[ubuntue:1778166] select: init of component self returned success
[ubuntue:1778166] select: initializing btl component vader
[ubuntue:1778166] select: init of component vader returned success
[ubuntue:1778166] select: initializing btl component tcp
[ubuntue:1778166] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778166] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1037
[ubuntue:1778166] btl:tcp: Attempting to bind to AF_INET port 1038
[ubuntue:1778166] btl:tcp: Successfully bound to AF_INET port 1038
[ubuntue:1778166] btl:tcp: my listening v4 socket is 0.0.0.0:1038
[ubuntue:1778166] btl:tcp: examining interface enp97s0f2
[ubuntue:1778166] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778166] select: init of component tcp returned success
[ubuntue:1778166] mca: base: components_register: registering framework pml components
[ubuntue:1778166] mca: base: components_register: found loaded component v
[ubuntue:1778166] mca: base: components_register: component v register function successful
[ubuntue:1778166] mca: base: components_register: found loaded component monitoring
[ubuntue:1778166] mca: base: components_register: component monitoring register function successful
[ubuntue:1778166] mca: base: components_register: found loaded component ob1
[ubuntue:1778166] mca: base: components_register: component ob1 register function successful
[ubuntue:1778166] mca: base: components_register: found loaded component cm
[ubuntue:1778166] mca: base: components_register: component cm register function successful
[ubuntue:1778166] mca: base: components_open: opening pml components
[ubuntue:1778166] mca: base: components_open: found loaded component v
[ubuntue:1778166] mca: base: components_open: component v open function successful
[ubuntue:1778166] mca: base: components_open: found loaded component monitoring
[ubuntue:1778166] mca: base: components_open: component monitoring open function successful
[ubuntue:1778166] mca: base: components_open: found loaded component ob1
[ubuntue:1778166] mca: base: components_open: component ob1 open function successful
[ubuntue:1778166] mca: base: components_open: found loaded component cm
[ubuntue:1778169] mca: base: components_register: registering framework btl components
[ubuntue:1778169] mca: base: components_register: found loaded component self
[ubuntue:1778169] mca: base: components_register: component self register function successful
[ubuntue:1778169] mca: base: components_register: found loaded component sm
[ubuntue:1778169] mca: base: components_register: found loaded component vader
[ubuntue:1778169] mca: base: components_register: component vader register function successful
[ubuntue:1778169] mca: base: components_register: found loaded component tcp
[ubuntue:1778169] mca: base: components_register: component tcp register function successful
[ubuntue:1778169] mca: base: components_open: opening btl components
[ubuntue:1778169] mca: base: components_open: found loaded component self
[ubuntue:1778169] mca: base: components_open: component self open function successful
[ubuntue:1778169] mca: base: components_open: found loaded component vader
[ubuntue:1778169] mca: base: components_open: component vader open function successful
[ubuntue:1778169] mca: base: components_open: found loaded component tcp
[ubuntue:1778169] mca: base: components_open: component tcp open function successful
[ubuntue:1778169] select: initializing btl component self
[ubuntue:1778169] select: init of component self returned success
[ubuntue:1778169] select: initializing btl component vader
[ubuntue:1778169] select: init of component vader returned success
[ubuntue:1778169] select: initializing btl component tcp
[ubuntue:1778169] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:1778169] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1037
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1038
[ubuntue:1778169] btl:tcp: Attempting to bind to AF_INET port 1039
[ubuntue:1778169] btl:tcp: Successfully bound to AF_INET port 1039
[ubuntue:1778169] btl:tcp: my listening v4 socket is 0.0.0.0:1039
[ubuntue:1778169] btl:tcp: examining interface enp97s0f2
[ubuntue:1778169] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:1778169] select: init of component tcp returned success
[ubuntue:1778169] mca: base: components_register: registering framework pml components
[ubuntue:1778169] mca: base: components_register: found loaded component v
[ubuntue:1778169] mca: base: components_register: component v register function successful
[ubuntue:1778169] mca: base: components_register: found loaded component monitoring
[ubuntue:1778169] mca: base: components_register: component monitoring register function successful
[ubuntue:1778169] mca: base: components_register: found loaded component ob1
[ubuntue:1778169] mca: base: components_register: component ob1 register function successful
[ubuntue:1778169] mca: base: components_register: found loaded component cm
[ubuntue:1778169] mca: base: components_register: component cm register function successful
[ubuntue:1778169] mca: base: components_open: opening pml components
[ubuntue:1778169] mca: base: components_open: found loaded component v
[ubuntue:1778169] mca: base: components_open: component v open function successful
[ubuntue:1778169] mca: base: components_open: found loaded component monitoring
[ubuntue:1778169] mca: base: components_open: component monitoring open function successful
[ubuntue:1778169] mca: base: components_open: found loaded component ob1
[ubuntue:1778169] mca: base: components_open: component ob1 open function successful
[ubuntue:1778169] mca: base: components_open: found loaded component cm
[ubuntue:1778163] mca: base: components_open: component cm open function successful
[ubuntue:1778155] mca: base: components_open: component cm open function successful
[ubuntue:1778165] mca: base: components_open: component cm open function successful
[ubuntue:1778165] select: component v not in the include list
[ubuntue:1778165] select: component monitoring not in the include list
[ubuntue:1778165] select: initializing pml component ob1
[ubuntue:1778165] select: init returned priority 20
[ubuntue:1778165] select: initializing pml component cm
[ubuntue:1778162] mca: base: components_open: component cm open function successful
[ubuntue:1778162] select: component v not in the include list
[ubuntue:1778162] select: component monitoring not in the include list
[ubuntue:1778162] select: initializing pml component ob1
[ubuntue:1778162] select: init returned priority 20
[ubuntue:1778162] select: initializing pml component cm
[ubuntue:1778160] mca: base: components_open: component cm open function successful
[ubuntue:1778160] select: component v not in the include list
[ubuntue:1778160] select: component monitoring not in the include list
[ubuntue:1778160] select: initializing pml component ob1
[ubuntue:1778160] select: init returned priority 20
[ubuntue:1778160] select: initializing pml component cm
[ubuntue:1778156] mca: base: components_open: component cm open function successful
[ubuntue:1778156] select: component v not in the include list
[ubuntue:1778156] select: component monitoring not in the include list
[ubuntue:1778156] select: initializing pml component ob1
[ubuntue:1778156] select: init returned priority 20
[ubuntue:1778156] select: initializing pml component cm
[ubuntue:1778159] mca: base: components_open: component cm open function successful
[ubuntue:1778159] select: component v not in the include list
[ubuntue:1778159] select: component monitoring not in the include list
[ubuntue:1778159] select: initializing pml component ob1
[ubuntue:1778159] select: init returned priority 20
[ubuntue:1778159] select: initializing pml component cm
[ubuntue:1778161] mca: base: components_open: component cm open function successful
[ubuntue:1778161] select: component v not in the include list
[ubuntue:1778161] select: component monitoring not in the include list
[ubuntue:1778161] select: initializing pml component ob1
[ubuntue:1778161] select: init returned priority 20
[ubuntue:1778161] select: initializing pml component cm
[ubuntue:1778157] mca: base: components_open: component cm open function successful
[ubuntue:1778157] select: component v not in the include list
[ubuntue:1778157] select: component monitoring not in the include list
[ubuntue:1778157] select: initializing pml component ob1
[ubuntue:1778157] select: init returned priority 20
[ubuntue:1778157] select: initializing pml component cm
[ubuntue:1778169] mca: base: components_open: component cm open function successful
[ubuntue:1778169] select: component v not in the include list
[ubuntue:1778169] select: component monitoring not in the include list
[ubuntue:1778169] select: initializing pml component ob1
[ubuntue:1778169] select: init returned priority 20
[ubuntue:1778169] select: initializing pml component cm
[ubuntue:1778164] mca: base: components_open: component cm open function successful
[ubuntue:1778164] select: component v not in the include list
[ubuntue:1778164] select: component monitoring not in the include list
[ubuntue:1778164] select: initializing pml component ob1
[ubuntue:1778164] select: init returned priority 20
[ubuntue:1778164] select: initializing pml component cm
[ubuntue:1778167] mca: base: components_open: component cm open function successful
[ubuntue:1778167] select: component v not in the include list
[ubuntue:1778167] select: component monitoring not in the include list
[ubuntue:1778167] select: initializing pml component ob1
[ubuntue:1778167] select: init returned priority 20
[ubuntue:1778167] select: initializing pml component cm
[ubuntue:1778172] mca: base: components_open: component cm open function successful
[ubuntue:1778172] select: component v not in the include list
[ubuntue:1778172] select: component monitoring not in the include list
[ubuntue:1778172] select: initializing pml component ob1
[ubuntue:1778172] select: init returned priority 20
[ubuntue:1778172] select: initializing pml component cm
[ubuntue:1778158] mca: base: components_open: component cm open function successful
[ubuntue:1778158] select: component v not in the include list
[ubuntue:1778158] select: component monitoring not in the include list
[ubuntue:1778158] select: initializing pml component ob1
[ubuntue:1778158] select: init returned priority 20
[ubuntue:1778158] select: initializing pml component cm
[ubuntue:1778177] mca: base: components_open: component cm open function successful
[ubuntue:1778163] select: component v not in the include list
[ubuntue:1778163] select: component monitoring not in the include list
[ubuntue:1778163] select: initializing pml component ob1
[ubuntue:1778163] select: init returned priority 20
[ubuntue:1778163] select: initializing pml component cm
[ubuntue:1778177] select: component v not in the include list
[ubuntue:1778177] select: component monitoring not in the include list
[ubuntue:1778177] select: initializing pml component ob1
[ubuntue:1778177] select: init returned priority 20
[ubuntue:1778177] select: initializing pml component cm
[ubuntue:1778155] select: component v not in the include list
[ubuntue:1778155] select: component monitoring not in the include list
[ubuntue:1778155] select: initializing pml component ob1
[ubuntue:1778155] select: init returned priority 20
[ubuntue:1778155] select: initializing pml component cm
[ubuntue:1778166] mca: base: components_open: component cm open function successful
[ubuntue:1778166] select: component v not in the include list
[ubuntue:1778166] select: component monitoring not in the include list
[ubuntue:1778166] select: initializing pml component ob1
[ubuntue:1778166] select: init returned priority 20
[ubuntue:1778166] select: initializing pml component cm
[ubuntue:1778156] select: init returned priority 25
[ubuntue:1778156] selected cm best priority 25
[ubuntue:1778156] select: component ob1 not selected / finalized
[ubuntue:1778156] select: component cm selected
[ubuntue:1778156] mca: base: close: component v closed
[ubuntue:1778156] mca: base: close: unloading component v
[ubuntue:1778156] mca: base: close: component monitoring closed
[ubuntue:1778156] mca: base: close: unloading component monitoring
[ubuntue:1778156] mca: base: close: component ob1 closed
[ubuntue:1778156] mca: base: close: unloading component ob1
[ubuntue:1778163] select: init returned priority 25
[ubuntue:1778163] selected cm best priority 25
[ubuntue:1778163] select: component ob1 not selected / finalized
[ubuntue:1778163] select: component cm selected
[ubuntue:1778163] mca: base: close: component v closed
[ubuntue:1778163] mca: base: close: unloading component v
[ubuntue:1778163] mca: base: close: component monitoring closed
[ubuntue:1778163] mca: base: close: unloading component monitoring
[ubuntue:1778163] mca: base: close: component ob1 closed
[ubuntue:1778163] mca: base: close: unloading component ob1
[ubuntue:1778164] select: init returned priority 25
[ubuntue:1778164] selected cm best priority 25
[ubuntue:1778164] select: component ob1 not selected / finalized
[ubuntue:1778164] select: component cm selected
[ubuntue:1778164] mca: base: close: component v closed
[ubuntue:1778164] mca: base: close: unloading component v
[ubuntue:1778164] mca: base: close: component monitoring closed
[ubuntue:1778164] mca: base: close: unloading component monitoring
[ubuntue:1778164] mca: base: close: component ob1 closed
[ubuntue:1778164] mca: base: close: unloading component ob1
[ubuntue:1778155] select: init returned priority 25
[ubuntue:1778155] selected cm best priority 25
[ubuntue:1778155] select: component ob1 not selected / finalized
[ubuntue:1778155] select: component cm selected
[ubuntue:1778155] mca: base: close: component v closed
[ubuntue:1778155] mca: base: close: unloading component v
[ubuntue:1778155] mca: base: close: component monitoring closed
[ubuntue:1778155] mca: base: close: unloading component monitoring
[ubuntue:1778155] mca: base: close: component ob1 closed
[ubuntue:1778155] mca: base: close: unloading component ob1
[ubuntue:1778167] select: init returned priority 25
[ubuntue:1778167] selected cm best priority 25
[ubuntue:1778167] select: component ob1 not selected / finalized
[ubuntue:1778167] select: component cm selected
[ubuntue:1778167] mca: base: close: component v closed
[ubuntue:1778167] mca: base: close: unloading component v
[ubuntue:1778167] mca: base: close: component monitoring closed
[ubuntue:1778167] mca: base: close: unloading component monitoring
[ubuntue:1778167] mca: base: close: component ob1 closed
[ubuntue:1778167] mca: base: close: unloading component ob1
[ubuntue:1778159] select: init returned priority 25
[ubuntue:1778159] selected cm best priority 25
[ubuntue:1778159] select: component ob1 not selected / finalized
[ubuntue:1778159] select: component cm selected
[ubuntue:1778159] mca: base: close: component v closed
[ubuntue:1778159] mca: base: close: unloading component v
[ubuntue:1778159] mca: base: close: component monitoring closed
[ubuntue:1778159] mca: base: close: unloading component monitoring
[ubuntue:1778159] mca: base: close: component ob1 closed
[ubuntue:1778159] mca: base: close: unloading component ob1
[ubuntue:1778177] select: init returned priority 25
[ubuntue:1778177] selected cm best priority 25
[ubuntue:1778177] select: component ob1 not selected / finalized
[ubuntue:1778177] select: component cm selected
[ubuntue:1778177] mca: base: close: component v closed
[ubuntue:1778177] mca: base: close: unloading component v
[ubuntue:1778177] mca: base: close: component monitoring closed
[ubuntue:1778177] mca: base: close: unloading component monitoring
[ubuntue:1778177] mca: base: close: component ob1 closed
[ubuntue:1778177] mca: base: close: unloading component ob1
[ubuntue:1778169] select: init returned priority 25
[ubuntue:1778169] selected cm best priority 25
[ubuntue:1778169] select: component ob1 not selected / finalized
[ubuntue:1778169] select: component cm selected
[ubuntue:1778169] mca: base: close: component v closed
[ubuntue:1778169] mca: base: close: unloading component v
[ubuntue:1778169] mca: base: close: component monitoring closed
[ubuntue:1778169] mca: base: close: unloading component monitoring
[ubuntue:1778169] mca: base: close: component ob1 closed
[ubuntue:1778169] mca: base: close: unloading component ob1
[ubuntue:1778166] select: init returned priority 25
[ubuntue:1778166] selected cm best priority 25
[ubuntue:1778166] select: component ob1 not selected / finalized
[ubuntue:1778166] select: component cm selected
[ubuntue:1778166] mca: base: close: component v closed
[ubuntue:1778166] mca: base: close: unloading component v
[ubuntue:1778166] mca: base: close: component monitoring closed
[ubuntue:1778166] mca: base: close: unloading component monitoring
[ubuntue:1778166] mca: base: close: component ob1 closed
[ubuntue:1778166] mca: base: close: unloading component ob1
[ubuntue:1778172] select: init returned priority 25
[ubuntue:1778172] selected cm best priority 25
[ubuntue:1778172] select: component ob1 not selected / finalized
[ubuntue:1778172] select: component cm selected
[ubuntue:1778172] mca: base: close: component v closed
[ubuntue:1778172] mca: base: close: unloading component v
[ubuntue:1778172] mca: base: close: component monitoring closed
[ubuntue:1778172] mca: base: close: unloading component monitoring
[ubuntue:1778172] mca: base: close: component ob1 closed
[ubuntue:1778172] mca: base: close: unloading component ob1
[ubuntue:1778165] select: init returned priority 25
[ubuntue:1778165] selected cm best priority 25
[ubuntue:1778165] select: component ob1 not selected / finalized
[ubuntue:1778165] select: component cm selected
[ubuntue:1778165] mca: base: close: component v closed
[ubuntue:1778165] mca: base: close: unloading component v
[ubuntue:1778165] mca: base: close: component monitoring closed
[ubuntue:1778165] mca: base: close: unloading component monitoring
[ubuntue:1778165] mca: base: close: component ob1 closed
[ubuntue:1778165] mca: base: close: unloading component ob1
[ubuntue:1778160] select: init returned priority 25
[ubuntue:1778160] selected cm best priority 25
[ubuntue:1778160] select: component ob1 not selected / finalized
[ubuntue:1778160] select: component cm selected
[ubuntue:1778160] mca: base: close: component v closed
[ubuntue:1778160] mca: base: close: unloading component v
[ubuntue:1778160] mca: base: close: component monitoring closed
[ubuntue:1778160] mca: base: close: unloading component monitoring
[ubuntue:1778160] mca: base: close: component ob1 closed
[ubuntue:1778160] mca: base: close: unloading component ob1
[ubuntue:1778157] select: init returned priority 25
[ubuntue:1778157] selected cm best priority 25
[ubuntue:1778157] select: component ob1 not selected / finalized
[ubuntue:1778157] select: component cm selected
[ubuntue:1778157] mca: base: close: component v closed
[ubuntue:1778157] mca: base: close: unloading component v
[ubuntue:1778157] mca: base: close: component monitoring closed
[ubuntue:1778157] mca: base: close: unloading component monitoring
[ubuntue:1778157] mca: base: close: component ob1 closed
[ubuntue:1778157] mca: base: close: unloading component ob1
[ubuntue:1778158] select: init returned priority 25
[ubuntue:1778158] selected cm best priority 25
[ubuntue:1778158] select: component ob1 not selected / finalized
[ubuntue:1778158] select: component cm selected
[ubuntue:1778158] mca: base: close: component v closed
[ubuntue:1778158] mca: base: close: unloading component v
[ubuntue:1778158] mca: base: close: component monitoring closed
[ubuntue:1778158] mca: base: close: unloading component monitoring
[ubuntue:1778161] select: init returned priority 25
[ubuntue:1778161] selected cm best priority 25
[ubuntue:1778161] select: component ob1 not selected / finalized
[ubuntue:1778161] select: component cm selected
[ubuntue:1778161] mca: base: close: component v closed
[ubuntue:1778161] mca: base: close: unloading component v
[ubuntue:1778161] mca: base: close: component monitoring closed
[ubuntue:1778161] mca: base: close: unloading component monitoring
[ubuntue:1778158] mca: base: close: component ob1 closed
[ubuntue:1778158] mca: base: close: unloading component ob1
[ubuntue:1778161] mca: base: close: component ob1 closed
[ubuntue:1778161] mca: base: close: unloading component ob1
[ubuntue:1778162] select: init returned priority 25
[ubuntue:1778162] selected cm best priority 25
[ubuntue:1778162] select: component ob1 not selected / finalized
[ubuntue:1778162] select: component cm selected
[ubuntue:1778162] mca: base: close: component v closed
[ubuntue:1778162] mca: base: close: unloading component v
[ubuntue:1778162] mca: base: close: component monitoring closed
[ubuntue:1778162] mca: base: close: unloading component monitoring
[ubuntue:1778162] mca: base: close: component ob1 closed
[ubuntue:1778162] mca: base: close: unloading component ob1
[ubuntue:1778162] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778169] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778159] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778177] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778163] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778155] check:select: rank=0
[ubuntue:1778156] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778172] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778160] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778166] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778167] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778161] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778164] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778158] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778157] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778165] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778156] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778155] check:select: rank=0
[ubuntue:1778159] check:select: modex data not found
[ubuntue:1778169] check:select: modex data not found
[ubuntue:1778157] check:select: modex data not found
[ubuntue:1778162] check:select: modex data not found
[ubuntue:1778165] check:select: modex data not found
[ubuntue:1778163] check:select: modex data not found
[ubuntue:1778164] check:select: modex data not found
[ubuntue:1778158] check:select: modex data not found
[ubuntue:1778166] check:select: modex data not found
[ubuntue:1778167] check:select: modex data not found
[ubuntue:1778161] check:select: modex data not found
[ubuntue:1778160] check:select: modex data not found
[ubuntue:1778157] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778155] check:select: rank=0
[ubuntue:1778158] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778165] check:select: modex data not found
[ubuntue:1778164] check:select: modex data not found
[ubuntue:1778163] check:select: modex data not found
[ubuntue:1778166] check:select: modex data not found
[ubuntue:1778167] check:select: modex data not found
[ubuntue:1778159] check:select: modex data not found
[ubuntue:1778162] check:select: modex data not found
[ubuntue:1778169] check:select: modex data not found
[ubuntue:1778160] check:select: modex data not found
[ubuntue:1778156] check:select: modex data not found
[ubuntue:1778161] check:select: modex data not found
[ubuntue:1778172] check:select: modex data not found
[ubuntue:1778162] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778159] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778155] check:select: rank=0
[ubuntue:1778160] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778161] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778165] check:select: modex data not found
[ubuntue:1778163] check:select: modex data not found
[ubuntue:1778157] check:select: modex data not found
[ubuntue:1778164] check:select: modex data not found
[ubuntue:1778166] check:select: modex data not found
[ubuntue:1778169] check:select: modex data not found
[ubuntue:1778172] check:select: modex data not found
[ubuntue:1778167] check:select: modex data not found
[ubuntue:1778158] check:select: modex data not found
[ubuntue:1778156] check:select: modex data not found
[ubuntue:1778163] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778165] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778164] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778159] check:select: modex data not found
[ubuntue:1778155] check:select: rank=0
[ubuntue:1778169] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778166] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778157] check:select: modex data not found
[ubuntue:1778162] check:select: modex data not found
[ubuntue:1778167] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778172] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:1778160] check:select: modex data not found
[ubuntue:1778161] check:select: modex data not found
[ubuntue:1778158] check:select: modex data not found
[ubuntue:1778156] check:select: modex data not found

libi40iw-i40iw_ureg_mr: Failed to register memory
libi40iw-i40iw_ureg_mr: Failed to register memory
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source            
nwchem             00000000048D287A  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FB2E93033C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FB2E65791C2  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FB2E896F854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FB2E93BC905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FB2E941683C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007FB2E9414A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FB2E93D14A1  MPI_Allgather         Unknown  Unknown
nwchem             000000000485B233  Unknown               Unknown  Unknown
nwchem             000000000481E1F5  Unknown               Unknown  Unknown

nwchem             00000000047F531D  Unknown               Unknown  Unknown
nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FB2E8A340B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source            
nwchem             00000000048D287A  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FDE2127B3C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FDE1E4F11C2  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FDE208E7854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FDE21334905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FDE2138E83C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007FDE2138CA68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007FDE213494A1  MPI_Allgather         Unknown  Unknown
nwchem             000000000485B233  Unknown               Unknown  Unknown
nwchem             000000000481E1F5  Unknown               Unknown  Unknown

nwchem             00000000047F531D  Unknown               Unknown  Unknown
nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FDE209AC0B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FF6339963C0  Unknown               Unknown  Unknown
librxm-fi.so       00007FF62B52E9C8  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F72767933C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F726E38CAB3  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F726FA050DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F7275DFF854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F727684C905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F72768AF5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F7276864730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F7275EC40B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8C4A2243C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F8C4A220877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007F8C41E23CBE  Unknown               Unknown  Unknown
librxm-fi.so       00007F8C41E24AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F8C4809B0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F8C49890854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F8C4A2DD905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F8C4A3405B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F8C4A2F5730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F8C499550B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1165C8D3C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFD4FE60A67  clock_gettime         Unknown  Unknown
libc-2.31.so       00007F11654770E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007F115D878DC1  Unknown               Unknown  Unknown
librxm-fi.so       00007F115D878E19  Unknown               Unknown  Unknown
librxm-fi.so       00007F115D8728EA  Unknown               Unknown  Unknown
librxm-fi.so       00007F115D872A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F115D88ACDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F115D88BAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F11640090DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F11652F9854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F1165D46905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F1165DA95B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F1165D5E730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F11653BE0B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F62E63AF3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F62E63AB877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007F62DDFA7CBE  Unknown               Unknown  Unknown
librxm-fi.so       00007F62DDFA8AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F62DF6210DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F62E5A1B854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F62E6468905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F62E64CB5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F62E6480730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F62E5AE00B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F9E8827E3C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F9E7FD92EA8  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F5BC57043C0  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F5BBE0637B0  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F5BBE065D18  Unknown               Unknown  Unknown
libverbs-fi.so     00007F5BBE1D4D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F5BBE1D4FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F5BBD2E68A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F5BBD2E6A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F5BBD2FECDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F5BBD2FFAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F5BBE9780DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F5BC4D70854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F5BC57BD905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F5BC58205B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F5BC57D5730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F5BC4E350B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FA6527DE3C0  Unknown               Unknown  Unknown
librxm-fi.so       00007FA64A3C195F  Unknown               Unknown  Unknown
librxm-fi.so       00007FA64A3C1A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FA64A3D9CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FA64A3DAAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FA64BA530DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FA651E4A854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FA652897905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FA6528FA5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FA6528AF730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FA651F0F0B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F0BCC20B3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F0BCC207877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007F0BC3DDD9BC  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F0BC94840DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F0BCB877854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F0BCC2C4905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F0BCC31E83C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F0BCC31CA68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F0BCC2D94A1  MPI_Allgather         Unknown  Unknown
nwchem             000000000485B233  Unknown               Unknown  Unknown
nwchem             000000000481E1F5  Unknown               Unknown  Unknown

nwchem             00000000047F531D  Unknown               Unknown  Unknown
nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F0BCB93C0B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F3EFCBF23C0  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F3EF9555CA0  Unknown               Unknown  Unknown
libverbs-fi.so     00007F3EF96C4D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F3EF96C4FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F3EF87D68A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F3EF87D6A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F3EF87EECDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F3EF87EFAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F3EF9E680DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F3EFC25E854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F3EFCCAB905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F3EFCD0E5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F3EFCCC3730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F3EFC3230B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F0E120E13C0  Unknown               Unknown  Unknown
libverbs-fi.so     00007F0E0AB98768  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8F201D73C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F8F201D3877  pthread_spin_lock     Unknown  Unknown
libi40iw-rdmav25.  00007F8F1CB3ACE7  Unknown               Unknown  Unknown
libverbs-fi.so     00007F8F1CCA9D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F8F1CCA9FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F8F17B838A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F8F17B83A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F8F17B9BCDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F8F17B9CAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F8F1D44D0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F8F1F843854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F8F20290905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F8F202F35B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F8F202A8730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F8F1F9080B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F9C5C4553C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F9C596ED121  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F9C5BAC1854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F9C5C50E905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F9C5C5715B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F9C5C526730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007F9C5BB860B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000048D28AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FE6EFFC23C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FE6EFFBE877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FE6E7B9CAB3  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FE6ED2380DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FE6EF62E854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FE6F007B905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FE6F00DE5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FE6F0093730  MPI_Barrier           Unknown  Unknown
nwchem             000000000483F31D  Unknown               Unknown  Unknown
nwchem             00000000047F529B  Unknown               Unknown  Unknown

nwchem             00000000047F4C13  Unknown               Unknown  Unknown
nwchem             00000000047F3B9D  Unknown               Unknown  Unknown
nwchem             0000000000418A1F  Unknown               Unknown  Unknown
nwchem             00000000004189A2  Unknown               Unknown  Unknown
libc-2.31.so       00007FE6EF6F30B3  __libc_start_main     Unknown  Unknown

nwchem             00000000004188AE  Unknown               Unknown  Unknown
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:

  Process name: [[6499,1],13]
  Exit code:    174
--------------------------------------------------------------------------

Your help is highly required to resolve this problem !

Regards 

Jibiao Li

To view this discussion on the web visit https://groups.google.com/d/msgid/nwchem-forum/43936349-11fa-42cf-a0c4-dacb494ed037n%40googlegroups.com.

Edoardo Aprà

unread,
Jun 14, 2023, 9:00:18 PM6/14/23
to NWChem Forum
I have absolutely no idea of what is going. On top of this it is impossible to follow you installation attempts, since
1. You see to change your NWChem installation method every day
2. You don't provide any information on your installation settings (e.g environment variables used, compilers, MPI, etc ...)

Jibiao Li

unread,
Jun 14, 2023, 11:21:56 PM6/14/23
to nwchem...@googlegroups.com
Hi, Edoardo

I want to use libxc, so I recompiled the code using the following setting

export NWCHEM_TOP=/home/jibiaoli/codes/nwchem-7-2-0
export NWCHEM_TARGET=LINUX64
export ARMCI_NETWORK=MPI-PR
export USE_MPI=y
export USE_OPENMP=1
export MPI_LIB=/home/jibiaoli/codes/openmpi-4.0.0/lib/openmpi
export MPI_INCLUDE=/home/jibiaoli/codes/openmpi-4.0.0/include
export USE_LIBXC=1
export LIBXC_INCLUDE=/home/jibiaoli/codes/libxc-6.0.0/include
export LIBXC_LIB=/home/jibiaoli/codes/libxc-6.0.0/lib
export NWCHEM_MODULES="all python"
export BLASOPT="-mkl"
export LAPACK_LIB="-mkl"
export BLAS_SIZE=8

below is my environment setting:

export OMPI_MCA_btl_openib_warn_no_device_params_found=0
source /home/jibiaoli/intel/oneapi/setvars.sh intel64
export PATH=/home/jibiaoli/intel/oneapi/compiler/latest/linux/bin/intel64:$PATH
#export PATH=/home/jibiaoli/intel/oneapi/mpi/2021.3.0/bin/:$PATH
#export PATH=/home/jibiaoli/intel/oneapi/mpi/latest/bin/:$PATH
export PATH=/home/jibiaoli/codes/espresso-6.8/bin/:$PATH
export PATH=/home/jibiaoli/codes/xcrysden-1.5.60/:$PATH
export PATH=/home/jibiaoli/codes/espresso-6.8/GUI/PWgui:$PATH
export PATH=/home/jibiaoli/codes/nwchem-7-2-0/bin:$PATH
export PATH=/home/jibiaoli/codes/openmpi-4.0.0/bin:$PATH

export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mkl/2021.3.0/lib/intel64:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64:$LD_LIBRARY_PATH
#export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mpi/2021.3.0/lib:$LD_LIBRARY_PATH
#export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mpi/latest/lib:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/codes/openmpi-4.0.0/lib/openmpi:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/compiler/latest/linux/compiler/lib/intel64_lin:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/codes/nwchem-7-2-0/src/tools/install/lib:$LD_LIBRARY_PATH

Please consider what I should do to remove the errors reported in the last email.

Your help is much appreciated!

Regards

Jibiao Li

To view this discussion on the web visit https://groups.google.com/d/msgid/nwchem-forum/a1318e83-586b-4219-b741-d08c81b2fc29n%40googlegroups.com.

Edoardo Aprà

unread,
Jun 15, 2023, 2:48:07 PM6/15/23
to NWChem Forum
Your latest two postings are not consistent. You show the obsolete openmpi 4.0.0 version in your LD_LIBRARY_PATH, while it does not show up in the ldd output.
The ldd output shows the default openmpi libraries.

Jibiao Li

unread,
Jun 15, 2023, 11:20:54 PM6/15/23
to nwchem...@googlegroups.com
Hi, Edoardo,

Following your suggestion, I changed the openmpi to version 4.1.5, but the problem remains. What should I do next?

export NWCHEM_TOP=/home/jibiaoli/codes/nwchem-7-2-0
export NWCHEM_TARGET=LINUX64
export ARMCI_NETWORK=MPI-PR
export USE_MPI=y
export USE_OPENMP=1
export MPI_LIB=/home/jibiaoli/codes/openmpi-4.1.5/lib/openmpi
export MPI_INCLUDE=/home/jibiaoli/codes/openmpi-4.1.5/include
export USE_LIBXC=1
export NWCHEM_MODULES="all python"
export BLASOPT="-mkl"
export LAPACK_LIB="-mkl"
export BLAS_SIZE=8

Environment setting in the .bashrc file:

source /home/jibiaoli/intel/oneapi/setvars.sh intel64

export PATH=/home/jibiaoli/intel/oneapi/compiler/latest/linux/bin/intel64:$PATH
#export PATH=/home/jibiaoli/intel/oneapi/mpi/2021.3.0/bin/:$PATH
#export PATH=/home/jibiaoli/intel/oneapi/mpi/latest/bin/:$PATH
export PATH=/home/jibiaoli/codes/espresso-6.8/bin/:$PATH
export PATH=/home/jibiaoli/codes/xcrysden-1.5.60/:$PATH
export PATH=/home/jibiaoli/codes/espresso-6.8/GUI/PWgui:$PATH
export PATH=/home/jibiaoli/codes/nwchem-7-2-0/bin:$PATH
export PATH=/home/jibiaoli/codes/openmpi-4.1.5/bin:$PATH


export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mkl/2021.3.0/lib/intel64:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64:$LD_LIBRARY_PATH
#export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mpi/2021.3.0/lib:$LD_LIBRARY_PATH
#export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/mpi/latest/lib:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/codes/openmpi-4.1.5/lib/openmpi/:$LD_LIBRARY_PATH

export LD_LIBRARY_PATH=/home/jibiaoli/intel/oneapi/compiler/latest/linux/compiler/lib/intel64_lin:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/codes/nwchem-7-2-0/src/tools/install/lib:$LD_LIBRARY_PATH

The NWchem code 7.2 was successfully compiled using the above configurations

jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ mpirun -np 16 nwchem top.nwc>& top.out&
[1] 2624092

jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ more top.out

libi40iw-i40iw_ureg_mr: Failed to register memory
libi40iw-i40iw_ureg_mr: Failed to register memory
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source            
nwchem             00000000071E467A  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F7372DF33C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F737003D1C2  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F7372431854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F7372F19905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F7372F7383C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F7372F71A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F7372F2E4A1  MPI_Allgather         Unknown  Unknown
nwchem             0000000004836A7D  Unknown               Unknown  Unknown
nwchem             0000000004836DD5  Unknown               Unknown  Unknown
nwchem             000000000481FB30  Unknown               Unknown  Unknown
nwchem             000000000482041F  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F73724F80B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source            
nwchem             00000000071E467A  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F77E3AD63C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F77E0D201C2  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F77E3114854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F77E3BFC905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F77E3C5683C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F77E3C54A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F77E3C114A1  MPI_Allgather         Unknown  Unknown
nwchem             0000000004836A7D  Unknown               Unknown  Unknown
nwchem             0000000004836DD5  Unknown               Unknown  Unknown
nwchem             000000000481FB30  Unknown               Unknown  Unknown
nwchem             000000000482041F  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F77E31DB0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FC799E683C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FC799E64877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FC791A25A41  Unknown               Unknown  Unknown

librxm-fi.so       00007FC791A3DCDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FC791A3EAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FC7980B40DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FC7994A6854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FC799F8E905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FC799FF15B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FC799FA6730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FC79956D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FB5B76573C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FB5B7653877  pthread_spin_lock     Unknown  Unknown
libi40iw-rdmav25.  00007FB5AFF8DCE7  Unknown               Unknown  Unknown
libverbs-fi.so     00007FB5B40FDD80  Unknown               Unknown  Unknown
libverbs-fi.so     00007FB5B40FDFC5  Unknown               Unknown  Unknown
librxm-fi.so       00007FB5AF20E8A4  Unknown               Unknown  Unknown
librxm-fi.so       00007FB5AF20EA49  Unknown               Unknown  Unknown
librxm-fi.so       00007FB5AF226CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FB5AF227AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FB5B48A10DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FB5B6C95854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FB5B777D905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FB5B77E05B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FB5B7795730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FB5B6D5C0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FEECDA7B3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FEECDA77877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FEEC564FAB3  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FEECC0C70DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FEECD0B9854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FEECDBA1905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FEECDC045B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FEECDBB9730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FEECD1800B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F99F99883C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F99F153CA41  Unknown               Unknown  Unknown
librxm-fi.so       00007F99F1554CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F99F1555AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F99F2BDB0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F99F8FC6854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F99F9AAE905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F99F9B0883C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F99F9B06A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F99F9AC34A1  MPI_Allgather         Unknown  Unknown
nwchem             0000000004836A7D  Unknown               Unknown  Unknown
nwchem             0000000004836DD5  Unknown               Unknown  Unknown
nwchem             000000000481FB30  Unknown               Unknown  Unknown
nwchem             000000000482041F  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F99F908D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FEB138273C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FEB10A71186  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FEB12E65854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FEB1394D905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FEB139B05B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FEB13965730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FEB12F2C0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F5C3C5F93C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F5C381CB910  Unknown               Unknown  Unknown
librxm-fi.so       00007F5C381B1A41  Unknown               Unknown  Unknown
librxm-fi.so       00007F5C381C9CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F5C381CAAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F5C398430DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F5C3BC37854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F5C3C71F905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F5C3C77983C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F5C3C777A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F5C3C7344A1  MPI_Allgather         Unknown  Unknown
nwchem             0000000004836A7D  Unknown               Unknown  Unknown
nwchem             0000000004836DD5  Unknown               Unknown  Unknown
nwchem             000000000481FB30  Unknown               Unknown  Unknown
nwchem             000000000482041F  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F5C3BCFE0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FEFC90283C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FEFC9024877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FEFC4BE0A41  Unknown               Unknown  Unknown
librxm-fi.so       00007FEFC4BF8CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FEFC4BF9AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FEFC62720DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FEFC8666854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FEFC914E905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FEFC91B15B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FEFC9166730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FEFC872D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F862F93A3C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F862CB84095  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F862EF78854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F862FA60905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F862FAC35B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F862FA78730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F862F03F0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FA72D2123C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FA72D20E877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007FA728DE2CBE  Unknown               Unknown  Unknown
librxm-fi.so       00007FA728DE3AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FA72A45C0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FA72C850854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FA72D338905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FA72D39B5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FA72D350730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FA72C9170B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F42EF2E43C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F42E6E34EF8  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8797F243C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F8797F208B0  pthread_spin_unlo     Unknown  Unknown
librxm-fi.so       00007F878F91DAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F879516E0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F8797562854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F879804A905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F87980AD5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F8798062730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F87976290B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F03B79B13C0  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F03B42E8CAA  Unknown               Unknown  Unknown
libverbs-fi.so     00007F03B4457D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F03B4457FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F03AF53E8A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F03AF53EA49  Unknown               Unknown  Unknown
librxm-fi.so       00007F03AF556CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F03AF557AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F03B4BFB0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F03B6FEF854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007F03B4C48F15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007F03B7B0E3E5  MPI_Recv              Unknown  Unknown

nwchem             000000000482A6D5  Unknown               Unknown  Unknown
nwchem             000000000482DBFA  Unknown               Unknown  Unknown
nwchem             000000000482DCFE  Unknown               Unknown  Unknown
nwchem             00000000048203FD  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F03B70B60B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FE4F5C8D3C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FE4F5C89877  pthread_spin_lock     Unknown  Unknown
libverbs-fi.so     00007FE4EE72FE85  Unknown               Unknown  Unknown
librxm-fi.so       00007FE4ED8418A4  Unknown               Unknown  Unknown
librxm-fi.so       00007FE4ED841A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FE4ED859CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FE4ED85AAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FE4EEED30DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FE4F52CB854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FE4F5DB3905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FE4F5E165B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FE4F5DCB730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FE4F53920B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F728DC9E3C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFED5B5EA67  clock_gettime         Unknown  Unknown
libc-2.31.so       00007F728D45C0E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007F728585EDC1  Unknown               Unknown  Unknown
librxm-fi.so       00007F728585EE19  Unknown               Unknown  Unknown
librxm-fi.so       00007F72858588EA  Unknown               Unknown  Unknown
librxm-fi.so       00007F7285858A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F7285870CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F7285871AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F728C00F0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F728D2DC854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F728DDC4905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F728DE275B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F728DDDC730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F728D3A30B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:

  Process name: [[13034,1],11]
  Exit code:    174
--------------------------------------------------------------------------

jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$   ldd /home/jibiaoli/codes/nwchem-7-2-0/bin/nwchem
linux-vdso.so.1 (0x00007ffe1cfe7000)
libmkl_intel_ilp64.so.1 => /home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_ilp64.so.1 (0x00007f2d967af000)
libmkl_intel_thread.so.1 => /home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_thread.so.1 (0x00007f2d92e95000)
libmkl_core.so.1 => /home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so.1 (0x00007f2d8e824000)
libiomp5.so => /home/jibiaoli/intel/oneapi/compiler/latest/linux/compiler/lib/intel64_lin/libiomp5.so (0x00007f2d8e40f000)
libmpi_usempif08.so.40 => /lib/x86_64-linux-gnu/libmpi_usempif08.so.40 (0x00007f2d8e3b1000)
libmpi_usempi_ignore_tkr.so.40 => /lib/x86_64-linux-gnu/libmpi_usempi_ignore_tkr.so.40 (0x00007f2d8e3a5000)
libmpi_mpifh.so.40 => /lib/x86_64-linux-gnu/libmpi_mpifh.so.40 (0x00007f2d8e340000)
libmpi.so.40 => /lib/x86_64-linux-gnu/libmpi.so.40 (0x00007f2d8e21b000)
libhwloc.so.15 => /lib/x86_64-linux-gnu/libhwloc.so.15 (0x00007f2d8e1c8000)
libblas.so.3 => /lib/x86_64-linux-gnu/libblas.so.3 (0x00007f2d8e15b000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f2d8e151000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f2d8e12e000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f2d8dfdf000)
libmvec.so.1 => /lib/x86_64-linux-gnu/libmvec.so.1 (0x00007f2d8dfb3000)
libpython3.8.so.1.0 => /lib/x86_64-linux-gnu/libpython3.8.so.1.0 (0x00007f2d8da5b000)
libcrypt.so.1 => /lib/x86_64-linux-gnu/libcrypt.so.1 (0x00007f2d8da20000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f2d8da1a000)
libutil.so.1 => /lib/x86_64-linux-gnu/libutil.so.1 (0x00007f2d8da15000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f2d8d823000)
/lib64/ld-linux-x86-64.so.2 (0x00007f2d974ab000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f2d8d808000)
libopen-pal.so.40 => /lib/x86_64-linux-gnu/libopen-pal.so.40 (0x00007f2d8d758000)
libopen-rte.so.40 => /lib/x86_64-linux-gnu/libopen-rte.so.40 (0x00007f2d8d69e000)
libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 (0x00007f2d8d671000)
libltdl.so.7 => /lib/x86_64-linux-gnu/libltdl.so.7 (0x00007f2d8d666000)
libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1 (0x00007f2d8d638000)
libz.so.1 => /home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/oclfpga/host/linux64/lib/libz.so.1 (0x00007f2d8d419000)
libevent-2.1.so.7 => /lib/x86_64-linux-gnu/libevent-2.1.so.7 (0x00007f2d8d3c3000)
libevent_pthreads-2.1.so.7 => /lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7 (0x00007f2d8d3be000)

jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ env | grep LD_LIBRARY_PATH
LD_LIBRARY_PATH=/home/jibiaoli/codes/openmpi-4.1.5/lib/openmpi/:/home/jibiaoli/codes/nwchem-7-2-0/src/tools/install/lib:/home/jibiaoli/intel/oneapi/compiler/latest/linux/compiler/lib/intel64_lin:/home/jibiaoli/codes/openmpi-4.1.5/lib/openmpi/:/home/jibiaoli/intel/oneapi/mkl/latest/lib/intel64:/home/jibiaoli/intel/oneapi/mkl/2021.3.0/lib/intel64:/home/jibiaoli/intel/oneapi/tbb/2021.3.0/env/../lib/intel64/gcc4.8:/home/jibiaoli/intel/oneapi/mpi/2021.3.0//libfabric/lib:/home/jibiaoli/intel/oneapi/mpi/2021.3.0//lib/release:/home/jibiaoli/intel/oneapi/mpi/2021.3.0//lib:/home/jibiaoli/intel/oneapi/mkl/2021.3.0/lib/intel64:/home/jibiaoli/intel/oneapi/debugger/10.1.2/gdb/intel64/lib:/home/jibiaoli/intel/oneapi/debugger/10.1.2/libipt/intel64/lib:/home/jibiaoli/intel/oneapi/debugger/10.1.2/dep/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/x64:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/emu:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/oclfpga/host/linux64/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/lib/oclfpga/linux64/lib:/home/jibiaoli/intel/oneapi/compiler/2021.3.0/linux/compiler/lib/intel64_lin


jibiaoli@ubuntue:~/calc/CRR/cluster_mgga$ mpirun -mca pml_base_verbose 100 -mca btl ^openib,ofi  -mca btl_base_verbose 100 -np 16 /home/jibiaoli/codes/nwchem-7-2-0/bin/nwchem top.nwc
[ubuntue:2624230] mca: base: components_register: registering framework btl components
[ubuntue:2624230] mca: base: components_register: found loaded component self
[ubuntue:2624230] mca: base: components_register: component self register function successful
[ubuntue:2624230] mca: base: components_register: found loaded component sm
[ubuntue:2624230] mca: base: components_register: found loaded component vader
[ubuntue:2624227] mca: base: components_register: registering framework btl components
[ubuntue:2624227] mca: base: components_register: found loaded component self
[ubuntue:2624227] mca: base: components_register: component self register function successful
[ubuntue:2624227] mca: base: components_register: found loaded component sm
[ubuntue:2624227] mca: base: components_register: found loaded component vader
[ubuntue:2624230] mca: base: components_register: component vader register function successful
[ubuntue:2624230] mca: base: components_register: found loaded component tcp
[ubuntue:2624230] mca: base: components_register: component tcp register function successful
[ubuntue:2624230] mca: base: components_open: opening btl components
[ubuntue:2624230] mca: base: components_open: found loaded component self
[ubuntue:2624230] mca: base: components_open: component self open function successful
[ubuntue:2624230] mca: base: components_open: found loaded component vader
[ubuntue:2624230] mca: base: components_open: component vader open function successful
[ubuntue:2624230] mca: base: components_open: found loaded component tcp
[ubuntue:2624230] mca: base: components_open: component tcp open function successful
[ubuntue:2624230] select: initializing btl component self
[ubuntue:2624230] select: init of component self returned success
[ubuntue:2624230] select: initializing btl component vader
[ubuntue:2624227] mca: base: components_register: component vader register function successful
[ubuntue:2624227] mca: base: components_register: found loaded component tcp
[ubuntue:2624227] mca: base: components_register: component tcp register function successful
[ubuntue:2624227] mca: base: components_open: opening btl components
[ubuntue:2624227] mca: base: components_open: found loaded component self
[ubuntue:2624227] mca: base: components_open: component self open function successful
[ubuntue:2624227] mca: base: components_open: found loaded component vader
[ubuntue:2624227] mca: base: components_open: component vader open function successful
[ubuntue:2624227] mca: base: components_open: found loaded component tcp
[ubuntue:2624227] mca: base: components_open: component tcp open function successful
[ubuntue:2624227] select: initializing btl component self
[ubuntue:2624227] select: init of component self returned success
[ubuntue:2624227] select: initializing btl component vader
[ubuntue:2624230] select: init of component vader returned success
[ubuntue:2624230] select: initializing btl component tcp
[ubuntue:2624230] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624230] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624230] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624230] btl:tcp: Successfully bound to AF_INET port 1024
[ubuntue:2624230] btl:tcp: my listening v4 socket is 0.0.0.0:1024
[ubuntue:2624230] btl:tcp: examining interface enp97s0f2
[ubuntue:2624230] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624230] select: init of component tcp returned success
[ubuntue:2624225] mca: base: components_register: registering framework btl components
[ubuntue:2624225] mca: base: components_register: found loaded component self
[ubuntue:2624227] select: init of component vader returned success
[ubuntue:2624227] select: initializing btl component tcp
[ubuntue:2624225] mca: base: components_register: component self register function successful
[ubuntue:2624225] mca: base: components_register: found loaded component sm
[ubuntue:2624225] mca: base: components_register: found loaded component vader
[ubuntue:2624227] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624227] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624229] mca: base: components_register: registering framework btl components
[ubuntue:2624229] mca: base: components_register: found loaded component self
[ubuntue:2624227] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624227] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624227] btl:tcp: Successfully bound to AF_INET port 1025
[ubuntue:2624227] btl:tcp: my listening v4 socket is 0.0.0.0:1025
[ubuntue:2624227] btl:tcp: examining interface enp97s0f2
[ubuntue:2624227] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624227] select: init of component tcp returned success
[ubuntue:2624225] mca: base: components_register: component vader register function successful
[ubuntue:2624225] mca: base: components_register: found loaded component tcp
[ubuntue:2624229] mca: base: components_register: component self register function successful
[ubuntue:2624229] mca: base: components_register: found loaded component sm
[ubuntue:2624229] mca: base: components_register: found loaded component vader
[ubuntue:2624230] mca: base: components_register: registering framework pml components
[ubuntue:2624230] mca: base: components_register: found loaded component v
[ubuntue:2624230] mca: base: components_register: component v register function successful
[ubuntue:2624225] mca: base: components_register: component tcp register function successful
[ubuntue:2624225] mca: base: components_open: opening btl components
[ubuntue:2624225] mca: base: components_open: found loaded component self
[ubuntue:2624225] mca: base: components_open: component self open function successful
[ubuntue:2624225] mca: base: components_open: found loaded component vader
[ubuntue:2624225] mca: base: components_open: component vader open function successful
[ubuntue:2624225] mca: base: components_open: found loaded component tcp
[ubuntue:2624225] mca: base: components_open: component tcp open function successful
[ubuntue:2624225] select: initializing btl component self
[ubuntue:2624225] select: init of component self returned success
[ubuntue:2624225] select: initializing btl component vader
[ubuntue:2624230] mca: base: components_register: found loaded component monitoring
[ubuntue:2624230] mca: base: components_register: component monitoring register function successful
[ubuntue:2624230] mca: base: components_register: found loaded component ob1
[ubuntue:2624229] mca: base: components_register: component vader register function successful
[ubuntue:2624229] mca: base: components_register: found loaded component tcp
[ubuntue:2624230] mca: base: components_register: component ob1 register function successful
[ubuntue:2624230] mca: base: components_register: found loaded component cm
[ubuntue:2624230] mca: base: components_register: component cm register function successful
[ubuntue:2624230] mca: base: components_open: opening pml components
[ubuntue:2624230] mca: base: components_open: found loaded component v
[ubuntue:2624229] mca: base: components_register: component tcp register function successful
[ubuntue:2624229] mca: base: components_open: opening btl components
[ubuntue:2624225] select: init of component vader returned success
[ubuntue:2624225] select: initializing btl component tcp
[ubuntue:2624229] mca: base: components_open: found loaded component self
[ubuntue:2624229] mca: base: components_open: component self open function successful
[ubuntue:2624229] mca: base: components_open: found loaded component vader
[ubuntue:2624229] mca: base: components_open: component vader open function successful
[ubuntue:2624229] mca: base: components_open: found loaded component tcp
[ubuntue:2624229] mca: base: components_open: component tcp open function successful
[ubuntue:2624229] select: initializing btl component self
[ubuntue:2624229] select: init of component self returned success
[ubuntue:2624229] select: initializing btl component vader
[ubuntue:2624225] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624225] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624225] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624225] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624225] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624225] btl:tcp: Successfully bound to AF_INET port 1026
[ubuntue:2624225] btl:tcp: my listening v4 socket is 0.0.0.0:1026
[ubuntue:2624225] btl:tcp: examining interface enp97s0f2
[ubuntue:2624225] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624230] mca: base: components_open: component v open function successful
[ubuntue:2624230] mca: base: components_open: found loaded component monitoring
[ubuntue:2624230] mca: base: components_open: component monitoring open function successful
[ubuntue:2624230] mca: base: components_open: found loaded component ob1
[ubuntue:2624230] mca: base: components_open: component ob1 open function successful
[ubuntue:2624230] mca: base: components_open: found loaded component cm
[ubuntue:2624225] select: init of component tcp returned success
[ubuntue:2624229] select: init of component vader returned success
[ubuntue:2624229] select: initializing btl component tcp
[ubuntue:2624229] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624229] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624227] mca: base: components_register: registering framework pml components
[ubuntue:2624227] mca: base: components_register: found loaded component v
[ubuntue:2624227] mca: base: components_register: component v register function successful
[ubuntue:2624227] mca: base: components_register: found loaded component monitoring
[ubuntue:2624229] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624229] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624229] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624229] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624229] btl:tcp: Successfully bound to AF_INET port 1027
[ubuntue:2624229] btl:tcp: my listening v4 socket is 0.0.0.0:1027
[ubuntue:2624229] btl:tcp: examining interface enp97s0f2
[ubuntue:2624229] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624227] mca: base: components_register: component monitoring register function successful
[ubuntue:2624227] mca: base: components_register: found loaded component ob1
[ubuntue:2624229] select: init of component tcp returned success
[ubuntue:2624227] mca: base: components_register: component ob1 register function successful
[ubuntue:2624227] mca: base: components_register: found loaded component cm
[ubuntue:2624227] mca: base: components_register: component cm register function successful
[ubuntue:2624227] mca: base: components_open: opening pml components
[ubuntue:2624227] mca: base: components_open: found loaded component v
[ubuntue:2624223] mca: base: components_register: registering framework btl components
[ubuntue:2624223] mca: base: components_register: found loaded component self
[ubuntue:2624225] mca: base: components_register: registering framework pml components
[ubuntue:2624225] mca: base: components_register: found loaded component v
[ubuntue:2624223] mca: base: components_register: component self register function successful
[ubuntue:2624223] mca: base: components_register: found loaded component sm
[ubuntue:2624223] mca: base: components_register: found loaded component vader
[ubuntue:2624225] mca: base: components_register: component v register function successful
[ubuntue:2624225] mca: base: components_register: found loaded component monitoring
[ubuntue:2624225] mca: base: components_register: component monitoring register function successful
[ubuntue:2624225] mca: base: components_register: found loaded component ob1
[ubuntue:2624227] mca: base: components_open: component v open function successful
[ubuntue:2624227] mca: base: components_open: found loaded component monitoring
[ubuntue:2624227] mca: base: components_open: component monitoring open function successful
[ubuntue:2624227] mca: base: components_open: found loaded component ob1
[ubuntue:2624227] mca: base: components_open: component ob1 open function successful
[ubuntue:2624227] mca: base: components_open: found loaded component cm
[ubuntue:2624225] mca: base: components_register: component ob1 register function successful
[ubuntue:2624225] mca: base: components_register: found loaded component cm
[ubuntue:2624225] mca: base: components_register: component cm register function successful
[ubuntue:2624223] mca: base: components_register: component vader register function successful
[ubuntue:2624223] mca: base: components_register: found loaded component tcp
[ubuntue:2624221] mca: base: components_register: registering framework btl components
[ubuntue:2624221] mca: base: components_register: found loaded component self
[ubuntue:2624225] mca: base: components_open: opening pml components
[ubuntue:2624225] mca: base: components_open: found loaded component v
[ubuntue:2624229] mca: base: components_register: registering framework pml components
[ubuntue:2624229] mca: base: components_register: found loaded component v
[ubuntue:2624229] mca: base: components_register: component v register function successful
[ubuntue:2624221] mca: base: components_register: component self register function successful
[ubuntue:2624221] mca: base: components_register: found loaded component sm
[ubuntue:2624221] mca: base: components_register: found loaded component vader
[ubuntue:2624223] mca: base: components_register: component tcp register function successful
[ubuntue:2624223] mca: base: components_open: opening btl components
[ubuntue:2624223] mca: base: components_open: found loaded component self
[ubuntue:2624223] mca: base: components_open: component self open function successful
[ubuntue:2624223] mca: base: components_open: found loaded component vader
[ubuntue:2624223] mca: base: components_open: component vader open function successful
[ubuntue:2624223] mca: base: components_open: found loaded component tcp
[ubuntue:2624223] mca: base: components_open: component tcp open function successful
[ubuntue:2624223] select: initializing btl component self
[ubuntue:2624229] mca: base: components_register: found loaded component monitoring
[ubuntue:2624223] select: init of component self returned success
[ubuntue:2624223] select: initializing btl component vader
[ubuntue:2624229] mca: base: components_register: component monitoring register function successful
[ubuntue:2624229] mca: base: components_register: found loaded component ob1
[ubuntue:2624229] mca: base: components_register: component ob1 register function successful
[ubuntue:2624229] mca: base: components_register: found loaded component cm
[ubuntue:2624225] mca: base: components_open: component v open function successful
[ubuntue:2624225] mca: base: components_open: found loaded component monitoring
[ubuntue:2624225] mca: base: components_open: component monitoring open function successful
[ubuntue:2624225] mca: base: components_open: found loaded component ob1
[ubuntue:2624225] mca: base: components_open: component ob1 open function successful
[ubuntue:2624225] mca: base: components_open: found loaded component cm
[ubuntue:2624229] mca: base: components_register: component cm register function successful
[ubuntue:2624229] mca: base: components_open: opening pml components
[ubuntue:2624229] mca: base: components_open: found loaded component v
[ubuntue:2624223] select: init of component vader returned success
[ubuntue:2624223] select: initializing btl component tcp
[ubuntue:2624221] mca: base: components_register: component vader register function successful
[ubuntue:2624221] mca: base: components_register: found loaded component tcp
[ubuntue:2624223] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624223] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624223] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624223] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624223] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624223] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624223] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624223] btl:tcp: Successfully bound to AF_INET port 1028
[ubuntue:2624229] mca: base: components_open: component v open function successful
[ubuntue:2624229] mca: base: components_open: found loaded component monitoring
[ubuntue:2624229] mca: base: components_open: component monitoring open function successful
[ubuntue:2624229] mca: base: components_open: found loaded component ob1
[ubuntue:2624229] mca: base: components_open: component ob1 open function successful
[ubuntue:2624229] mca: base: components_open: found loaded component cm
[ubuntue:2624223] btl:tcp: my listening v4 socket is 0.0.0.0:1028
[ubuntue:2624223] btl:tcp: examining interface enp97s0f2
[ubuntue:2624223] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624223] select: init of component tcp returned success
[ubuntue:2624221] mca: base: components_register: component tcp register function successful
[ubuntue:2624221] mca: base: components_open: opening btl components
[ubuntue:2624221] mca: base: components_open: found loaded component self
[ubuntue:2624232] mca: base: components_register: registering framework btl components
[ubuntue:2624232] mca: base: components_register: found loaded component self
[ubuntue:2624221] mca: base: components_open: component self open function successful
[ubuntue:2624221] mca: base: components_open: found loaded component vader
[ubuntue:2624221] mca: base: components_open: component vader open function successful
[ubuntue:2624221] mca: base: components_open: found loaded component tcp
[ubuntue:2624221] mca: base: components_open: component tcp open function successful
[ubuntue:2624221] select: initializing btl component self
[ubuntue:2624221] select: init of component self returned success
[ubuntue:2624221] select: initializing btl component vader
[ubuntue:2624232] mca: base: components_register: component self register function successful
[ubuntue:2624232] mca: base: components_register: found loaded component sm
[ubuntue:2624232] mca: base: components_register: found loaded component vader
[ubuntue:2624232] mca: base: components_register: component vader register function successful
[ubuntue:2624232] mca: base: components_register: found loaded component tcp
[ubuntue:2624223] mca: base: components_register: registering framework pml components
[ubuntue:2624223] mca: base: components_register: found loaded component v
[ubuntue:2624223] mca: base: components_register: component v register function successful
[ubuntue:2624221] select: init of component vader returned success
[ubuntue:2624221] select: initializing btl component tcp
[ubuntue:2624223] mca: base: components_register: found loaded component monitoring
[ubuntue:2624223] mca: base: components_register: component monitoring register function successful
[ubuntue:2624223] mca: base: components_register: found loaded component ob1
[ubuntue:2624232] mca: base: components_register: component tcp register function successful
[ubuntue:2624221] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624221] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624232] mca: base: components_open: opening btl components
[ubuntue:2624232] mca: base: components_open: found loaded component self
[ubuntue:2624232] mca: base: components_open: component self open function successful
[ubuntue:2624232] mca: base: components_open: found loaded component vader
[ubuntue:2624232] mca: base: components_open: component vader open function successful
[ubuntue:2624232] mca: base: components_open: found loaded component tcp
[ubuntue:2624232] mca: base: components_open: component tcp open function successful
[ubuntue:2624232] select: initializing btl component self
[ubuntue:2624232] select: init of component self returned success
[ubuntue:2624232] select: initializing btl component vader
[ubuntue:2624223] mca: base: components_register: component ob1 register function successful
[ubuntue:2624223] mca: base: components_register: found loaded component cm
[ubuntue:2624223] mca: base: components_register: component cm register function successful
[ubuntue:2624221] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624221] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624221] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624221] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624221] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624221] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624221] btl:tcp: Successfully bound to AF_INET port 1029
[ubuntue:2624223] mca: base: components_open: opening pml components
[ubuntue:2624223] mca: base: components_open: found loaded component v
[ubuntue:2624221] btl:tcp: my listening v4 socket is 0.0.0.0:1029
[ubuntue:2624221] btl:tcp: examining interface enp97s0f2
[ubuntue:2624221] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624232] select: init of component vader returned success
[ubuntue:2624232] select: initializing btl component tcp
[ubuntue:2624232] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624232] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624221] select: init of component tcp returned success
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624232] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624232] btl:tcp: Successfully bound to AF_INET port 1030
[ubuntue:2624232] btl:tcp: my listening v4 socket is 0.0.0.0:1030
[ubuntue:2624232] btl:tcp: examining interface enp97s0f2
[ubuntue:2624232] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624232] select: init of component tcp returned success
[ubuntue:2624223] mca: base: components_open: component v open function successful
[ubuntue:2624223] mca: base: components_open: found loaded component monitoring
[ubuntue:2624223] mca: base: components_open: component monitoring open function successful
[ubuntue:2624223] mca: base: components_open: found loaded component ob1
[ubuntue:2624223] mca: base: components_open: component ob1 open function successful
[ubuntue:2624223] mca: base: components_open: found loaded component cm
[ubuntue:2624222] mca: base: components_register: registering framework btl components
[ubuntue:2624222] mca: base: components_register: found loaded component self
[ubuntue:2624224] mca: base: components_register: registering framework btl components
[ubuntue:2624224] mca: base: components_register: found loaded component self
[ubuntue:2624232] mca: base: components_register: registering framework pml components
[ubuntue:2624232] mca: base: components_register: found loaded component v
[ubuntue:2624232] mca: base: components_register: component v register function successful
[ubuntue:2624232] mca: base: components_register: found loaded component monitoring
[ubuntue:2624222] mca: base: components_register: component self register function successful
[ubuntue:2624222] mca: base: components_register: found loaded component sm
[ubuntue:2624222] mca: base: components_register: found loaded component vader
[ubuntue:2624224] mca: base: components_register: component self register function successful
[ubuntue:2624234] mca: base: components_register: registering framework btl components
[ubuntue:2624234] mca: base: components_register: found loaded component self
[ubuntue:2624232] mca: base: components_register: component monitoring register function successful
[ubuntue:2624232] mca: base: components_register: found loaded component ob1
[ubuntue:2624232] mca: base: components_register: component ob1 register function successful
[ubuntue:2624232] mca: base: components_register: found loaded component cm
[ubuntue:2624234] mca: base: components_register: component self register function successful
[ubuntue:2624234] mca: base: components_register: found loaded component sm
[ubuntue:2624234] mca: base: components_register: found loaded component vader
[ubuntue:2624224] mca: base: components_register: found loaded component sm
[ubuntue:2624224] mca: base: components_register: found loaded component vader
[ubuntue:2624232] mca: base: components_register: component cm register function successful
[ubuntue:2624232] mca: base: components_open: opening pml components
[ubuntue:2624232] mca: base: components_open: found loaded component v
[ubuntue:2624234] mca: base: components_register: component vader register function successful
[ubuntue:2624234] mca: base: components_register: found loaded component tcp
[ubuntue:2624222] mca: base: components_register: component vader register function successful
[ubuntue:2624234] mca: base: components_register: component tcp register function successful
[ubuntue:2624234] mca: base: components_open: opening btl components
[ubuntue:2624234] mca: base: components_open: found loaded component self
[ubuntue:2624234] mca: base: components_open: component self open function successful
[ubuntue:2624234] mca: base: components_open: found loaded component vader
[ubuntue:2624234] mca: base: components_open: component vader open function successful
[ubuntue:2624234] mca: base: components_open: found loaded component tcp
[ubuntue:2624234] mca: base: components_open: component tcp open function successful
[ubuntue:2624234] select: initializing btl component self
[ubuntue:2624234] select: init of component self returned success
[ubuntue:2624234] select: initializing btl component vader
[ubuntue:2624221] mca: base: components_register: registering framework pml components
[ubuntue:2624221] mca: base: components_register: found loaded component v
[ubuntue:2624221] mca: base: components_register: component v register function successful
[ubuntue:2624221] mca: base: components_register: found loaded component monitoring
[ubuntue:2624222] mca: base: components_register: found loaded component tcp
[ubuntue:2624224] mca: base: components_register: component vader register function successful
[ubuntue:2624224] mca: base: components_register: found loaded component tcp
[ubuntue:2624232] mca: base: components_open: component v open function successful
[ubuntue:2624232] mca: base: components_open: found loaded component monitoring
[ubuntue:2624232] mca: base: components_open: component monitoring open function successful
[ubuntue:2624232] mca: base: components_open: found loaded component ob1
[ubuntue:2624232] mca: base: components_open: component ob1 open function successful
[ubuntue:2624232] mca: base: components_open: found loaded component cm
[ubuntue:2624234] select: init of component vader returned success
[ubuntue:2624234] select: initializing btl component tcp
[ubuntue:2624221] mca: base: components_register: component monitoring register function successful
[ubuntue:2624221] mca: base: components_register: found loaded component ob1
[ubuntue:2624234] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624234] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624234] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624234] btl:tcp: Successfully bound to AF_INET port 1031
[ubuntue:2624234] btl:tcp: my listening v4 socket is 0.0.0.0:1031
[ubuntue:2624234] btl:tcp: examining interface enp97s0f2
[ubuntue:2624234] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624234] select: init of component tcp returned success
[ubuntue:2624222] mca: base: components_register: component tcp register function successful
[ubuntue:2624222] mca: base: components_open: opening btl components
[ubuntue:2624222] mca: base: components_open: found loaded component self
[ubuntue:2624222] mca: base: components_open: component self open function successful
[ubuntue:2624222] mca: base: components_open: found loaded component vader
[ubuntue:2624222] mca: base: components_open: component vader open function successful
[ubuntue:2624222] mca: base: components_open: found loaded component tcp
[ubuntue:2624221] mca: base: components_register: component ob1 register function successful
[ubuntue:2624221] mca: base: components_register: found loaded component cm
[ubuntue:2624221] mca: base: components_register: component cm register function successful
[ubuntue:2624224] mca: base: components_register: component tcp register function successful
[ubuntue:2624224] mca: base: components_open: opening btl components
[ubuntue:2624224] mca: base: components_open: found loaded component self
[ubuntue:2624222] mca: base: components_open: component tcp open function successful
[ubuntue:2624222] select: initializing btl component self
[ubuntue:2624222] select: init of component self returned success
[ubuntue:2624222] select: initializing btl component vader
[ubuntue:2624224] mca: base: components_open: component self open function successful
[ubuntue:2624224] mca: base: components_open: found loaded component vader
[ubuntue:2624224] mca: base: components_open: component vader open function successful
[ubuntue:2624224] mca: base: components_open: found loaded component tcp
[ubuntue:2624224] mca: base: components_open: component tcp open function successful
[ubuntue:2624224] select: initializing btl component self
[ubuntue:2624224] select: init of component self returned success
[ubuntue:2624224] select: initializing btl component vader
[ubuntue:2624221] mca: base: components_open: opening pml components
[ubuntue:2624221] mca: base: components_open: found loaded component v
[ubuntue:2624222] select: init of component vader returned success
[ubuntue:2624222] select: initializing btl component tcp
[ubuntue:2624234] mca: base: components_register: registering framework pml components
[ubuntue:2624234] mca: base: components_register: found loaded component v
[ubuntue:2624234] mca: base: components_register: component v register function successful
[ubuntue:2624234] mca: base: components_register: found loaded component monitoring
[ubuntue:2624224] select: init of component vader returned success
[ubuntue:2624224] select: initializing btl component tcp
[ubuntue:2624234] mca: base: components_register: component monitoring register function successful
[ubuntue:2624234] mca: base: components_register: found loaded component ob1
[ubuntue:2624221] mca: base: components_open: component v open function successful
[ubuntue:2624221] mca: base: components_open: found loaded component monitoring
[ubuntue:2624221] mca: base: components_open: component monitoring open function successful
[ubuntue:2624221] mca: base: components_open: found loaded component ob1
[ubuntue:2624221] mca: base: components_open: component ob1 open function successful
[ubuntue:2624221] mca: base: components_open: found loaded component cm
[ubuntue:2624226] mca: base: components_register: registering framework btl components
[ubuntue:2624226] mca: base: components_register: found loaded component self
[ubuntue:2624234] mca: base: components_register: component ob1 register function successful
[ubuntue:2624234] mca: base: components_register: found loaded component cm
[ubuntue:2624234] mca: base: components_register: component cm register function successful
[ubuntue:2624234] mca: base: components_open: opening pml components
[ubuntue:2624234] mca: base: components_open: found loaded component v
[ubuntue:2624226] mca: base: components_register: component self register function successful
[ubuntue:2624226] mca: base: components_register: found loaded component sm
[ubuntue:2624226] mca: base: components_register: found loaded component vader
[ubuntue:2624222] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624222] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624224] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624224] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624222] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624222] btl:tcp: Successfully bound to AF_INET port 1032
[ubuntue:2624222] btl:tcp: my listening v4 socket is 0.0.0.0:1032
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624224] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624224] btl:tcp: Successfully bound to AF_INET port 1033
[ubuntue:2624224] btl:tcp: my listening v4 socket is 0.0.0.0:1033
[ubuntue:2624224] btl:tcp: examining interface enp97s0f2
[ubuntue:2624224] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624226] mca: base: components_register: component vader register function successful
[ubuntue:2624226] mca: base: components_register: found loaded component tcp
[ubuntue:2624234] mca: base: components_open: component v open function successful
[ubuntue:2624234] mca: base: components_open: found loaded component monitoring
[ubuntue:2624234] mca: base: components_open: component monitoring open function successful
[ubuntue:2624234] mca: base: components_open: found loaded component ob1
[ubuntue:2624234] mca: base: components_open: component ob1 open function successful
[ubuntue:2624234] mca: base: components_open: found loaded component cm
[ubuntue:2624222] btl:tcp: examining interface enp97s0f2
[ubuntue:2624222] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624222] select: init of component tcp returned success
[ubuntue:2624224] select: init of component tcp returned success
[ubuntue:2624226] mca: base: components_register: component tcp register function successful
[ubuntue:2624226] mca: base: components_open: opening btl components
[ubuntue:2624226] mca: base: components_open: found loaded component self
[ubuntue:2624226] mca: base: components_open: component self open function successful
[ubuntue:2624226] mca: base: components_open: found loaded component vader
[ubuntue:2624226] mca: base: components_open: component vader open function successful
[ubuntue:2624226] mca: base: components_open: found loaded component tcp
[ubuntue:2624226] mca: base: components_open: component tcp open function successful
[ubuntue:2624226] select: initializing btl component self
[ubuntue:2624226] select: init of component self returned success
[ubuntue:2624226] select: initializing btl component vader
[ubuntue:2624226] select: init of component vader returned success
[ubuntue:2624226] select: initializing btl component tcp
[ubuntue:2624226] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624226] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624226] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:2624226] btl:tcp: Successfully bound to AF_INET port 1034
[ubuntue:2624226] btl:tcp: my listening v4 socket is 0.0.0.0:1034
[ubuntue:2624226] btl:tcp: examining interface enp97s0f2
[ubuntue:2624226] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624226] select: init of component tcp returned success
[ubuntue:2624222] mca: base: components_register: registering framework pml components
[ubuntue:2624222] mca: base: components_register: found loaded component v
[ubuntue:2624224] mca: base: components_register: registering framework pml components
[ubuntue:2624224] mca: base: components_register: found loaded component v
[ubuntue:2624226] mca: base: components_register: registering framework pml components
[ubuntue:2624226] mca: base: components_register: found loaded component v
[ubuntue:2624226] mca: base: components_register: component v register function successful
[ubuntue:2624222] mca: base: components_register: component v register function successful
[ubuntue:2624222] mca: base: components_register: found loaded component monitoring
[ubuntue:2624226] mca: base: components_register: found loaded component monitoring
[ubuntue:2624224] mca: base: components_register: component v register function successful
[ubuntue:2624224] mca: base: components_register: found loaded component monitoring
[ubuntue:2624226] mca: base: components_register: component monitoring register function successful
[ubuntue:2624226] mca: base: components_register: found loaded component ob1
[ubuntue:2624222] mca: base: components_register: component monitoring register function successful
[ubuntue:2624226] mca: base: components_register: component ob1 register function successful
[ubuntue:2624226] mca: base: components_register: found loaded component cm
[ubuntue:2624226] mca: base: components_register: component cm register function successful
[ubuntue:2624222] mca: base: components_register: found loaded component ob1
[ubuntue:2624224] mca: base: components_register: component monitoring register function successful
[ubuntue:2624224] mca: base: components_register: found loaded component ob1
[ubuntue:2624226] mca: base: components_open: opening pml components
[ubuntue:2624226] mca: base: components_open: found loaded component v
[ubuntue:2624222] mca: base: components_register: component ob1 register function successful
[ubuntue:2624222] mca: base: components_register: found loaded component cm
[ubuntue:2624224] mca: base: components_register: component ob1 register function successful
[ubuntue:2624224] mca: base: components_register: found loaded component cm
[ubuntue:2624222] mca: base: components_register: component cm register function successful
[ubuntue:2624222] mca: base: components_open: opening pml components
[ubuntue:2624222] mca: base: components_open: found loaded component v
[ubuntue:2624224] mca: base: components_register: component cm register function successful
[ubuntue:2624224] mca: base: components_open: opening pml components
[ubuntue:2624224] mca: base: components_open: found loaded component v
[ubuntue:2624226] mca: base: components_open: component v open function successful
[ubuntue:2624226] mca: base: components_open: found loaded component monitoring
[ubuntue:2624226] mca: base: components_open: component monitoring open function successful
[ubuntue:2624226] mca: base: components_open: found loaded component ob1
[ubuntue:2624226] mca: base: components_open: component ob1 open function successful
[ubuntue:2624226] mca: base: components_open: found loaded component cm
[ubuntue:2624222] mca: base: components_open: component v open function successful
[ubuntue:2624222] mca: base: components_open: found loaded component monitoring
[ubuntue:2624222] mca: base: components_open: component monitoring open function successful
[ubuntue:2624222] mca: base: components_open: found loaded component ob1
[ubuntue:2624222] mca: base: components_open: component ob1 open function successful
[ubuntue:2624222] mca: base: components_open: found loaded component cm
[ubuntue:2624224] mca: base: components_open: component v open function successful
[ubuntue:2624224] mca: base: components_open: found loaded component monitoring
[ubuntue:2624224] mca: base: components_open: component monitoring open function successful
[ubuntue:2624224] mca: base: components_open: found loaded component ob1
[ubuntue:2624224] mca: base: components_open: component ob1 open function successful
[ubuntue:2624224] mca: base: components_open: found loaded component cm
[ubuntue:2624228] mca: base: components_register: registering framework btl components
[ubuntue:2624228] mca: base: components_register: found loaded component self
[ubuntue:2624228] mca: base: components_register: component self register function successful
[ubuntue:2624228] mca: base: components_register: found loaded component sm
[ubuntue:2624228] mca: base: components_register: found loaded component vader
[ubuntue:2624228] mca: base: components_register: component vader register function successful
[ubuntue:2624228] mca: base: components_register: found loaded component tcp
[ubuntue:2624228] mca: base: components_register: component tcp register function successful
[ubuntue:2624228] mca: base: components_open: opening btl components
[ubuntue:2624228] mca: base: components_open: found loaded component self
[ubuntue:2624228] mca: base: components_open: component self open function successful
[ubuntue:2624228] mca: base: components_open: found loaded component vader
[ubuntue:2624228] mca: base: components_open: component vader open function successful
[ubuntue:2624228] mca: base: components_open: found loaded component tcp
[ubuntue:2624228] mca: base: components_open: component tcp open function successful
[ubuntue:2624228] select: initializing btl component self
[ubuntue:2624228] select: init of component self returned success
[ubuntue:2624228] select: initializing btl component vader
[ubuntue:2624228] select: init of component vader returned success
[ubuntue:2624228] select: initializing btl component tcp
[ubuntue:2624228] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624228] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:2624228] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:2624228] btl:tcp: Successfully bound to AF_INET port 1035
[ubuntue:2624228] btl:tcp: my listening v4 socket is 0.0.0.0:1035
[ubuntue:2624228] btl:tcp: examining interface enp97s0f2
[ubuntue:2624228] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624228] select: init of component tcp returned success
[ubuntue:2624228] mca: base: components_register: registering framework pml components
[ubuntue:2624228] mca: base: components_register: found loaded component v
[ubuntue:2624228] mca: base: components_register: component v register function successful
[ubuntue:2624228] mca: base: components_register: found loaded component monitoring
[ubuntue:2624228] mca: base: components_register: component monitoring register function successful
[ubuntue:2624228] mca: base: components_register: found loaded component ob1
[ubuntue:2624228] mca: base: components_register: component ob1 register function successful
[ubuntue:2624228] mca: base: components_register: found loaded component cm
[ubuntue:2624228] mca: base: components_register: component cm register function successful
[ubuntue:2624228] mca: base: components_open: opening pml components
[ubuntue:2624228] mca: base: components_open: found loaded component v
[ubuntue:2624228] mca: base: components_open: component v open function successful
[ubuntue:2624228] mca: base: components_open: found loaded component monitoring
[ubuntue:2624228] mca: base: components_open: component monitoring open function successful
[ubuntue:2624228] mca: base: components_open: found loaded component ob1
[ubuntue:2624228] mca: base: components_open: component ob1 open function successful
[ubuntue:2624228] mca: base: components_open: found loaded component cm
[ubuntue:2624238] mca: base: components_register: registering framework btl components
[ubuntue:2624238] mca: base: components_register: found loaded component self
[ubuntue:2624238] mca: base: components_register: component self register function successful
[ubuntue:2624238] mca: base: components_register: found loaded component sm
[ubuntue:2624238] mca: base: components_register: found loaded component vader
[ubuntue:2624238] mca: base: components_register: component vader register function successful
[ubuntue:2624238] mca: base: components_register: found loaded component tcp
[ubuntue:2624238] mca: base: components_register: component tcp register function successful
[ubuntue:2624238] mca: base: components_open: opening btl components
[ubuntue:2624238] mca: base: components_open: found loaded component self
[ubuntue:2624238] mca: base: components_open: component self open function successful
[ubuntue:2624238] mca: base: components_open: found loaded component vader
[ubuntue:2624238] mca: base: components_open: component vader open function successful
[ubuntue:2624238] mca: base: components_open: found loaded component tcp
[ubuntue:2624238] mca: base: components_open: component tcp open function successful
[ubuntue:2624238] select: initializing btl component self
[ubuntue:2624238] select: init of component self returned success
[ubuntue:2624238] select: initializing btl component vader
[ubuntue:2624238] select: init of component vader returned success
[ubuntue:2624238] select: initializing btl component tcp
[ubuntue:2624238] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624238] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:2624238] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:2624238] btl:tcp: Successfully bound to AF_INET port 1036
[ubuntue:2624238] btl:tcp: my listening v4 socket is 0.0.0.0:1036
[ubuntue:2624238] btl:tcp: examining interface enp97s0f2
[ubuntue:2624238] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624238] select: init of component tcp returned success
[ubuntue:2624238] mca: base: components_register: registering framework pml components
[ubuntue:2624238] mca: base: components_register: found loaded component v
[ubuntue:2624238] mca: base: components_register: component v register function successful
[ubuntue:2624238] mca: base: components_register: found loaded component monitoring
[ubuntue:2624238] mca: base: components_register: component monitoring register function successful
[ubuntue:2624238] mca: base: components_register: found loaded component ob1
[ubuntue:2624238] mca: base: components_register: component ob1 register function successful
[ubuntue:2624238] mca: base: components_register: found loaded component cm
[ubuntue:2624238] mca: base: components_register: component cm register function successful
[ubuntue:2624238] mca: base: components_open: opening pml components
[ubuntue:2624238] mca: base: components_open: found loaded component v
[ubuntue:2624238] mca: base: components_open: component v open function successful
[ubuntue:2624238] mca: base: components_open: found loaded component monitoring
[ubuntue:2624238] mca: base: components_open: component monitoring open function successful
[ubuntue:2624238] mca: base: components_open: found loaded component ob1
[ubuntue:2624238] mca: base: components_open: component ob1 open function successful
[ubuntue:2624238] mca: base: components_open: found loaded component cm
[ubuntue:2624241] mca: base: components_register: registering framework btl components
[ubuntue:2624241] mca: base: components_register: found loaded component self
[ubuntue:2624241] mca: base: components_register: component self register function successful
[ubuntue:2624241] mca: base: components_register: found loaded component sm
[ubuntue:2624241] mca: base: components_register: found loaded component vader
[ubuntue:2624241] mca: base: components_register: component vader register function successful
[ubuntue:2624241] mca: base: components_register: found loaded component tcp
[ubuntue:2624241] mca: base: components_register: component tcp register function successful
[ubuntue:2624241] mca: base: components_open: opening btl components
[ubuntue:2624241] mca: base: components_open: found loaded component self
[ubuntue:2624241] mca: base: components_open: component self open function successful
[ubuntue:2624241] mca: base: components_open: found loaded component vader
[ubuntue:2624241] mca: base: components_open: component vader open function successful
[ubuntue:2624241] mca: base: components_open: found loaded component tcp
[ubuntue:2624241] mca: base: components_open: component tcp open function successful
[ubuntue:2624241] select: initializing btl component self
[ubuntue:2624241] select: init of component self returned success
[ubuntue:2624241] select: initializing btl component vader
[ubuntue:2624241] select: init of component vader returned success
[ubuntue:2624241] select: initializing btl component tcp
[ubuntue:2624241] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624241] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:2624241] btl:tcp: Attempting to bind to AF_INET port 1037
[ubuntue:2624241] btl:tcp: Successfully bound to AF_INET port 1037
[ubuntue:2624241] btl:tcp: my listening v4 socket is 0.0.0.0:1037
[ubuntue:2624241] btl:tcp: examining interface enp97s0f2
[ubuntue:2624241] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624241] select: init of component tcp returned success
[ubuntue:2624244] mca: base: components_register: registering framework btl components
[ubuntue:2624244] mca: base: components_register: found loaded component self
[ubuntue:2624244] mca: base: components_register: component self register function successful
[ubuntue:2624244] mca: base: components_register: found loaded component sm
[ubuntue:2624244] mca: base: components_register: found loaded component vader
[ubuntue:2624244] mca: base: components_register: component vader register function successful
[ubuntue:2624244] mca: base: components_register: found loaded component tcp
[ubuntue:2624241] mca: base: components_register: registering framework pml components
[ubuntue:2624241] mca: base: components_register: found loaded component v
[ubuntue:2624244] mca: base: components_register: component tcp register function successful
[ubuntue:2624244] mca: base: components_open: opening btl components
[ubuntue:2624244] mca: base: components_open: found loaded component self
[ubuntue:2624244] mca: base: components_open: component self open function successful
[ubuntue:2624241] mca: base: components_register: component v register function successful
[ubuntue:2624241] mca: base: components_register: found loaded component monitoring
[ubuntue:2624241] mca: base: components_register: component monitoring register function successful
[ubuntue:2624244] mca: base: components_open: found loaded component vader
[ubuntue:2624244] mca: base: components_open: component vader open function successful
[ubuntue:2624244] mca: base: components_open: found loaded component tcp
[ubuntue:2624244] mca: base: components_open: component tcp open function successful
[ubuntue:2624244] select: initializing btl component self
[ubuntue:2624244] select: init of component self returned success
[ubuntue:2624244] select: initializing btl component vader
[ubuntue:2624241] mca: base: components_register: found loaded component ob1
[ubuntue:2624241] mca: base: components_register: component ob1 register function successful
[ubuntue:2624241] mca: base: components_register: found loaded component cm
[ubuntue:2624241] mca: base: components_register: component cm register function successful
[ubuntue:2624241] mca: base: components_open: opening pml components
[ubuntue:2624241] mca: base: components_open: found loaded component v
[ubuntue:2624244] select: init of component vader returned success
[ubuntue:2624244] select: initializing btl component tcp
[ubuntue:2624244] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624244] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624241] mca: base: components_open: component v open function successful
[ubuntue:2624241] mca: base: components_open: found loaded component monitoring
[ubuntue:2624241] mca: base: components_open: component monitoring open function successful
[ubuntue:2624241] mca: base: components_open: found loaded component ob1
[ubuntue:2624241] mca: base: components_open: component ob1 open function successful
[ubuntue:2624241] mca: base: components_open: found loaded component cm
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1037
[ubuntue:2624244] btl:tcp: Attempting to bind to AF_INET port 1038
[ubuntue:2624244] btl:tcp: Successfully bound to AF_INET port 1038
[ubuntue:2624244] btl:tcp: my listening v4 socket is 0.0.0.0:1038
[ubuntue:2624244] btl:tcp: examining interface enp97s0f2
[ubuntue:2624244] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624244] select: init of component tcp returned success
[ubuntue:2624244] mca: base: components_register: registering framework pml components
[ubuntue:2624244] mca: base: components_register: found loaded component v
[ubuntue:2624244] mca: base: components_register: component v register function successful
[ubuntue:2624244] mca: base: components_register: found loaded component monitoring
[ubuntue:2624244] mca: base: components_register: component monitoring register function successful
[ubuntue:2624244] mca: base: components_register: found loaded component ob1
[ubuntue:2624244] mca: base: components_register: component ob1 register function successful
[ubuntue:2624244] mca: base: components_register: found loaded component cm
[ubuntue:2624244] mca: base: components_register: component cm register function successful
[ubuntue:2624244] mca: base: components_open: opening pml components
[ubuntue:2624244] mca: base: components_open: found loaded component v
[ubuntue:2624244] mca: base: components_open: component v open function successful
[ubuntue:2624244] mca: base: components_open: found loaded component monitoring
[ubuntue:2624244] mca: base: components_open: component monitoring open function successful
[ubuntue:2624244] mca: base: components_open: found loaded component ob1
[ubuntue:2624244] mca: base: components_open: component ob1 open function successful
[ubuntue:2624244] mca: base: components_open: found loaded component cm
[ubuntue:2624236] mca: base: components_register: registering framework btl components
[ubuntue:2624236] mca: base: components_register: found loaded component self
[ubuntue:2624236] mca: base: components_register: component self register function successful
[ubuntue:2624236] mca: base: components_register: found loaded component sm
[ubuntue:2624236] mca: base: components_register: found loaded component vader
[ubuntue:2624236] mca: base: components_register: component vader register function successful
[ubuntue:2624236] mca: base: components_register: found loaded component tcp
[ubuntue:2624236] mca: base: components_register: component tcp register function successful
[ubuntue:2624236] mca: base: components_open: opening btl components
[ubuntue:2624236] mca: base: components_open: found loaded component self
[ubuntue:2624236] mca: base: components_open: component self open function successful
[ubuntue:2624236] mca: base: components_open: found loaded component vader
[ubuntue:2624236] mca: base: components_open: component vader open function successful
[ubuntue:2624236] mca: base: components_open: found loaded component tcp
[ubuntue:2624236] mca: base: components_open: component tcp open function successful
[ubuntue:2624236] select: initializing btl component self
[ubuntue:2624236] select: init of component self returned success
[ubuntue:2624236] select: initializing btl component vader
[ubuntue:2624236] select: init of component vader returned success
[ubuntue:2624236] select: initializing btl component tcp
[ubuntue:2624236] btl: tcp: Searching for exclude address+prefix: 127.0.0.1 / 8
[ubuntue:2624236] btl: tcp: Found match: 127.0.0.1 (lo)
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1024
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1025
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1026
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1027
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1028
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1029
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1030
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1031
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1032
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1033
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1034
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1035
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1036
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1037
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1038
[ubuntue:2624236] btl:tcp: Attempting to bind to AF_INET port 1039
[ubuntue:2624236] btl:tcp: Successfully bound to AF_INET port 1039
[ubuntue:2624236] btl:tcp: my listening v4 socket is 0.0.0.0:1039
[ubuntue:2624236] btl:tcp: examining interface enp97s0f2
[ubuntue:2624236] btl:tcp: using ipv6 interface enp97s0f2
[ubuntue:2624236] select: init of component tcp returned success
[ubuntue:2624236] mca: base: components_register: registering framework pml components
[ubuntue:2624236] mca: base: components_register: found loaded component v
[ubuntue:2624236] mca: base: components_register: component v register function successful
[ubuntue:2624236] mca: base: components_register: found loaded component monitoring
[ubuntue:2624236] mca: base: components_register: component monitoring register function successful
[ubuntue:2624236] mca: base: components_register: found loaded component ob1
[ubuntue:2624236] mca: base: components_register: component ob1 register function successful
[ubuntue:2624236] mca: base: components_register: found loaded component cm
[ubuntue:2624236] mca: base: components_register: component cm register function successful
[ubuntue:2624236] mca: base: components_open: opening pml components
[ubuntue:2624236] mca: base: components_open: found loaded component v
[ubuntue:2624236] mca: base: components_open: component v open function successful
[ubuntue:2624236] mca: base: components_open: found loaded component monitoring
[ubuntue:2624236] mca: base: components_open: component monitoring open function successful
[ubuntue:2624236] mca: base: components_open: found loaded component ob1
[ubuntue:2624236] mca: base: components_open: component ob1 open function successful
[ubuntue:2624236] mca: base: components_open: found loaded component cm
[ubuntue:2624223] mca: base: components_open: component cm open function successful
[ubuntue:2624223] select: component v not in the include list
[ubuntue:2624223] select: component monitoring not in the include list
[ubuntue:2624223] select: initializing pml component ob1
[ubuntue:2624223] select: init returned priority 20
[ubuntue:2624223] select: initializing pml component cm
[ubuntue:2624221] mca: base: components_open: component cm open function successful
[ubuntue:2624221] select: component v not in the include list
[ubuntue:2624221] select: component monitoring not in the include list
[ubuntue:2624221] select: initializing pml component ob1
[ubuntue:2624221] select: init returned priority 20
[ubuntue:2624221] select: initializing pml component cm
[ubuntue:2624232] mca: base: components_open: component cm open function successful
[ubuntue:2624232] select: component v not in the include list
[ubuntue:2624232] select: component monitoring not in the include list
[ubuntue:2624232] select: initializing pml component ob1
[ubuntue:2624232] select: init returned priority 20
[ubuntue:2624232] select: initializing pml component cm
[ubuntue:2624234] mca: base: components_open: component cm open function successful
[ubuntue:2624229] mca: base: components_open: component cm open function successful
[ubuntue:2624234] select: component v not in the include list
[ubuntue:2624234] select: component monitoring not in the include list
[ubuntue:2624234] select: initializing pml component ob1
[ubuntue:2624234] select: init returned priority 20
[ubuntue:2624234] select: initializing pml component cm
[ubuntue:2624244] mca: base: components_open: component cm open function successful
[ubuntue:2624244] select: component v not in the include list
[ubuntue:2624244] select: component monitoring not in the include list
[ubuntue:2624244] select: initializing pml component ob1
[ubuntue:2624244] select: init returned priority 20
[ubuntue:2624244] select: initializing pml component cm
[ubuntue:2624241] mca: base: components_open: component cm open function successful
[ubuntue:2624229] select: component v not in the include list
[ubuntue:2624229] select: component monitoring not in the include list
[ubuntue:2624229] select: initializing pml component ob1
[ubuntue:2624229] select: init returned priority 20
[ubuntue:2624229] select: initializing pml component cm
[ubuntue:2624241] select: component v not in the include list
[ubuntue:2624241] select: component monitoring not in the include list
[ubuntue:2624241] select: initializing pml component ob1
[ubuntue:2624241] select: init returned priority 20
[ubuntue:2624241] select: initializing pml component cm
[ubuntue:2624228] mca: base: components_open: component cm open function successful
[ubuntue:2624228] select: component v not in the include list
[ubuntue:2624228] select: component monitoring not in the include list
[ubuntue:2624228] select: initializing pml component ob1
[ubuntue:2624228] select: init returned priority 20
[ubuntue:2624228] select: initializing pml component cm
[ubuntue:2624224] mca: base: components_open: component cm open function successful
[ubuntue:2624224] select: component v not in the include list
[ubuntue:2624224] select: component monitoring not in the include list
[ubuntue:2624224] select: initializing pml component ob1
[ubuntue:2624224] select: init returned priority 20
[ubuntue:2624224] select: initializing pml component cm
[ubuntue:2624225] mca: base: components_open: component cm open function successful
[ubuntue:2624225] select: component v not in the include list
[ubuntue:2624225] select: component monitoring not in the include list
[ubuntue:2624225] select: initializing pml component ob1
[ubuntue:2624225] select: init returned priority 20
[ubuntue:2624225] select: initializing pml component cm
[ubuntue:2624230] mca: base: components_open: component cm open function successful
[ubuntue:2624230] select: component v not in the include list
[ubuntue:2624230] select: component monitoring not in the include list
[ubuntue:2624230] select: initializing pml component ob1
[ubuntue:2624230] select: init returned priority 20
[ubuntue:2624230] select: initializing pml component cm
[ubuntue:2624238] mca: base: components_open: component cm open function successful
[ubuntue:2624222] mca: base: components_open: component cm open function successful
[ubuntue:2624238] select: component v not in the include list
[ubuntue:2624238] select: component monitoring not in the include list
[ubuntue:2624238] select: initializing pml component ob1
[ubuntue:2624238] select: init returned priority 20
[ubuntue:2624238] select: initializing pml component cm
[ubuntue:2624222] select: component v not in the include list
[ubuntue:2624222] select: component monitoring not in the include list
[ubuntue:2624222] select: initializing pml component ob1
[ubuntue:2624222] select: init returned priority 20
[ubuntue:2624222] select: initializing pml component cm
[ubuntue:2624227] mca: base: components_open: component cm open function successful
[ubuntue:2624227] select: component v not in the include list
[ubuntue:2624227] select: component monitoring not in the include list
[ubuntue:2624227] select: initializing pml component ob1
[ubuntue:2624227] select: init returned priority 20
[ubuntue:2624227] select: initializing pml component cm
[ubuntue:2624226] mca: base: components_open: component cm open function successful
[ubuntue:2624226] select: component v not in the include list
[ubuntue:2624226] select: component monitoring not in the include list
[ubuntue:2624226] select: initializing pml component ob1
[ubuntue:2624226] select: init returned priority 20
[ubuntue:2624226] select: initializing pml component cm
[ubuntue:2624236] mca: base: components_open: component cm open function successful
[ubuntue:2624236] select: component v not in the include list
[ubuntue:2624236] select: component monitoring not in the include list
[ubuntue:2624236] select: initializing pml component ob1
[ubuntue:2624236] select: init returned priority 20
[ubuntue:2624236] select: initializing pml component cm
[ubuntue:2624232] select: init returned priority 25
[ubuntue:2624232] selected cm best priority 25
[ubuntue:2624232] select: component ob1 not selected / finalized
[ubuntue:2624232] select: component cm selected
[ubuntue:2624232] mca: base: close: component v closed
[ubuntue:2624232] mca: base: close: unloading component v
[ubuntue:2624232] mca: base: close: component monitoring closed
[ubuntue:2624232] mca: base: close: unloading component monitoring
[ubuntue:2624232] mca: base: close: component ob1 closed
[ubuntue:2624232] mca: base: close: unloading component ob1
[ubuntue:2624229] select: init returned priority 25
[ubuntue:2624229] selected cm best priority 25
[ubuntue:2624229] select: component ob1 not selected / finalized
[ubuntue:2624229] select: component cm selected
[ubuntue:2624229] mca: base: close: component v closed
[ubuntue:2624229] mca: base: close: unloading component v
[ubuntue:2624229] mca: base: close: component monitoring closed
[ubuntue:2624229] mca: base: close: unloading component monitoring
[ubuntue:2624229] mca: base: close: component ob1 closed
[ubuntue:2624229] mca: base: close: unloading component ob1
[ubuntue:2624221] select: init returned priority 25
[ubuntue:2624221] selected cm best priority 25
[ubuntue:2624221] select: component ob1 not selected / finalized
[ubuntue:2624221] select: component cm selected
[ubuntue:2624221] mca: base: close: component v closed
[ubuntue:2624221] mca: base: close: unloading component v
[ubuntue:2624221] mca: base: close: component monitoring closed
[ubuntue:2624221] mca: base: close: unloading component monitoring
[ubuntue:2624221] mca: base: close: component ob1 closed
[ubuntue:2624221] mca: base: close: unloading component ob1
[ubuntue:2624224] select: init returned priority 25
[ubuntue:2624224] selected cm best priority 25
[ubuntue:2624224] select: component ob1 not selected / finalized
[ubuntue:2624224] select: component cm selected
[ubuntue:2624224] mca: base: close: component v closed
[ubuntue:2624224] mca: base: close: unloading component v
[ubuntue:2624224] mca: base: close: component monitoring closed
[ubuntue:2624224] mca: base: close: unloading component monitoring
[ubuntue:2624224] mca: base: close: component ob1 closed
[ubuntue:2624224] mca: base: close: unloading component ob1
[ubuntue:2624223] select: init returned priority 25
[ubuntue:2624223] selected cm best priority 25
[ubuntue:2624223] select: component ob1 not selected / finalized
[ubuntue:2624223] select: component cm selected
[ubuntue:2624223] mca: base: close: component v closed
[ubuntue:2624223] mca: base: close: unloading component v
[ubuntue:2624223] mca: base: close: component monitoring closed
[ubuntue:2624223] mca: base: close: unloading component monitoring
[ubuntue:2624223] mca: base: close: component ob1 closed
[ubuntue:2624223] mca: base: close: unloading component ob1
[ubuntue:2624230] select: init returned priority 25
[ubuntue:2624230] selected cm best priority 25
[ubuntue:2624230] select: component ob1 not selected / finalized
[ubuntue:2624230] select: component cm selected
[ubuntue:2624230] mca: base: close: component v closed
[ubuntue:2624230] mca: base: close: unloading component v
[ubuntue:2624230] mca: base: close: component monitoring closed
[ubuntue:2624230] mca: base: close: unloading component monitoring
[ubuntue:2624230] mca: base: close: component ob1 closed
[ubuntue:2624230] mca: base: close: unloading component ob1
[ubuntue:2624236] select: init returned priority 25
[ubuntue:2624236] selected cm best priority 25
[ubuntue:2624236] select: component ob1 not selected / finalized
[ubuntue:2624236] select: component cm selected
[ubuntue:2624236] mca: base: close: component v closed
[ubuntue:2624236] mca: base: close: unloading component v
[ubuntue:2624236] mca: base: close: component monitoring closed
[ubuntue:2624236] mca: base: close: unloading component monitoring
[ubuntue:2624236] mca: base: close: component ob1 closed
[ubuntue:2624236] mca: base: close: unloading component ob1
[ubuntue:2624227] select: init returned priority 25
[ubuntue:2624227] selected cm best priority 25
[ubuntue:2624227] select: component ob1 not selected / finalized
[ubuntue:2624227] select: component cm selected
[ubuntue:2624227] mca: base: close: component v closed
[ubuntue:2624227] mca: base: close: unloading component v
[ubuntue:2624227] mca: base: close: component monitoring closed
[ubuntue:2624227] mca: base: close: unloading component monitoring
[ubuntue:2624227] mca: base: close: component ob1 closed
[ubuntue:2624227] mca: base: close: unloading component ob1
[ubuntue:2624234] select: init returned priority 25
[ubuntue:2624234] selected cm best priority 25
[ubuntue:2624234] select: component ob1 not selected / finalized
[ubuntue:2624234] select: component cm selected
[ubuntue:2624234] mca: base: close: component v closed
[ubuntue:2624234] mca: base: close: unloading component v
[ubuntue:2624234] mca: base: close: component monitoring closed
[ubuntue:2624234] mca: base: close: unloading component monitoring
[ubuntue:2624234] mca: base: close: component ob1 closed
[ubuntue:2624234] mca: base: close: unloading component ob1
[ubuntue:2624228] select: init returned priority 25
[ubuntue:2624228] selected cm best priority 25
[ubuntue:2624228] select: component ob1 not selected / finalized
[ubuntue:2624228] select: component cm selected
[ubuntue:2624228] mca: base: close: component v closed
[ubuntue:2624228] mca: base: close: unloading component v
[ubuntue:2624228] mca: base: close: component monitoring closed
[ubuntue:2624228] mca: base: close: unloading component monitoring
[ubuntue:2624228] mca: base: close: component ob1 closed
[ubuntue:2624228] mca: base: close: unloading component ob1
[ubuntue:2624222] select: init returned priority 25
[ubuntue:2624222] selected cm best priority 25
[ubuntue:2624222] select: component ob1 not selected / finalized
[ubuntue:2624222] select: component cm selected
[ubuntue:2624222] mca: base: close: component v closed
[ubuntue:2624222] mca: base: close: unloading component v
[ubuntue:2624222] mca: base: close: component monitoring closed
[ubuntue:2624222] mca: base: close: unloading component monitoring
[ubuntue:2624222] mca: base: close: component ob1 closed
[ubuntue:2624222] mca: base: close: unloading component ob1
[ubuntue:2624238] select: init returned priority 25
[ubuntue:2624238] selected cm best priority 25
[ubuntue:2624238] select: component ob1 not selected / finalized
[ubuntue:2624238] select: component cm selected
[ubuntue:2624238] mca: base: close: component v closed
[ubuntue:2624238] mca: base: close: unloading component v
[ubuntue:2624238] mca: base: close: component monitoring closed
[ubuntue:2624238] mca: base: close: unloading component monitoring
[ubuntue:2624238] mca: base: close: component ob1 closed
[ubuntue:2624238] mca: base: close: unloading component ob1
[ubuntue:2624225] select: init returned priority 25
[ubuntue:2624225] selected cm best priority 25
[ubuntue:2624225] select: component ob1 not selected / finalized
[ubuntue:2624225] select: component cm selected
[ubuntue:2624225] mca: base: close: component v closed
[ubuntue:2624225] mca: base: close: unloading component v
[ubuntue:2624225] mca: base: close: component monitoring closed
[ubuntue:2624225] mca: base: close: unloading component monitoring
[ubuntue:2624225] mca: base: close: component ob1 closed
[ubuntue:2624225] mca: base: close: unloading component ob1
[ubuntue:2624241] select: init returned priority 25
[ubuntue:2624241] selected cm best priority 25
[ubuntue:2624241] select: component ob1 not selected / finalized
[ubuntue:2624241] select: component cm selected
[ubuntue:2624241] mca: base: close: component v closed
[ubuntue:2624241] mca: base: close: unloading component v
[ubuntue:2624241] mca: base: close: component monitoring closed
[ubuntue:2624241] mca: base: close: unloading component monitoring
[ubuntue:2624241] mca: base: close: component ob1 closed
[ubuntue:2624241] mca: base: close: unloading component ob1
[ubuntue:2624244] select: init returned priority 25
[ubuntue:2624244] selected cm best priority 25
[ubuntue:2624244] select: component ob1 not selected / finalized
[ubuntue:2624244] select: component cm selected
[ubuntue:2624244] mca: base: close: component v closed
[ubuntue:2624244] mca: base: close: unloading component v
[ubuntue:2624244] mca: base: close: component monitoring closed
[ubuntue:2624244] mca: base: close: unloading component monitoring
[ubuntue:2624244] mca: base: close: component ob1 closed
[ubuntue:2624244] mca: base: close: unloading component ob1
[ubuntue:2624226] select: init returned priority 25
[ubuntue:2624226] selected cm best priority 25
[ubuntue:2624226] select: component ob1 not selected / finalized
[ubuntue:2624226] select: component cm selected
[ubuntue:2624226] mca: base: close: component v closed
[ubuntue:2624226] mca: base: close: unloading component v
[ubuntue:2624226] mca: base: close: component monitoring closed
[ubuntue:2624226] mca: base: close: unloading component monitoring
[ubuntue:2624226] mca: base: close: component ob1 closed
[ubuntue:2624226] mca: base: close: unloading component ob1
[ubuntue:2624226] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624234] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624223] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624230] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624221] check:select: rank=0
[ubuntue:2624225] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624224] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624232] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624241] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624228] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624244] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624238] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624236] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624229] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624222] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624227] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624221] check:select: rank=0
[ubuntue:2624222] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624226] check:select: modex data not found
[ubuntue:2624225] check:select: modex data not found
[ubuntue:2624236] check:select: modex data not found
[ubuntue:2624228] check:select: modex data not found
[ubuntue:2624238] check:select: modex data not found
[ubuntue:2624227] check:select: modex data not found
[ubuntue:2624234] check:select: modex data not found
[ubuntue:2624224] check:select: modex data not found
[ubuntue:2624232] check:select: modex data not found
[ubuntue:2624229] check:select: modex data not found
[ubuntue:2624223] check:select: modex data not found
[ubuntue:2624230] check:select: modex data not found
[ubuntue:2624221] check:select: rank=0
[ubuntue:2624224] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624236] check:select: modex data not found
[ubuntue:2624223] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624241] check:select: modex data not found
[ubuntue:2624225] check:select: modex data not found
[ubuntue:2624226] check:select: modex data not found
[ubuntue:2624228] check:select: modex data not found
[ubuntue:2624238] check:select: modex data not found
[ubuntue:2624227] check:select: modex data not found
[ubuntue:2624222] check:select: modex data not found
[ubuntue:2624234] check:select: modex data not found
[ubuntue:2624232] check:select: modex data not found
[ubuntue:2624229] check:select: modex data not found
[ubuntue:2624230] check:select: modex data not found
[ubuntue:2624221] check:select: rank=0
[ubuntue:2624225] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624226] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624228] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624227] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624222] check:select: modex data not found
[ubuntue:2624224] check:select: modex data not found
[ubuntue:2624223] check:select: modex data not found
[ubuntue:2624236] check:select: modex data not found
[ubuntue:2624241] check:select: modex data not found
[ubuntue:2624234] check:select: modex data not found
[ubuntue:2624232] check:select: modex data not found
[ubuntue:2624229] check:select: modex data not found
[ubuntue:2624230] check:select: modex data not found
[ubuntue:2624238] check:select: modex data not found
[ubuntue:2624234] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624236] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624221] check:select: rank=0
[ubuntue:2624241] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624229] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624238] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624232] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624230] check:select: checking my pml cm against rank=0 pml cm
[ubuntue:2624225] check:select: modex data not found
[ubuntue:2624226] check:select: modex data not found
[ubuntue:2624228] check:select: modex data not found
[ubuntue:2624224] check:select: modex data not found
[ubuntue:2624222] check:select: modex data not found
[ubuntue:2624227] check:select: modex data not found
[ubuntue:2624223] check:select: modex data not found

libi40iw-i40iw_ureg_mr: Failed to register memory
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source            
nwchem             00000000071E467A  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F9E335D93C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F9E308231C2  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F9E32C17854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F9E336FF905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F9E3375983C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F9E33757A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F9E337144A1  MPI_Allgather         Unknown  Unknown
nwchem             0000000004836A7D  Unknown               Unknown  Unknown
nwchem             0000000004836DD5  Unknown               Unknown  Unknown
nwchem             000000000481FB30  Unknown               Unknown  Unknown
nwchem             000000000482041F  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F9E32CDE0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F59823723C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F59819B06D0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F59819B08A4  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F5982498905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F59824FB5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F59824B0730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F5981A770B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8A647D83C0  Unknown               Unknown  Unknown
mca_coll_libnbc.s  00007F8A619C19FC  ompi_coll_libnbc_     Unknown  Unknown
libopen-pal.so.40  00007F8A63E16854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F8A648FE905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F8A6495883C  ompi_coll_base_se     Unknown  Unknown
libmpi.so.40.20.3  00007F8A64956A68  ompi_coll_base_al     Unknown  Unknown
libmpi.so.40.20.3  00007F8A649134A1  MPI_Allgather         Unknown  Unknown
nwchem             0000000004836A7D  Unknown               Unknown  Unknown
nwchem             0000000004836DD5  Unknown               Unknown  Unknown
nwchem             000000000481FB30  Unknown               Unknown  Unknown
nwchem             000000000482041F  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F8A63EDD0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1923A143C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007F1923A10870  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007F191B5A8A41  Unknown               Unknown  Unknown
librxm-fi.so       00007F191B5C0CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F191B5C1AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F1920C5E0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F1923052854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F1923B3A905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F1923B9D5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F1923B52730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F19231190B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007EFD066543C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007EFD06650877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007EFCFE227CBE  Unknown               Unknown  Unknown
librxm-fi.so       00007EFCFE228AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007EFD0409F0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007EFD05C92854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007EFD0677A905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007EFD067DD5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007EFD06792730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007EFD05D590B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F2E7EA5C3C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F2E766319AB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F2E7C0A70DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F2E7E09A854  opal_progress         Unknown  Unknown
mca_pml_cm.so      00007F2E7C0F4F15  Unknown               Unknown  Unknown
libmpi.so.40.20.3  00007F2E7EBB93E5  MPI_Recv              Unknown  Unknown

nwchem             000000000482A6D5  Unknown               Unknown  Unknown
nwchem             000000000482DBFA  Unknown               Unknown  Unknown
nwchem             000000000482DCFE  Unknown               Unknown  Unknown
nwchem             00000000048203FD  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F2E7E1610B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F7A372E13C0  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F7A3452B061  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F7A3691F854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F7A37407905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F7A3746A5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F7A3741F730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F7A369E60B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F754972B3C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F75412FECF3  Unknown               Unknown  Unknown
librxm-fi.so       00007F75412FFAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F75429780DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F7548D69854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F7549851905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F75498B45B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F7549869730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F7548E300B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FCCF53493C0  Unknown               Unknown  Unknown
libverbs-fi.so     00007FCCF1DEFE96  Unknown               Unknown  Unknown
librxm-fi.so       00007FCCF0F018A4  Unknown               Unknown  Unknown
librxm-fi.so       00007FCCF0F01A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FCCF0F19CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FCCF0F1AAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FCCF25930DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FCCF4987854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FCCF546F905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FCCF54D25B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FCCF5487730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FCCF4A4E0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F571EF8C3C0  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F57178C5928  Unknown               Unknown  Unknown
libi40iw-rdmav25.  00007F57178C7D18  Unknown               Unknown  Unknown
libverbs-fi.so     00007F5717927D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007F5717927FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007F5716B488A4  Unknown               Unknown  Unknown
librxm-fi.so       00007F5716B48A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F5716B60CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F5716B61AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F571C1D60DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F571E5CA854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F571F0B2905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F571F1155B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F571F0CA730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F571E6910B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FF022A0F3C0  Unknown               Unknown  Unknown
librxm-fi.so       00007FF01A5C6959  Unknown               Unknown  Unknown
librxm-fi.so       00007FF01A5C6A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FF01A5DECDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FF01A5DFAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FF02005A0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FF02204D854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FF022B35905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FF022B985B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FF022B4D730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FF0221140B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007EFEE10893C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007EFEE1085877  pthread_spin_lock     Unknown  Unknown
librxm-fi.so       00007EFEDCC5AAB3  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007EFEDE2D30DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007EFEE06C7854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007EFEE11AF905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007EFEE12125B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007EFEE11C7730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007EFEE078E0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F3B5C5823C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFC24BDEA34  clock_gettime         Unknown  Unknown
libc-2.31.so       00007F3B5BD400E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007F3B58140DC1  Unknown               Unknown  Unknown
librxm-fi.so       00007F3B58140E19  Unknown               Unknown  Unknown
librxm-fi.so       00007F3B5813A8EA  Unknown               Unknown  Unknown
librxm-fi.so       00007F3B5813AA49  Unknown               Unknown  Unknown
librxm-fi.so       00007F3B58152CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F3B58153AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F3B597CC0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F3B5BBC0854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F3B5C6A8905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F3B5C70B5B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F3B5C6C0730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F3B5BC870B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F5A42C393C0  Unknown               Unknown  Unknown
linux-vdso.so.1    00007FFE451F2A67  clock_gettime         Unknown  Unknown
libc-2.31.so       00007F5A423F70E5  __clock_gettime       Unknown  Unknown
librxm-fi.so       00007F5A3A7ECDC1  Unknown               Unknown  Unknown
librxm-fi.so       00007F5A3A7ECE19  Unknown               Unknown  Unknown
librxm-fi.so       00007F5A3A7E68EA  Unknown               Unknown  Unknown
librxm-fi.so       00007F5A3A7E6A49  Unknown               Unknown  Unknown
librxm-fi.so       00007F5A3A7FECDD  Unknown               Unknown  Unknown
librxm-fi.so       00007F5A3A7FFAAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007F5A3BE780DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007F5A42277854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007F5A42D5F905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007F5A42DC25B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007F5A42D77730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F5A4233E0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8BF3BF33C0  Unknown               Unknown  Unknown
librxm-fi.so       00007F8BEB598EA8  Unknown               Unknown  Unknown

forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source            
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FD7AADB93C0  Unknown               Unknown  Unknown
libpthread-2.31.s  00007FD7AADB5877  pthread_spin_lock     Unknown  Unknown
libi40iw-rdmav25.  00007FD7A36E7CE7  Unknown               Unknown  Unknown
libverbs-fi.so     00007FD7A3856D80  Unknown               Unknown  Unknown
libverbs-fi.so     00007FD7A3856FC5  Unknown               Unknown  Unknown
librxm-fi.so       00007FD7A29688A4  Unknown               Unknown  Unknown
librxm-fi.so       00007FD7A2968A49  Unknown               Unknown  Unknown
librxm-fi.so       00007FD7A2980CDD  Unknown               Unknown  Unknown
librxm-fi.so       00007FD7A2981AAB  Unknown               Unknown  Unknown
mca_mtl_ofi.so     00007FD7A3FFA0DA  ompi_mtl_ofi_prog     Unknown  Unknown
libopen-pal.so.40  00007FD7AA3F7854  opal_progress         Unknown  Unknown
libmpi.so.40.20.3  00007FD7AAEDF905  ompi_request_defa     Unknown  Unknown
libmpi.so.40.20.3  00007FD7AAF425B4  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.20.3  00007FD7AAEF7730  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004835818  Unknown               Unknown  Unknown
nwchem             00000000047FB44A  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FD7AA4BE0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown

--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:

  Process name: [[12911,1],11]
  Exit code:    174
--------------------------------------------------------------------------

Best

Jibiao Li

To view this discussion on the web visit https://groups.google.com/d/msgid/nwchem-forum/944f18fe-bb9b-42b0-989a-dde6dbee1c2an%40googlegroups.com.

Edoardo Aprà

unread,
Jun 15, 2023, 11:25:02 PM6/15/23
to NWChem Forum
The directory /home/jibiaoli/codes/openmpi-4.1.5/lib is missing from LD_LIBRARY_PATH

export LD_LIBRARY_PATH=/home/jibiaoli/codes/openmpi-4.1.5/lib:/home/jibiaoli/codes/openmpi-4.1.5/lib/openmpi/:$LD_LIBRARY_PATH

Jibiao Li

unread,
Jun 16, 2023, 8:35:05 AM6/16/23
to nwchem...@googlegroups.com
Hi, Edoardo,

I have added  /home/jibiaoli/codes/openmpi-4.1.5/lib to  LD_LIBRARY_PATH
export LD_LIBRARY_PATH=/home/jibiaoli/codes/openmpi-4.1.5/lib:/home/jibiaoli/codes/openmpi-4.1.5/lib/openmpi/:$LD_LIBRARY_PATH

and I tried to run the input below. The calculation stopped by the following error message

start cluster_top

title "cluster_top, Def2-TZVP basis, optimized geometry"

geometry units angstroms
O             1.2612663660        2.1845774270       11.3694929670
C             1.2612663660        2.1845774270       10.2171954095
Cu           -0.0121442003       -0.0181624245        8.2581987614
Cu            2.5346769303       -0.0181624245        8.2581987614
Cu            5.0450654620        0.0000000000        8.2787244011
Cu            1.2612663660        2.1845774270        8.3671243521
Cu            3.8056003181        2.1831414533        8.2581987614
Cu            2.5321897518        4.3887532522        8.2581987614
Cu            2.5097112051        2.9053673915        6.2120527736
Cu            3.7812762676        0.7296490323        6.1914257666
Cu            1.2612663660        0.7429974989        6.2120527736
Cu            2.5225327310        1.4563849510        4.1192787010
end

basis
O   library Def2-TZVP
C   library Def2-TZVP
*   library Def2-TZVP
Cu  library Def2-TZVP
end

dft
 xc MGGA_C_REVTPSS  MGGA_X_REVTPSS
end

scf
   thresh 1.0e-8
end

task dft energy


... ...

WARNING: movecs_in_org=atomic not equal to movecs_in=./cluster_top.movecs
   Time after variat. SCF:      4.0
   Time prior to 1st pass:      4.0

 Integral file          = ./cluster_top.aoints.00
 Record size in doubles =  65536        No. of integs per rec  =  32766
 Max. records in memory =      0        Max. records in file   =   4722
 No. of bits per label  =     16        No. of bits per value  =     64


 #quartets = 4.085D+08 #integrals = 3.650D+10 #direct = 78.4% #cached = 21.6%


 Grid_pts file          = ./cluster_top.gridpts.00
 Record size in doubles =  12289        No. of grid_pts per rec  =   3070
 Max. records in memory =      5        Max. recs in file   =    141602

 PeIGS error from dstebz 4 ...trying dsterf 
 error from dsterf 590 
 error from dsterf 590 
 Error in pstein5. me = 0 argument 10 has an illegal value. 
 Error in pstein5. me = 1 argument 10 has an illegal value. 
 Error in pstein5. me = 2 argument 10 has an illegal value. 
 Error in pstein5. me = 3 argument 10 has an illegal value. 
 Error in pstein5. me = 4 argument 10 has an illegal value. 
 Error in pstein5. me = 5 argument 10 has an illegal value. 
 Error in pstein5. me = 6 argument 10 has an illegal value. 
 Error in pstein5. me = 7 argument 10 has an illegal value. 
 Error in pstein5. me = 8 argument 10 has an illegal value. 
 Error in pstein5. me = 9 argument 10 has an illegal value. 
 Error in pstein5. me = 10 argument 10 has an illegal value. 
 Error in pstein5. me = 11 argument 10 has an illegal value. 
 Error in pstein5. me = 12 argument 10 has an illegal value. 
 Error in pstein5. me = 13 argument 10 has an illegal value. 
 Error in pstein5. me = 14 argument 10 has an illegal value. 
 Error in pstein5. me = 15 argument 10 has an illegal value. 
 Error in pstein5. me = 16 argument 10 has an illegal value. 
 Error in pstein5. me = 17 argument 10 has an illegal value. 
 Error in pstein5. me = 18 argument 10 has an illegal value. 
  ME =                     11  Exiting via 
  ME =                     12  Exiting via 
  ME =                     13  Exiting via 
  ME =                     14  Exiting via 
  ME =                     15  Exiting via 
  ME =                     16  Exiting via 
  ME =                     17  Exiting via 
  ME =                      4  Exiting via 
  ME =                      5  Exiting via 
  ME =                      8  Exiting via 
  ME =                     10  Exiting via 
  ME =                      0  Exiting via 
  ME =                      1  Exiting via 
  ME =                      2  Exiting via 
  ME =                      3  Exiting via 
  ME =                      6  Exiting via 
  ME =                      7  Exiting via 
  ME =                      9  Exiting via 
  ME =                     18  Exiting via 
[12] Received an Error in Communication: (-1) 12: peigs error: mxpend:
[13] Received an Error in Communication: (-1) 13: peigs error: mxpend:
[14] Received an Error in Communication: (-1) 14: peigs error: mxpend:
[15] Received an Error in Communication: (-1) 15: peigs error: mxpend:
[16] Received an Error in Communication: (-1) 16: peigs error: mxpend:
[17] Received an Error in Communication: (-1) 17: peigs error: mxpend:
[4] Received an Error in Communication: (-1) 4: peigs error: mxpend:
[5] Received an Error in Communication: (-1) 5: peigs error: mxpend:
[8] Received an Error in Communication: (-1) 8: peigs error: mxpend:
[10] Received an Error in Communication: (-1) 10: peigs error: mxpend:
[11] Received an Error in Communication: (-1) 11: peigs error: mxpend:
[18] Received an Error in Communication: (-1) 18: peigs error: mxpend:
[0] Received an Error in Communication: (-1) 0: peigs error: mxpend:
[1] Received an Error in Communication: (-1) 1: peigs error: mxpend:
[6] Received an Error in Communication: (-1) 6: peigs error: mxpend:
[7] Received an Error in Communication: (-1) 7: peigs error: mxpend:
[9] Received an Error in Communication: (-1) 9: peigs error: mxpend:
[2] Received an Error in Communication: (-1) 2: peigs error: mxpend:
[3] Received an Error in Communication: (-1) 3: peigs error: mxpend:
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 13 in communicator MPI COMMUNICATOR 3 DUP FROM 0
with errorcode -1.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F05754A23C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F05694DA3C7  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F0574A228B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F05755F3725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F0575663C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F057560CD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F0574BA70B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1FF14FA3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F1FE552D450  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F1FF0A7A8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F1FF164B725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F1FF16BBC7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F1FF1664D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1FF0BFF0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1C23A7E3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F1C17AB43C7  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F1C22FFE8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F1C23BCF725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F1C23C3FC7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F1C23BE8D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1C231830B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1DE597F3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F1DE000D3D3  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F1DE4EFF8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F1DE5AD0725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F1DE5B40C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F1DE5AE9D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1DE50840B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1EFD8DD3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F1EF80191FA  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F1EFCE5D8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F1EFDA2E725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F1EFDA9EC7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F1EFDA47D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1EFCFE20B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F27A4D683C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F2798DA21E7  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F27A42E88B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F27A4EB9725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F27A4F29C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F27A4ED2D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F27A446D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F0AFE9193C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F0AF84143D3  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F0AFDE998B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F0AFEA6A725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F0AFEADAC7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F0AFEA83D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F0AFE01E0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F6EBA6213C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F6EB411C450  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F6EB9BA18B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F6EBA772725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F6EBA7E2C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F6EBA78BD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F6EB9D260B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FA47D42F3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FA4780073E0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FA47C9AF8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FA47D580725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FA47D5F0C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FA47D599D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FA47CB340B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F45CA2AF3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F45BE2AF3C7  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F45C982F8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F45CA400725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F45CA470C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F45CA419D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F45C99B40B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F1BA38713C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F1BA2DF17A0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F1BA2DF1904  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F1BA39C2725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F1BA3A32C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F1BA39DBD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F1BA2F760B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FAB199073C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FAB0D90644E  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FAB18E878B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FAB19A58725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FAB19AC8C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FAB19A71D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FAB1900C0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FCBA14513C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FCB9C068450  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FCBA09D18B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FCBA15A2725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FCBA1612C7B  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FCBA15BBD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FCBA0B560B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F16DE8723C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F16D836D3C7  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F16DDDF28B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F16DE9C3725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F16DEA33E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F16DE9DCD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F16DDF770B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FC5A88523C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FC59C88B323  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FC5A7DD28B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FC5A89A3725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FC5A8A13E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FC5A89BCD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FC5A7F570B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F3CC40493C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F3CB808432C  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F3CC35C98B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F3CC419A725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F3CC420AE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F3CC41B3D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F3CC374E0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F6F7F1F63C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F6F7E776880  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F6F7F347725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F6F7F3B7E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F6F7F360D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F6F7E8FB0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F330C8E93C0  Unknown               Unknown  Unknown
mca_coll_libnbc.s  00007F330021F16A  ompi_coll_libnbc_     Unknown  Unknown
libopen-pal.so.40  00007F330BE698B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F330CA3A725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F330CAAAE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F330CA53D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F330BFEE0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F52968903C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F529038B3C7  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F5295E108B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F52969E1725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F5296A51E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F52969FAD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F5295F950B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FE6CBDA73C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FE6C40683C3  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FE6CB3278B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FE6CBEF8725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FE6CBF68E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FE6CBF11D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FE6CB4AC0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F706B3683C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F70640113D3  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F706A8E88B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F706B4B9725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F706B529E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F706B4D2D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F706AA6D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F434D9FD3C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F434CFD41E9  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F434CF7D74F  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F434CF7D904  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F434DB4E725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F434DBBEE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F434DB67D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F434D1020B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F7FC32403C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007F7FB7277325  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F7FC27C08B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F7FC3391725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F7FC3401E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F7FC33AAD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F7FC29450B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F8BEB3163C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F8BEA8ED1E9  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F8BEA89674F  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F8BEA896904  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F8BEB467725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F8BEB4D7E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F8BEB480D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F8BEAA1B0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F23A31E93C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F23A27C01E9  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F23A276974F  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F23A2769904  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F23A333A725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F23A33AAE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F23A3353D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F23A28EE0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FE609D9A3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FE5FDDC7310  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FE60931A8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FE609EEB725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FE609F5BE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FE609F04D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FE60949F0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FFBACC983C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FFBA0CCF3D0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FFBAC2188B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FFBACDE9725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FFBACE59E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FFBACE02D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FFBAC39D0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F3CB958A3C0  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F3CB8B611E9  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F3CB8B0A74F  Unknown               Unknown  Unknown
libopen-pal.so.40  00007F3CB8B0A904  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007F3CB96DB725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007F3CB974BE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007F3CB96F4D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F3CB8C8F0B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FA78DE133C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FA781DBC32C  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FA78D3938B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FA78DF64725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FA78DFD4E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FA78DF7DD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FA78D5180B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FAA4A6E43C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FAA441DF308  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FAA49C648B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FAA4A835725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FAA4A8A5E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FAA4A84ED50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FAA49DE90B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FA4326AC3C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FA42C1A7325  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FA431C2C8B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FA4327FD725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FA43286DE53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FA432816D50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FA431DB10B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007FC4F30703C0  Unknown               Unknown  Unknown
mca_btl_vader.so   00007FC4EC00E308  Unknown               Unknown  Unknown
libopen-pal.so.40  00007FC4F25F08B4  opal_progress         Unknown  Unknown
libmpi.so.40.30.5  00007FC4F31C1725  ompi_request_defa     Unknown  Unknown
libmpi.so.40.30.5  00007FC4F3231E53  ompi_coll_base_ba     Unknown  Unknown
libmpi.so.40.30.5  00007FC4F31DAD50  MPI_Barrier           Unknown  Unknown
nwchem             0000000004832372  Unknown               Unknown  Unknown
nwchem             0000000004822893  Unknown               Unknown  Unknown
nwchem             000000000470D984  Unknown               Unknown  Unknown
nwchem             0000000004793E48  Unknown               Unknown  Unknown
nwchem             000000000471BFEC  Unknown               Unknown  Unknown
nwchem             00000000047E1836  Unknown               Unknown  Unknown
nwchem             00000000047B94BB  Unknown               Unknown  Unknown
nwchem             0000000004722FB4  Unknown               Unknown  Unknown
nwchem             00000000007D17D1  Unknown               Unknown  Unknown
nwchem             00000000007C1EE9  Unknown               Unknown  Unknown
nwchem             00000000007BB6A0  Unknown               Unknown  Unknown
nwchem             00000000007B147E  Unknown               Unknown  Unknown
nwchem             00000000007B0B1E  Unknown               Unknown  Unknown
nwchem             000000000042ED6D  Unknown               Unknown  Unknown
nwchem             000000000042D6F7  Unknown               Unknown  Unknown
nwchem             000000000042091D  Unknown               Unknown  Unknown
nwchem             00000000004180CF  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007FC4F27750B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
nwchem             00000000071E46AB  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  00007F799D6743C0  Unknown               Unknown  Unknown
mca_coll_libnbc.s  00007F7990FAA16A  ompi_coll_libnbc_     Unknown  Unknown
libopen-pal.so.40  00007F799CBF48B4  opal_progress         Unknown  Unknown
mca_pml_ob1.so     00007F7991050ED5  mca_pml_ob1_recv      Unknown  Unknown
libmpi.so.40.30.5  00007F799D7FDB75  MPI_Recv              Unknown  Unknown
nwchem             000000000482A6D5  Unknown               Unknown  Unknown
nwchem             000000000482DBFA  Unknown               Unknown  Unknown
nwchem             000000000482DCFE  Unknown               Unknown  Unknown
nwchem             00000000048203FD  Unknown               Unknown  Unknown
nwchem             00000000047FB3B5  Unknown               Unknown  Unknown
nwchem             00000000047FAFA4  Unknown               Unknown  Unknown
nwchem             00000000047FB00E  Unknown               Unknown  Unknown
nwchem             00000000047F9D77  Unknown               Unknown  Unknown
nwchem             0000000000417B2F  Unknown               Unknown  Unknown
nwchem             0000000000417AB2  Unknown               Unknown  Unknown
libc-2.31.so       00007F799CD790B3  __libc_start_main     Unknown  Unknown
nwchem             00000000004179BE  Unknown               Unknown  Unknown
[ubuntue:2639251] 18 more processes have sent help message help-mpi-api.txt / mpi-abort
[ubuntue:2639251] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages

Best

Jibiao Li


To view this discussion on the web visit https://groups.google.com/d/msgid/nwchem-forum/c1dd5197-b68e-4658-8e0a-8871f97b73d7n%40googlegroups.com.

NWChem Forum

unread,
Jun 16, 2023, 7:57:55 PM6/16/23
to NWChem Forum
The following input section is the root cause of your crash
basis
O   library Def2-TZVP
C   library Def2-TZVP
*   library Def2-TZVP
Cu  library Def2-TZVP
end
Since you end having twice the same basis function on each atom, you end up with matrices that very ill-conditioned.
The input section above should be changed to
basis
*   library Def2-TZVP
end

I would also recommend to use spherical basis functions instead of the default cartesian, too.
https://nwchemgit.github.io/Basis.html#spherical-or-cartesian
Reply all
Reply to author
Forward
0 new messages