+ upcrun -v -n 48 /home/faculty/sturgmancohen/install/hipmer/hipmer-install-Linux/bin/main-64 -f validation.config -N 24 -B -H -C + Executing srun as pid 214022 on node06.cluster *** upcrun setting: GASNET_MAX_SEGSIZE='1019400KB' *** upcrun setting: UPC_NODES='node06 node07 ' *** upcrun setting: GASNET_NODEFILE='/tmp/kn5KGgv0w1' *** upcrun setting: GASNET_RM_NODEFILE='1' *** upcrun setting: GASNET_SSH_SERVERS='node06 node07 ' *** upcrun running: '/home/faculty/sturgmancohen/install/opt/bin/gasnetrun_mpi -v -n 48 -c 1 -E UPC_SHARED_HEAP_SIZE,UPC_NODES,UPC_PTHREADS_OPT /home/faculty/sturgmancohen/install/hipmer/hipmer-install-Linux/bin/main-64 -f validation.config -N 24 -B -H -C' gasnetrun: identified MPI spawner as: OpenMPI gasnetrun: located executable '/home/faculty/sturgmancohen/install/hipmer/hipmer-install-Linux/bin/main-64' envargs: -x UPC_SHARED_HEAP_SIZE -x UPC_NODES -x UPC_PTHREADS_OPT -x GASNET_SSH_SERVERS -x GASNET_NODEFILE -x GASNET_RM_NODEFILE -x GASNET_VERBOSEENV -x GASNET_ENVCMD -x GASNET_PSHM_ENABLED -x GASNET_PHYSMEM_MAX -x GASNET_MAX_SEGSIZE -x GASNET_PHYSMEM_NOPROBE -x GASNET_SPAWN_CONTROL -x GASNET_PLATFORM -x GASNET_SPAWN_CONDUIT gasnetrun: running: /home/faculty/sturgmancohen/spack/opt/spack/linux-centos7-x86_64/gcc-8.2.0/openmpi-2.1.5-tz2w3gpjbjekfnuo6ptfowjmxdrjor4v/bin/mpirun -np 48 -x UPC_SHARED_HEAP_SIZE -x UPC_NODES -x UPC_PTHREADS_OPT -x GASNET_SSH_SERVERS -x GASNET_NODEFILE -x GASNET_RM_NODEFILE -x GASNET_VERBOSEENV -x GASNET_ENVCMD -x GASNET_PSHM_ENABLED -x GASNET_PHYSMEM_MAX -x GASNET_MAX_SEGSIZE -x GASNET_PHYSMEM_NOPROBE -x GASNET_SPAWN_CONTROL -x GASNET_PLATFORM -x GASNET_SPAWN_CONDUIT /home/faculty/sturgmancohen/install/hipmer/hipmer-install-Linux/bin/main-64 -f validation.config -N 24 -B -H -C ENV parameter: GASNET_MAXIMIZE_RLIMIT_CPU = YES (default) ENV parameter: GASNET_MAXIMIZE_RLIMIT_DATA = YES (default) ENV parameter: GASNET_MAXIMIZE_RLIMIT_RSS = YES (default) ENV parameter: GASNET_MAXIMIZE_RLIMIT_STACK = YES (default) ENV parameter: GASNET_MAXIMIZE_RLIMIT_AS = YES (default) ENV parameter: GASNET_FREEZE = NO (default) ENV parameter: GASNET_NETWORKDEPTH = 4 (default) ENV parameter: GASNET_MPI_THREAD = MPI_THREAD_SINGLE (default) ENV parameter: GASNET_TSC_RATE = wallclock (default) ENV parameter: GASNET_TSC_RATE_TOLERANCE = 0.0005 (default) ENV parameter: GASNET_TSC_RATE_HARD_TOLERANCE = 0.02 (default) ENV parameter: GASNET_DISABLE_ARGDECODE = NO (default) ENV parameter: GASNET_BACKTRACE = NO (default) ENV parameter: GASNET_TMPDIR = *not set* (default) ENV parameter: GASNET_DISABLE_ENVDECODE = NO (default) ENV parameter: TMPDIR = /tmp ENV parameter: GASNET_BACKTRACE_TYPE = GDB,GSTACK,PSTACK,EXECINFO (default) ENV parameter: GASNET_FREEZE_ON_ERROR = NO (default) ENV parameter: GASNET_FREEZE_SIGNAL = *not set* (default) ENV parameter: GASNET_BACKTRACE_SIGNAL = *not set* (default) ENV parameter: GASNET_NODEMAP_EXACT = YES (default) ENV parameter: GASNET_SUPERNODE_MAXSIZE = 0 (default) ENV parameter: GASNET_PSHM_NETWORK_DEPTH = 32 (default) ENV parameter: GASNET_BARRIER = DISSEM (default) ENV parameter: GASNET_COLL_MIN_SCRATCH_SIZE = 1 KB (default) ENV parameter: GASNET_COLL_SCRATCH_SIZE = 2 MB (default) ENV parameter: GASNET_MAX_SEGSIZE = 1019400KB (995 MB) ENV parameter: UPC_SHARED_HEAP_SIZE = 903 (903 MB) ENV parameter: UPC_SHARED_HEAP_OFFSET = 0 (default) ENV parameter: UPC_SHARED_LOCALHEAP_INITSZ = 32 KB (default) ENV parameter: GASNET_DISABLE_MUNMAP = NO (default) ENV parameter: GASNET_QUIET = NO (default) WARNING: Using GASNet's mpi-conduit, which exists for portability convenience. WARNING: Support was detected for native GASNet conduits: ibv, psm WARNING: You should *really* use the high-performance native GASNet conduit WARNING: if communication performance is at all important in this program run. ENV parameter: GASNET_FS_SYNC = NO (default) ENV parameter: GASNET_MAX_THREADS = 1 (default) ENV parameter: GASNET_PSHM_BARRIER_HIER = YES (default) ENV parameter: GASNET_PSHM_BARRIER_RADIX = 0 (default) ENV parameter: GASNET_VIS_AMPIPE = YES (default) ENV parameter: GASNET_VIS_MAXCHUNK = 63 KB (default) ENV parameter: GASNET_VIS_PUT_MAXCHUNK = 63 KB (default) ENV parameter: GASNET_VIS_GET_MAXCHUNK = 63 KB (default) ENV parameter: GASNET_VIS_REMOTECONTIG = YES (default) ENV parameter: GASNET_COLL_P2P_EAGER_MIN = 16 (default) ENV parameter: GASNET_COLL_P2P_EAGER_SCALE = 16 (default) ENV parameter: GASNET_COLL_ROOTED_GEOM = KNOMIAL_TREE,2 (default) ENV parameter: GASNET_COLL_BROADCAST_GEOM = KNOMIAL_TREE,2 (default) ENV parameter: GASNET_COLL_SCATTER_GEOM = KNOMIAL_TREE,2 (default) ENV parameter: GASNET_COLL_GATHER_GEOM = KNOMIAL_TREE,2 (default) ENV parameter: GASNET_COLL_GATHER_ALL_DISSEM_LIMIT_PER_THREAD = 1 KB (default) ENV parameter: GASNET_COLL_GATHER_ALL_DISSEM_LIMIT = 1 KB (default) ENV parameter: GASNET_COLL_EXCHANGE_DISSEM_LIMIT_PER_THREAD = 1 KB (default) ENV parameter: GASNET_COLL_EXCHANGE_DISSEM_LIMIT = 1 KB (default) ENV parameter: GASNET_COLL_EXCHANGE_DISSEM_RADIX = 2 (default) ENV parameter: GASNET_COLL_PIPE_SEG_SIZE = 1354 B (default) ENV parameter: GASNET_COLL_AUTOTUNE_WARM_ITERS = 5 (default) ENV parameter: GASNET_COLL_AUTOTUNE_PERF_ITERS = 10 (default) ENV parameter: GASNET_COLL_AUTOTUNE_ALLOW_FLAT_TREE = 1 (default) ENV parameter: GASNET_COLL_TUNING_FILE = *not set* (default) ENV parameter: GASNET_COLL_PRINT_AUTOTUNE_TIMER = NO (default) ENV parameter: GASNET_COLL_PRINT_COLL_ALG = NO (default) ENV parameter: GASNET_COLL_ENABLE_SEARCH = NO (default) ENV parameter: GASNET_COLL_ENABLE_PROFILE = NO (default) ENV parameter: GASNET_COLL_TUNE_SMP_BARRIER = NO (default) UPCR: UPC thread 0 of 48 on node06.cluster (pshm node 0 of 1, process 0 of 48, pid=214072) UPCR: UPC thread 1 of 48 on node06.cluster (pshm node 0 of 1, process 1 of 48, pid=214073) UPCR: UPC thread 19 of 48 on node06.cluster (pshm node 0 of 1, process 19 of 48, pid=214150) UPCR: UPC thread 20 of 48 on node06.cluster (pshm node 0 of 1, process 20 of 48, pid=214153) UPCR: UPC thread 24 of 48 on node06.cluster (pshm node 0 of 1, process 24 of 48, pid=214194) UPCR: UPC thread 27 of 48 on node06.cluster (pshm node 0 of 1, process 27 of 48, pid=214220) UPCR: UPC thread 28 of 48 on node06.cluster (pshm node 0 of 1, process 28 of 48, pid=214235) UPCR: UPC thread 29 of 48 on node06.cluster (pshm node 0 of 1, process 29 of 48, pid=214237) UPCR: UPC thread 34 of 48 on node06.cluster (pshm node 0 of 1, process 34 of 48, pid=214277) UPCR: UPC thread 2 of 48 on node06.cluster (pshm node 0 of 1, process 2 of 48, pid=214074) UPCR: UPC thread 3 of 48 on node06.cluster (pshm node 0 of 1, process 3 of 48, pid=214075) UPCR: UPC thread 5 of 48 on node06.cluster (pshm node 0 of 1, process 5 of 48, pid=214077) UPCR: UPC thread 6 of 48 on node06.cluster (pshm node 0 of 1, process 6 of 48, pid=214078) UPCR: UPC thread 7 of 48 on node06.cluster (pshm node 0 of 1, process 7 of 48, pid=214079) UPCR: UPC thread 8 of 48 on node06.cluster (pshm node 0 of 1, process 8 of 48, pid=214080) UPCR: UPC thread 9 of 48 on node06.cluster (pshm node 0 of 1, process 9 of 48, pid=214084) UPCR: UPC thread 10 of 48 on node06.cluster (pshm node 0 of 1, process 10 of 48, pid=214089) UPCR: UPC thread 11 of 48 on node06.cluster (pshm node 0 of 1, process 11 of 48, pid=214094) UPCR: UPC thread 12 of 48 on node06.cluster (pshm node 0 of 1, process 12 of 48, pid=214096) UPCR: UPC thread 13 of 48 on node06.cluster (pshm node 0 of 1, process 13 of 48, pid=214099) UPCR: UPC thread 14 of 48 on node06.cluster (pshm node 0 of 1, process 14 of 48, pid=214102) UPCR: UPC thread 15 of 48 on node06.cluster (pshm node 0 of 1, process 15 of 48, pid=214105) UPCR: UPC thread 16 of 48 on node06.cluster (pshm node 0 of 1, process 16 of 48, pid=214109) UPCR: UPC thread 17 of 48 on node06.cluster (pshm node 0 of 1, process 17 of 48, pid=214125) UPCR: UPC thread 18 of 48 on node06.cluster (pshm node 0 of 1, process 18 of 48, pid=214148) UPCR: UPC thread 21 of 48 on node06.cluster (pshm node 0 of 1, process 21 of 48, pid=214162) UPCR: UPC thread 22 of 48 on node06.cluster (pshm node 0 of 1, process 22 of 48, pid=214171) UPCR: UPC thread 23 of 48 on node06.cluster (pshm node 0 of 1, process 23 of 48, pid=214182) UPCR: UPC thread 30 of 48 on node06.cluster (pshm node 0 of 1, process 30 of 48, pid=214245) UPCR: UPC thread 31 of 48 on node06.cluster (pshm node 0 of 1, process 31 of 48, pid=214253) UPCR: UPC thread 32 of 48 on node06.cluster (pshm node 0 of 1, process 32 of 48, pid=214263) UPCR: UPC thread 33 of 48 on node06.cluster (pshm node 0 of 1, process 33 of 48, pid=214269) UPCR: UPC thread 35 of 48 on node06.cluster (pshm node 0 of 1, process 35 of 48, pid=214285) UPCR: UPC thread 36 of 48 on node06.cluster (pshm node 0 of 1, process 36 of 48, pid=214295) UPCR: UPC thread 37 of 48 on node06.cluster (pshm node 0 of 1, process 37 of 48, pid=214301) UPCR: UPC thread 38 of 48 on node06.cluster (pshm node 0 of 1, process 38 of 48, pid=214304) UPCR: UPC thread 39 of 48 on node06.cluster (pshm node 0 of 1, process 39 of 48, pid=214314) UPCR: UPC thread 40 of 48 on node06.cluster (pshm node 0 of 1, process 40 of 48, pid=214322) UPCR: UPC thread 41 of 48 on node06.cluster (pshm node 0 of 1, process 41 of 48, pid=214328) UPCR: UPC thread 42 of 48 on node06.cluster (pshm node 0 of 1, process 42 of 48, pid=214333) UPCR: UPC thread 43 of 48 on node06.cluster (pshm node 0 of 1, process 43 of 48, pid=214346) UPCR: UPC thread 44 of 48 on node06.cluster (pshm node 0 of 1, process 44 of 48, pid=214352) UPCR: UPC thread 45 of 48 on node06.cluster (pshm node 0 of 1, process 45 of 48, pid=214362) UPCR: UPC thread 46 of 48 on node06.cluster (pshm node 0 of 1, process 46 of 48, pid=214370) UPCR: UPC thread 47 of 48 on node06.cluster (pshm node 0 of 1, process 47 of 48, pid=214386) UPCR: UPC thread 4 of 48 on node06.cluster (pshm node 0 of 1, process 4 of 48, pid=214076) UPCR: UPC thread 25 of 48 on node06.cluster (pshm node 0 of 1, process 25 of 48, pid=214200) UPCR: UPC thread 26 of 48 on node06.cluster (pshm node 0 of 1, process 26 of 48, pid=214208) ENV parameter: UPC_FREEZE_EARLY = *not set* (default) ENV parameter: UPC_POLITE_SYNC = YES (default) WARNING: Host node06.cluster running more threads (48) than there are physical CPU's (24) enabling "polite", low-performance synchronization algorithms ENV parameter: UPC_REQUIRE_SHARED_SIZE = NO (default) ENV parameter: UPC_BARRIER_MISMATCH_WARNS = NO (default) ENV parameter: UPC_BIND_THREADS = NO (default) ENV parameter: UPC_SUPPRESS_SIGFPE = NO (default) ENV parameter: UPC_FIRSTTOUCH = YES (default) ENV parameter: UPC_FORCETOUCH = NO (default) ENV parameter: UPC_SHARED_ALLOC_ALIGN = 4 KB (default) ENV parameter: UPC_LOCKS_RR = 1 (default) ENV parameter: UPC_FREEZE = *not set* (default) [Th0 INFO 2019-04-10 18:13:14 mach.h:273]: Found 24 cores_per_node