Hi all,
I'm trying to run a simulation with several MultiApps - Okapi (OpenMC wrapped as a MooseApp), Buffalo (surrogate for BISON), and MOON (Nek5000 wrapped as a MooseApp). The MasterApp is Okapi (performs a dummy solve and only acts to transfer data between the three MultiApps). I've gotten this setup to run correctly for the Okapi-Buffalo situation, but once I add in MOON, I'm running into problems with finding the libmoon-dbg.so library. Specifically, I get the following error message:
*** ERROR ***
Cannot open library: /homes/anovak/projects/moon/lib/libmoon-dbg.so.0
The library is there:
anovak@nash:~/projects/moon/lib$ ls
libmoon-dbg.so libmoon-dbg.txt libmoon-opt.so.0
and to be sure I put it in LD_LIBRARY_PATH:
anovak@nash:~/projects/okapimcs $ echo $LD_LIBRARY_PATH
/homes/anovak/projects/moon/lib:/homes/anovak/projects/openmc/build/lib:/soft/apps/packages/climate/mpich/3.2/gcc-6.2.0/lib:/soft/apps/packages/gcc/gcc-6.2.0/lib64:/soft/apps/packages/climate/hdf5/1.8.16-parallel/gcc-6.2.0/lib
In my Master App input file, the MultiApp section looks like:
[MultiApps]
[./bison]
type = TransientMultiApp
app_type = BuffaloApp
positions = '0 0 0'
input_files = 'bison.i'
execute_on = timestep_begin
library_path = /homes/anovak/projects/buffalo/lib
[../]
[./openmc]
type = TransientMultiApp
app_type = OkapiMCSApp
positions = '0 0 0'
input_files = 'openmc.i'
execute_on = timestep_begin
[../]
[./nek]
type = TransientMultiApp
app_type = MoonApp
positions = '0 0 0'
input_files = 'nek.i'
execute_on = timestep_begin
library_path = /homes/anovak/projects/moon/lib
[../]
[]
I'm not sure if this can be answered here because the problem might be very specific to MOON, but I thought I'd ask to see if there are any other things I might be missing. I did also try the reverse, where MOON acts as the MasterApp and facilitates data transfer between Okapi, Buffalo, and MOON, but instead I got the following error (and this library is also there, so could be a common-cause failure...):
*** ERROR ***
Cannot open library: /homes/anovak/projects/moose/modules/module_loader/lib/libmodule_loader_with-dbg.so.0
One thing that might be causing the problem is that MOON and Okapi/Buffalo use different MOOSE_DIRs - forcing MOOSE_DIR to be the same for all of them gives me errors building the MOON executable, though.
Thanks very much, and have a good weekend!
-April