Troubleshooting coupled wrf-wrf hydro coupled test case compile

[willrudisill]

Hello WRF Hydro community,

I am attempting to couple WRF with WRF-Hydro, starting by running the test cases. I've used both WRF and WRF-Hydro quite a bit, but this is my first attempt coupling the two. I'm using intel fortran compilers on our local university HPC system. 

WRF Version: 4.1.2

WRF-Hydro Version: (Whatever comes shipped with WRF 4.1.2)

These are the instructions I'm following 

https://ral.ucar.edu/sites/default/files/public/coupledWRFWRFHydroV5TestCaseUserGuide.pdf)

I set the wrf hydro compile flag to 1 prior to building, and i edited the hydro/macros file to use the right intel fortran compiler (mpifort). The compile log says it was successful, and I have a wrf.exe, real.exe, etc. in my main/ directory. So everything seems fine on that end... BUT, when I go to run the test case, though, I'm not getting any hydro output. Real/wrf runs fine and I get all of the correct wrfout_d0* files but that's it. I'm using the CO front range test case found here: https://ral.ucar.edu/projects/wrf_hydro/testcases

I'm not really sure what I should be looking for here-- I don't see any errors in the .rsl log files. 

Does anyone have an idea of what I should check? It seems like wrf hdyro isn't being called at all. 

At the bottom of this post I also have shown the output of grepping the log file for all instances of 'hydro'. From that it looks like the compile did the right thing.

Thanks in advance,

Will Rudisill 

-------------------------------------------------------------------------------------------------------

cat wrf_wh_compile.log | grep hydro

if [ 1 -eq 1 ]   ; then make -i -r MODULE_DIRS="-I../dyn_em -I../dyn_nmm  -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/esmf_time_f90  -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/main -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/io_netcdf -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/io_int -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/frame -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/share -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/phys -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/wrftladj -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/chem -I/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/inc -I/cm/shared/apps/netcdf/intel/64/4.4.1/include " wrf_hydro ; fi

----------wrf_hydro-----------------------

if [ 1 -eq 1 ]   ; then (cd hydro/CPL/WRF_cpl; make -f Makefile.cpl) ; fi

make[2]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/CPL/WRF_cpl'

make[3]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro'

make[4]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/MPP'

make[4]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/MPP'

make[4]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/Data_Rec'

make[4]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/Data_Rec'

make[4]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/Routing'

make[4]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/Routing'

make[4]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/HYDRO_drv'

make[4]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/HYDRO_drv'

make[3]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro'

make[3]: Entering directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/CPL/WRF_cpl'

make[3]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/CPL/WRF_cpl'

make[2]: Leaving directory `/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/hydro/CPL/WRF_cpl'

time mpiifort -heap-arrays -f90=ifort -o wrf.exe  -O3 -ip -fp-model precise -w -ftz -align all -fno-alias -FR -convert big_endian   -ip   wrf.o ../main/module_wrf_top.o libwrflib.a /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/fftpack/fftpack5/libfftpack.a /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/io_grib1/libio_grib1.a /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/io_grib_share/libio_grib_share.a /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/io_int/libwrfio_int.a -L/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/esmf_time_f90 -lesmf_time /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/RSL_LITE/librsl_lite.a /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/frame/module_internal_header_util.o /home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/frame/pack_utils.o  -L/home/wrudisill/WRF-R2/4.1.2/WRF-4.1.2/external/io_netcdf -lwrfio_nf -L/cm/shared/apps/netcdf/intel/64/4.4.1/lib -lnetcdff -lnetcdf     -L/cm/shared/apps/hdf5_18/1.8.18-mpi/lib/lib -lhdf5hl_fortran -lhdf5_hl -lhdf5_fortran -lhdf5 -lm -lz  -L../hydro/lib -lHYDRO -L/cm/shared/apps/hdf5_18/1.8.18/lib -lhdf5 -lhdf5_hl -lz

[Katelyn FitzGerald]

Hi Will,

Thanks for posting.

It looks like this doc didn’t get updated to add a link and/or copy over the domain files to the corresponding location in the hydro.namelist. We’ll get that updated.

Hopefully that’s the issue here as well (though I’m a bit surprised the run didn’t fail). If not, shoot us a note via the help form w/ the full log.

Katelyn

[willrudisill]

Thanks for the quick response Katelyn!

So I did do that part in fact. I copied over the DOMAIN directory into the WRF run directory. It contains: 

Fulldom_hires.nc

GEOGRID_LDASOUT_Spatial_Metadata.nc

GWBASINS.nc

GWBUCKPARM.nc

Which are all of the domain files provided in the testcase. Not sure if this matters, but the hydro.namelist does specify a hydro2dtbl.nc file... which was not provided in the testcase files.

At the bottom of my comment i've provided the entirety of the rsl.out.0001 file. Should I provide the full compile log file? 

Thanks again for your help as always!

Quilting with   1 groups of   0 I/O tasks.

 Ntasks in X            1 , ntasks in Y            2

*************************************

Configuring physics suite 'conus'

         mp_physics:      3*     3*

         cu_physics:      0*     0*

      ra_lw_physics:      1*     1*

      ra_sw_physics:      1*     1*

     bl_pbl_physics:      1*     1*

  sf_sfclay_physics:      1*     1*

 sf_surface_physics:      4*     4*

(* = option overrides suite setting)

*************************************

WRF V4.1.2 MODEL

 *************************************

 Parent domain

 ids,ide,jds,jde            1          42           1          42

 ims,ime,jms,jme           -4          47          15          47

 ips,ipe,jps,jpe            1          42          22          42

 *************************************

DYNAMICS OPTION: Eulerian Mass Coordinate

   alloc_space_field: domain            1 ,               31485476  bytes allocated

  med_initialdata_input: calling input_input

   Input data is acceptable to use:

Max map factor in domain 1 =  1.00. Scale the dt in the model accordingly.

INPUT LandUse = "USGS"

 LANDUSE TYPE = "USGS" FOUND          33  CATEGORIES           2  SEASONS WATER CATEGORY =           16  SNOW CATEGORY =           24

 SOIL TEXTURE CLASSIFICATION = STAS FOUND          19  CATEGORIES

 *************************************

 Nesting domain

 ids,ide,jds,jde            1          52           1          31

 ims,ime,jms,jme           -4          57           6          36

 ips,ipe,jps,jpe            1          52          16          31

 INTERMEDIATE domain

 ids,ide,jds,jde           11          33          15          30

 ims,ime,jms,jme            6          38          12          35

 ips,ipe,jps,jpe            9          35          22          32

 *************************************

d01 2013-09-09_18:00:00  alloc_space_field: domain            2 ,                4409856  bytes allocated

d01 2013-09-09_18:00:00  alloc_space_field: domain            2 ,               35113972  bytes allocated

d01 2013-09-09_18:00:00 *** Initializing nest domain # 2 from an input file. ***

d01 2013-09-09_18:00:00 med_initialdata_input: calling input_input

d01 2013-09-09_18:00:00  Input data is acceptable to use:

INPUT LandUse = "USGS"

 LANDUSE TYPE = "USGS" FOUND          33  CATEGORIES           2  SEASONS WATER CATEGORY =           16  SNOW CATEGORY =           24

 SOIL TEXTURE CLASSIFICATION = STAS FOUND          19  CATEGORIES

INPUT LandUse = "USGS"

 LANDUSE TYPE = "USGS" FOUND          33  CATEGORIES           2  SEASONS WATER CATEGORY =           16  SNOW CATEGORY =           24

 SOIL TEXTURE CLASSIFICATION = STAS FOUND          19  CATEGORIES

Max map factor in domain 1 =  1.00. Scale the dt in the model accordingly.

INPUT LandUse = "USGS"

 LANDUSE TYPE = "USGS" FOUND          33  CATEGORIES           2  SEASONS WATER CATEGORY =           16  SNOW CATEGORY =           24

 SOIL TEXTURE CLASSIFICATION = STAS FOUND          19  CATEGORIES

d01 2013-09-09_18:00:00  Input data is acceptable to use:

 Tile Strategy is not specified. Assuming 1D-Y

WRF TILE   1 IS      1 IE     42 JS     22 JE     42

WRF NUMBER OF TILES =   1

 Tile Strategy is not specified. Assuming 1D-Y

WRF TILE   1 IS      1 IE     52 JS     16 JE     31

WRF NUMBER OF TILES =   1

d01 2013-09-10_00:00:00  Input data is acceptable to use:

d01 2013-09-10_06:00:00 wrf: SUCCESS COMPLETE WRF

[willrudisill]

And attached is the full compile log

[willrudisill]

Problem has been resolved! Not exactly sure what changed, but I did a recompile and it's now working (I'm seeing wrf hydro and wrf output, yay!). I might have copied over the wrong executables from the get-go.

Thanks,

Will 

[Katelyn FitzGerald]

Glad it's working!

And the path to the not yet existent netCDF version of the hydro parameter table shouldn't be an issue.  If one is not there, the model will generate one for you from the HYDRO.TBL.  If there is one, that will be read instead.