WRF Hydro Geoprocessing Toolbox

446 views
Skip to first unread message

Walter Samuel

unread,
Feb 20, 2020, 12:21:49 PM2/20/20
to wrf-hydro_users
Hello

I have been using the ArcGIS Preprocessing toolbox and it has been working perfectly well. 

Today when I wanted to use it, it has begun to give me the following error

Executing: ProcessGeogridFile "H:\WRF Hydro\wrf domain\DOMAIN_1\geo_em.d01.nc" "H:\WRF Hydro\brahmaputra_frxst_pts_csv.csv" true true false # "H:\WRF Hydro\EURASIA\eurasia.tif" 10 25 1 1 H:\OutputZipFolder\T1.zip
Start Time: Thu Feb 20 22:47:46 2020
Running script ProcessGeogridFile...
Begining processing on Thu Feb 20 22:47:46 2020
64-bit: False
Input parameters:
    Parameter: Input GEOGRID File: H:\WRF Hydro\wrf domain\DOMAIN_1\geo_em.d01.nc
    Parameter: Forecast Points (CSV): H:\WRF Hydro\brahmaputra_frxst_pts_csv.csv
    Parameter: Mask CHANNELGRID variable to forecast basins?: true
    Parameter: Create reach-based routing (RouteLink) files?: true
    Parameter: Create lake parameter (LAKEPARM) file?: false
    Parameter: Reservoirs Shapefile or Feature Class: None
    Parameter: Input Elevation Raster: H:\WRF Hydro\EURASIA\eurasia.tif
    Parameter: Regridding (nest) Factor: 10
    Parameter: Number of routing grid cells to define stream: 25
    Parameter: OVROUGHRTFAC Value: 1
    Parameter: RETDEPRTFAC Value: 1
    Parameter: Output ZIP File: H:\OutputZipFolder\T1.zip
None
Step 1: NetCDF Conversion initiated...
    Map Projection: Lambert Conformal Conic
    Using MOAD_CEN_LAT for latitude of origin.
    Using Standard Parallel 2 in Lambert Conformal Conic map projection.
    Step 1 completed without error.
    The GEOGRID File resolution is 10000.0sm
    Proj4: +proj=lcc +units=m +a=6370000.0 +b=6370000.0 +lat_1=28.495 +lat_2=28.495 +lat_0=28.495 +lon_0=90.017 +x_0=0 +y_0=0 +k_0=1.0 +nadgrids=@null +wktext  +no_defs 
    GeoTransform: -995000.934121 10000.0 0 745001.511341 0 -10000.0
    Created projection definition from input NetCDF GEOGRID file.
Creating CF-netCDF File.
    Esri PE String: PROJCS["Sphere_Lambert_Conformal_Conic",GEOGCS["GCS_Sphere",DATUM["D_Sphere",SPHEROID["Sphere",6370000.0,0.0]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Lambert_Conformal_Conic_2SP"],PARAMETER["false_easting",0.0],PARAMETER["false_northing",0.0],PARAMETER["central_meridian",90.017],PARAMETER["standard_parallel_1",28.495],PARAMETER["standard_parallel_2",28.495],PARAMETER["latitude_of_origin",28.495],UNIT["Meter",1.0]]
    Map Projection of input raster : lambert_conformal_conic
    Dimensions created after  0.02 seconds.
    Coordinate variables and variable attributes set after  0.02 seconds.
    netCDF global attributes set after  0.02 seconds.
Step 2 initiated...
    The GEOGRID File resolution is 10000.0sm
    The High-resolution dataset will be 1000.0m
    Tranformation: GeoTransform_Null_WRFHydro
    MakeRasterLayer process completed without error.
    The coarse grid has 149 rows and 199 columns.
    The input elevation grid (before reprojection) has 3198 rows and 5206 columns.
    Projecting input elevation data to WRF coordinate system.
    ArcGIS version 10.3.1 found. Using Custom Geotransformation (GeoTransform_Null_WRFHydro)
    Finished projecting input elevation data to WRF coordinate system.
    The fine grid (before ExtractByMask) has 1531 rows and 2265 columns.
    Fine Grid has 1490 rows and 1990 columns.
    Step 2 completed without error.
    Deriving geocentric coordinates on routing grid from bilinear interpolation of geogrid coordinates.
Creating CF-netCDF File.
    Esri PE String: PROJCS["Sphere_Lambert_Conformal_Conic",GEOGCS["GCS_Sphere",DATUM["D_Sphere",SPHEROID["Sphere",6370000.0,0.0]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Lambert_Conformal_Conic_2SP"],PARAMETER["false_easting",0.0],PARAMETER["false_northing",0.0],PARAMETER["central_meridian",90.017],PARAMETER["standard_parallel_1",28.495],PARAMETER["standard_parallel_2",28.495],PARAMETER["latitude_of_origin",28.495],UNIT["Meter",1.0]]
    Map Projection of input raster : lambert_conformal_conic
    Dimensions created after  0.00 seconds.
    Coordinate variables and variable attributes set after  0.05 seconds.
    Proceeding to add LATITUDE and LONGITUDE variables after  0.05 seconds.
    Variables populated after  0.66 seconds.
    Process completed without error.
    LATITUDE and LONGITUDE variables and variable attributes set after  0.66 seconds.
    netCDF global attributes set after  0.66 seconds.
    Process: landuse written to output netCDF.
Step 4 initiated...
    Channelgrid will be masked to basins.
    Reach-based routing files will be created.
Exception: ERROR 010429: Error in GRID IO: CellLyrCreateInternal: Unable to create cell layer directory c:\progra~2\arcgis\deskto~1.3\arctoo~1\toolbo~1\t_t87  .
ERROR 010302: Unable to create the output raster: Toolboxes\System Toolboxes\t_t87
ERROR 010067: Error in executing grid expression.
Failed to execute (Fill).

Error encountered after 11.0209999084 seconds.
ERROR
Completed script ProcessGeogridFile...
Failed to execute (ProcessGeogridFile).
Failed at Thu Feb 20 22:47:57 2020 (Elapsed Time: 11.23 seconds)

Unable to figure out what has caused it to stop functioning like it used to before. Any help will be highly appreciated.

Walter

Kevin

unread,
Feb 20, 2020, 12:33:32 PM2/20/20
to wrf-hydro_users
Walter,

I am glad that you have been having a good experience using the tools up until today. Thank you for posting the error messages you received when the tool failed. The failure occurred on the "Fill" tool, which is a spatial analyst tool that fills depressions. Do you have Spatial Analyst enabled? Are you able to run the Fill tool independently without error?

If so, then I wonder if you have run into a permission issue in the output directory or with your current, default, or scratch workspace environments. These Esri errors can be difficult to interpret, though it is clear that a temporary output file is causing the issue. I wonder why it is trying to create a temporary output "t_t87" in the "Toolboxes\System Toolboxes" directory. I would first check your environments (under the "Analysis" tab in Pro) at the application and tool level and try to change your "Current Workspace" and "Scratch Workspace" environments to a directory on disk that you have adequate read-write permissions (and do not set this to a geodatabase). You may need to go into this directory and clean out any unnecessary temporary raster files: c:\progra~2\arcgis\deskto~1.3\arctoo~1\toolbo~1\t_t87

Also, is your "H:" directory local? Sometimes ArcGIS has trouble writing to network drives.

I hope some of these suggestions will reveal the error,

Kevin

Walter Samuel

unread,
Feb 20, 2020, 12:56:23 PM2/20/20
to wrf-hyd...@ucar.edu
Hey Kevin

Thanks for the prompt response. I followed your advice and realised that the environment settings was the culprit. 




--
You received this message because you are subscribed to the Google Groups "wrf-hydro_users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.
To view this discussion on the web visit https://groups.google.com/a/ucar.edu/d/msgid/wrf-hydro_users/4da1f8a3-d38c-46e1-a5ac-15d820ff191b%40ucar.edu.

Kevin

unread,
Feb 20, 2020, 1:06:59 PM2/20/20
to wrf-hydro_users
Walter,

I am glad to hear it, and I hope this discussion helps others if they encounter similar problems in ArcGIS Pro.

Kevin

Lien

unread,
Apr 15, 2020, 10:57:58 AM4/15/20
to wrf-hydro_users
Hello

I have been using the ArcGIS Preprocessing toolbox and it has been working perfectly well. 

Today when I wanted to use it, it has begun to give me the following error


Vào 00:21:49 UTC+7 Thứ Sáu, ngày 21 tháng 2 năm 2020, Walter Samuel đã viết:
Hello

I have been using the ArcGIS Preprocessing toolbox and it has been working perfectly well. 

Today when I wanted to use it, it has begun to give me the following error
    Unable to figure out what has caused it to stop functioning like it used to before. Any help will be highly appreciated. 
    Lien.
Capture.PNG
Capture1.PNG

Kevin

unread,
Apr 15, 2020, 2:34:01 PM4/15/20
to wrf-hydro_users
Lien,

I see that the script is encountering an error after trying unsuccessfully to build default WRF-Hydro groundwater basin inputs for your routing stack. You might want to try testing a newer version of the GIS Pre-processing tools (current version is 5.1.1). If you are using a version >= 5.0, then you can open the 'GEOGRID_STANDALONE.pyt' script in any text editor and change the global variable 'GW_with_Stack' from True to False. This should keep the pre-processor from building any groundwater inputs for WRF-Hydro. If the script succeeds after making this change, then the problem has to do with the grids being used to derive the groundwater inputs (CHANNELGRID, FLOWDIRECTION).

Cheers,

Kevin

Lien Nguyen

unread,
Apr 15, 2020, 9:30:14 PM4/15/20
to wrf-hyd...@ucar.edu
Kevin,
I have followed your instructions but still have errors. As I understand, the request is running on 64bit background processing, but my machine is running on python 32bit . I have found out how to fix it into 64bit but it still has not been successful. Do you have any way to help me? I am using arcgis 10.6.
Thanks.
Lien.

Vào Th 5, 16 thg 4, 2020 vào lúc 01:34 Kevin <ksam...@ucar.edu> đã viết:
--
You received this message because you are subscribed to the Google Groups "wrf-hydro_users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.
To view this discussion on the web visit https://groups.google.com/a/ucar.edu/d/msgid/wrf-hydro_users/c2e0cf89-4df4-4ea2-b366-669144c32651%40ucar.edu.

Walter Samuel

unread,
Apr 27, 2020, 1:14:16 PM4/27/20
to wrf-hydro_users
Hey Kevin 

I have again come across a problem with the geoprocessing toolbox.

When I use a  regridding factor to get a routing resolution of 100 m I end up getting this error. Is this because I have a large domain? 

Executing: ProcessGeogridFile "H:\WRF Hydro\wrf domain\DOMAIN_4\geo_em.d01.nc" "H:\WRF Hydro\brahmaputra_frxst_pts_csv.csv" true true false # "H:\WRF Hydro\EURASIA\eurasia.tif" 250 50 1 1 "H:\WRF Hydro\Process_GEOGRID\gb_1.zip"
Start Time: Mon Apr 27 22:04:50 2020
Running script ProcessGeogridFile...
Begining processing on Mon Apr 27 22:04:50 2020
64-bit: False
Input parameters:
    Parameter: Input GEOGRID File: H:\WRF Hydro\wrf domain\DOMAIN_4\geo_em.d01.nc
    Parameter: Forecast Points (CSV): H:\WRF Hydro\brahmaputra_frxst_pts_csv.csv
    Parameter: Mask CHANNELGRID variable to forecast basins?: true
    Parameter: Create reach-based routing (RouteLink) files?: true
    Parameter: Create lake parameter (LAKEPARM) file?: false
    Parameter: Reservoirs Shapefile or Feature Class: None
    Parameter: Input Elevation Raster: H:\WRF Hydro\EURASIA\eurasia.tif
    Parameter: Regridding (nest) Factor: 250
    Parameter: Number of routing grid cells to define stream: 50
    Parameter: OVROUGHRTFAC Value: 1
    Parameter: RETDEPRTFAC Value: 1
    Parameter: Output ZIP File: H:\WRF Hydro\Process_GEOGRID\gb_1.zip
None
Step 1: NetCDF Conversion initiated...
    Map Projection: Lambert Conformal Conic
    Using MOAD_CEN_LAT for latitude of origin.
    Using Standard Parallel 2 in Lambert Conformal Conic map projection.
    Step 1 completed without error.
    The GEOGRID File resolution is 25000.0sm
    Proj4: +proj=lcc +units=m +a=6370000.0 +b=6370000.0 +lat_1=28.584 +lat_2=28.584 +lat_0=28.584 +lon_0=86.196 +x_0=0 +y_0=0 +k_0=1.0 +nadgrids=@null +wktext  +no_defs 
    GeoTransform: -1487500.41217 25000.0 0 737501.810933 0 -25000.0
    Created projection definition from input NetCDF GEOGRID file.
Creating CF-netCDF File.
    Esri PE String: PROJCS["Sphere_Lambert_Conformal_Conic",GEOGCS["GCS_Sphere",DATUM["D_Sphere",SPHEROID["Sphere",6370000.0,0.0]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]],PROJECTION["Lambert_Conformal_Conic_2SP"],PARAMETER["false_easting",0.0],PARAMETER["false_northing",0.0],PARAMETER["central_meridian",86.196],PARAMETER["standard_parallel_1",28.584],PARAMETER["standard_parallel_2",28.584],PARAMETER["latitude_of_origin",28.584],UNIT["Meter",1.0]]
    Map Projection of input raster : lambert_conformal_conic
    Dimensions created after  0.00 seconds.
    Coordinate variables and variable attributes set after  0.01 seconds.
    netCDF global attributes set after  0.01 seconds.
Step 2 initiated...
    The GEOGRID File resolution is 25000.0sm
    The High-resolution dataset will be 100.0m
    Tranformation: GeoTransform_Null_WRFHydro
    MakeRasterLayer process completed without error.
    The coarse grid has 59 rows and 119 columns.
    The input elevation grid (before reprojection) has 3152 rows and 7760 columns.
    Projecting input elevation data to WRF coordinate system.
    ArcGIS version 10.3.1 found. Using Custom Geotransformation (GeoTransform_Null_WRFHydro)
    Finished projecting input elevation data to WRF coordinate system.
    The fine grid (before ExtractByMask) has 15752 rows and 33723 columns.
    Fine Grid has 14750 rows and 29750 columns.
    Step 2 completed without error.
    Deriving geocentric coordinates on routing grid from bilinear interpolation of geogrid coordinates.

Traceback (most recent call last):
  File "<string>", line 382, in execute
  File "H:\WRF Hydro\wrf_hydro_arcgis_preprocessor-5.1.1\wrf_hydro_arcgis_preprocessor-5.1.1\wrf_hydro_functions.py", line 1200, in coordMethod1
    latArr2 = arcpy.RasterToNumPyArray(latRaster2)
  File "c:\program files (x86)\arcgis\desktop10.3\arcpy\arcpy\__init__.py", line 2244, in RasterToNumPyArray
    return _RasterToNumPyArray(*args, **kwargs)
MemoryError

Failed to execute (ProcessGeogridFile).
Failed at Mon Apr 27 22:20:32 2020 (Elapsed Time: 15 minutes 42 seconds)

Kevin

unread,
Apr 27, 2020, 1:40:29 PM4/27/20
to wrf-hydro_users
Lien,

I am still not sure of the error. Did you install the ArcGIS 64-bit Background Geoprocessing module? If you have, then these python scripts will be executed using 64-bit python instead of 32-bit. I also suggest you upgrade to the latest version of the WRF-Hydro GIS Pre-processor (5.1.1) and upgrade your ArcGIS Desktop to 10.7 or 10.8 (much newer than 10.6). You could also run this in ArcGIS Pro. Let me know how it goes and please provide as much diagnostic information as possible if you are still encountering an error.

Kevin

On Wednesday, April 15, 2020 at 7:30:14 PM UTC-6, Lien wrote:
Kevin,
I have followed your instructions but still have errors. As I understand, the request is running on 64bit background processing, but my machine is running on python 32bit . I have found out how to fix it into 64bit but it still has not been successful. Do you have any way to help me? I am using arcgis 10.6.
Thanks.
Lien.

Vào Th 5, 16 thg 4, 2020 vào lúc 01:34 Kevin đã viết:
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_users+unsubscribe@ucar.edu.

Kevin

unread,
Apr 27, 2020, 1:46:45 PM4/27/20
to wrf-hydro_users
Walter,

This error happens when you run out of memory. It does tend to happen on large grid sizes. I see that your regridding factor is 250, and we typically suggest keeping this value below 20. With a regridding factor of 250, you end up with 62,500 routing grid cells for every 1 LSM grid cell. You are moving water around on a very fine grid, but the LSM is has no variation over each of its 25km grid cells. If you want 100m routing that is meaningful, you might consider running the LSM on a finer grid. Using your input parameters, the tool is trying to build a routing grid of 3152x7760. This is rather large, but you may be able to do it with enough RAM.

The most important thing to increase your chances of a successful pre-processing is to install the 64-bit Background Geoprocessing module for ArcGIS Desktop. This will install 64-bit Python and will run the tool against the 64-bit version of Python. You will be able to process much larger datasets this way. You could also run this tool from within ArcGIS Pro, which has 64-bit Python built-in.

Good luck,

Kevin

Lien Nguyen

unread,
Apr 28, 2020, 9:06:07 AM4/28/20
to wrf-hyd...@ucar.edu
Hi Kevin.
I installed Arcgis 10.7.1 and succeeded.Thank you very much.
Lien.

Vào Th 3, 28 thg 4, 2020 vào lúc 00:40 Kevin <ksam...@ucar.edu> đã viết:
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.

--
You received this message because you are subscribed to the Google Groups "wrf-hydro_users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.
To view this discussion on the web visit https://groups.google.com/a/ucar.edu/d/msgid/wrf-hydro_users/2a0120c1-b7fe-4bc0-8a5f-68ffa75fa902%40ucar.edu.

Lien Nguyen

unread,
Apr 28, 2020, 10:27:11 AM4/28/20
to wrf-hyd...@ucar.edu
Kevin,
I followed the instructions from the video but the result doesn't have some '.TBL' files as in the video  tutorial. Can you help me?
Lien.



Vào Th 3, 28 thg 4, 2020 vào lúc 20:05 Lien Nguyen <nguyenl...@gmail.com> đã viết:
test.PNG
videohuongdan.png

Kevin

unread,
Apr 28, 2020, 11:30:13 AM4/28/20
to wrf-hydro_users
Lien,

The video tutorial is based on an older version of the WRF-Hydro ArcGIS Pre-processor. If you are running with a more recent version (v5.1.0 or v5.1.1), then the outputs are now in netCDF format instead of the ASCII .TBL format.


On Tuesday, April 28, 2020 at 8:27:11 AM UTC-6, Lien wrote:
Kevin,
I followed the instructions from the video but the result doesn't have some '.TBL' files as in the video  tutorial. Can you help me?
Lien.



Vào Th 3, 28 thg 4, 2020 vào lúc 20:05 Lien Nguyen đã viết:
Hi Kevin.
I installed Arcgis 10.7.1 and succeeded.Thank you very much.
Lien.

Vào Th 3, 28 thg 4, 2020 vào lúc 00:40 Kevin đã viết:
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_users+unsubscribe@ucar.edu.

--
You received this message because you are subscribed to the Google Groups "wrf-hydro_users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_users+unsubscribe@ucar.edu.

Lien Nguyen

unread,
Apr 28, 2020, 8:44:09 PM4/28/20
to wrf-hyd...@ucar.edu
Kevin, 
Thank you very much.


Vào Th 3, 28 thg 4, 2020 vào lúc 22:30 Kevin <ksam...@ucar.edu> đã viết:
Lien,

To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.

--
You received this message because you are subscribed to the Google Groups "wrf-hydro_users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.

--
You received this message because you are subscribed to the Google Groups "wrf-hydro_users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wrf-hydro_use...@ucar.edu.
To view this discussion on the web visit https://groups.google.com/a/ucar.edu/d/msgid/wrf-hydro_users/6233732e-c4f2-43e7-8a5e-fdf60a2224d8%40ucar.edu.

Walter Samuel

unread,
Apr 30, 2020, 12:32:35 PM4/30/20
to wrf-hydro_users
Thank you Kevin.

sunny

unread,
Mar 6, 2025, 4:55:49 AMMar 6
to wrf-hydro_users, Walter
Hello

I have been using the ArcGIS Preprocessing toolbox and it has been working perfectly well. 
Today when I wanted to use it, it has begun to give me the following error.
屏幕截图 2025-03-06 154611.png
屏幕截图 2025-03-06 154811.png
Reply all
Reply to author
Forward
0 new messages