I'm trying to run a pysa-eur sector-coupled scenario with all countries and 39 clusters that is pretty similar to the default config. At some point I am getting the error below. I have tried installing the suggested plug-in but that doesn't seem to work with the current pypsa-eur environment. I can get rid of the error message when setting the max_depth and min_depth in the config file to false, as the nc file is then not needed, but that results in very high off-shore wind capacities as there is not depth constraint.
localrule build_clustered_population_layouts:
input: resources/allc_sec_depthtest/
pop_layout_total.nc, resources/allc_sec_depthtest/
pop_layout_urban.nc, resources/allc_sec_depthtest/
pop_layout_rural.nc, resources/allc_sec_depthtest/regions_onshore_base_s_39.geojson, cutouts/
europe-2013-sarah3-era5.nc output: resources/allc_sec_depthtest/pop_layout_base_s_39.csv
log: logs/allc_sec_depthtest/build_clustered_population_layouts_s_39.log
jobid: 57
benchmark: benchmarks/allc_sec_depthtest/build_clustered_population_layouts/s_39
reason: Missing output files: resources/allc_sec_depthtest/pop_layout_base_s_39.csv; Input files updated by another job: resources/allc_sec_depthtest/
pop_layout_total.nc, resources/allc_sec_depthtest/
pop_layout_rural.nc, resources/allc_sec_depthtest/regions_onshore_base_s_39.geojson, resources/allc_sec_depthtest/
pop_layout_urban.nc wildcards: clusters=39
resources: tmpdir=/tmp/8007850.1.debian.q, mem_mb=10000, mem_mib=9537
ERROR:root:Uncaught exception
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "rasterio/_base.pyx", line 310, in rasterio._base.DatasetBase.__init__
File "rasterio/_base.pyx", line 221, in rasterio._base.open_dataset
File "rasterio/_err.pyx", line 359, in rasterio._err.exc_wrap_pointer
rasterio._err.CPLE_OpenFailedError: 'data/bundle/gebco/GEBCO_2014_2D.nc' not recognized as being in a supported file format. It could have been recognized by driver HDF5, but plugin gdal_HDF5.so is not available in your installation. You may install it with 'conda install -c conda-forge libgdal-hdf5'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "~/.conda/envs/pypsa-eur/lib/python3.12/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
^^^^^^^^^^^^^^^^^^^
File "~/.conda/envs/pypsa-eur/lib/python3.12/multiprocessing/pool.py", line 48, in mapstar
return list(map(*args))
^^^^^^^^^^^^^^^^
File "~/.conda/envs/pypsa-eur/lib/python3.12/site-packages/atlite/gis.py", line 666, in _process_func
return shape_availability_reprojected(shapes.loc[[i]], *args)[0]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "~/.conda/envs/pypsa-eur/lib/python3.12/site-packages/atlite/gis.py", line 361, in shape_availability_reprojected
masked, transform = shape_availability(geometry, excluder)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "~/.conda/envs/pypsa-eur/lib/python3.12/site-packages/atlite/gis.py", line 286, in shape_availability
excluder.open_files()
File "~/.conda/envs/pypsa-eur/lib/python3.12/site-packages/atlite/gis.py", line 477, in open_files
raster = rio.open(raster)
^^^^^^^^^^^^^^^^
File "~/.conda/envs/pypsa-eur/lib/python3.12/site-packages/rasterio/env.py", line 463, in wrapper
return f(*args, **kwds)
^^^^^^^^^^^^^^^^
File "~/.conda/envs/pypsa-eur/lib/python3.12/site-packages/rasterio/__init__.py", line 356, in open
dataset = DatasetReader(path, driver=driver, sharing=sharing, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "rasterio/_base.pyx", line 312, in rasterio._base.DatasetBase.__init__
rasterio.errors.RasterioIOError: 'data/bundle/gebco/GEBCO_2014_2D.nc' not recognized as being in a supported file format. It could have been recognized by driver HDF5, but plugin gdal_HDF5.so is not available in your installation. You may install it with 'conda install -c conda-forge libgdal-hdf5'
"""