PyAPS authorized and acepted the terms but failed to download

398 views
Skip to first unread message

hike L

unread,
Sep 22, 2021, 11:52:17 PM9/22/21
to MintPy
Hi everyone,

I used to successfully download grib files of ERA5 using PyAPS during MintPy processing, but recently I have a problem when downloading the grib files of my new study area. Here is the error:

2021-09-22 17:29:18,114 WARNING Recovering from connection error [HTTPSConnectionPool(host='cds.climate.copernicus.eu', port=443): Max retries exceeded with url: /api/v2/resources/reanalysis-era5-pressure-levels (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x2b1d5685b250>: Failed to establish a new connection: [Errno -2] Name or service not known'))], attemps 0 of 500
2021-09-22 17:29:18,114 WARNING Retrying in 120 seconds
2021-09-22 17:31:18,160 INFO Retrying now...
2021-09-22 17:31:18,166 WARNING Recovering from connection error [HTTPSConnectionPool(host='cds.climate.copernicus.eu', port=443): Max retries exceeded with url: /api/v2/resources/reanalysis-era5-pressure-levels (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x2b1d5685fa90>: Failed to establish a new connection: [Errno -2] Name or service not known'))], attemps 1 of 500
2021-09-22 17:31:18,166 WARNING Retrying in 120 seconds
2021-09-22 17:33:18,241 INFO Retrying now...
2021-09-22 17:33:18,247 WARNING Recovering from connection error [HTTPSConnectionPool(host='cds.climate.copernicus.eu', port=443): Max retries exceeded with url: /api/v2/resources/reanalysis-era5-pressure-levels (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x2b1d5685b370>: Failed to establish a new connection: [Errno -2] Name or service not known'))], attemps 2 of 500
2021-09-22 17:33:18,247 WARNING Retrying in 120 seconds
2021-09-22 17:35:18,339 INFO Retrying now...
2021-09-22 17:35:18,350 WARNING Recovering from connection error [HTTPSConnectionPool(host='cds.climate.copernicus.eu', port=443): Max retries exceeded with url: /api/v2/resources/reanalysis-era5-pressure-levels (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x2b1d5685f0a0>: Failed to establish a new connection: [Errno -2] Name or service not known'))], attemps 3 of 500
2021-09-22 17:35:18,350 WARNING Retrying in 120 seconds

I tried to solve it and then I updated the PyAPS to latest version. I tested pyaps3 by run  the scripts TestPyAPS.py (located in ./PyAPS/examples/), but unlukily another error came like this:

(mintpy) [zzusaa02@login05 ~]$ python testPyAPS.py

------------------------------------------------

You are using PyAPS from /public/home/zzusaa02/tools/PyAPS/pyaps3/__init__.py

------------------------------------------------

Testing Download Methods

Testing ECMWF Downloads

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2

Downloading 1 of 1: ./ECMWF/ERA-5_20150503_00.grb

{'product_type': 'reanalysis', 'format': 'grib', 'variable': ['geopotential', 'temperature', 'specific_humidity'], 'pressure_level': ['1', '2', '3', '5', '7', '10', '20', '30', '50', '70', '100', '125', '150', '175', '200', '225', '250', '300', '350', '400', '450', '500', '550', '600', '650', '700', '750', '775', '800', '825', '850', '875', '900', '925', '950', '975', '1000'], 'year': '2015', 'month': '05', 'day': '03', 'time': '00:00'}

2021-09-23 10:10:11,512 INFO Welcome to the CDS

2021-09-23 10:10:11,513 INFO Sending request to https://cds.climate.copernicus.eu/api/v2/resources/reanalysis-era5-pressure-levels

2021-09-23 10:10:11,840 INFO Request is queued

2021-09-23 10:10:14,924 INFO Request is running

2021-09-23 10:10:21,135 INFO Request is completed

2021-09-23 10:10:21,135 INFO Downloading https://download-0006.copernicus-climate.eu/cache-compute-0006/cache/data9/adaptor.mars.internal-1632363019.3601813-7063-15-e8e9cccb-3fcc-40a1-a62b-e2d24f428952.grib to ./ECMWF/ERA-5_20150503_00.grb (219.8M)

Traceback (most recent call last):                                                                                                                                                         

  File "test_cds.py", line 13, in <module>

    pa.ECMWFdload(['20150503'],'00','./ECMWF','ERA5','fc')

  File "/public/home/zzusaa02/tools/PyAPS/pyaps3/autoget.py", line 138, in ECMWFdload

    c.retrieve('reanalysis-{}-pressure-levels'.format(model.lower()),indict,target=fname)

  File "/public/home/zzusaa02/miniconda3/envs/mintpy/lib/python3.8/site-packages/cdsapi/api.py", line 350, in retrieve

    result.download(target)

  File "/public/home/zzusaa02/miniconda3/envs/mintpy/lib/python3.8/site-packages/cdsapi/api.py", line 173, in download return self._download(self.location, self.content_length, target)

  File "/public/home/zzusaa02/miniconda3/envs/mintpy/lib/python3.8/site-packages/cdsapi/api.py", line 132, in _download

    with open(target, mode) as f:

FileNotFoundError: [Errno 2] No such file or directory: './ECMWF/ERA-5_20150503_00.grb'


Even if I re-created a new account of CDS, these two errors still exsist. Could you please give me a hand?

Best

Liang.

Russell Grew

unread,
Sep 23, 2021, 3:01:26 AM9/23/21
to min...@googlegroups.com
I think they have been experiencing some issues. I had the first error you report earlier in the week.

I hope this helps.

--
You received this message because you are subscribed to the Google Groups "MintPy" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mintpy+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mintpy/11eff304-94df-4272-a8da-80db9cc4792cn%40googlegroups.com.

hike L

unread,
Oct 4, 2021, 10:24:00 AM10/4/21
to MintPy
Thanks for your reply, sir. I can download ERA-5 files through the API python code on my terminal but failed in MintPy. I later  manually  downloaded the ERA-5 files from the website and successfully ran the step of tropospheric correction.
Reply all
Reply to author
Forward
Message has been deleted
0 new messages