Error and massive delays while downloading GOF3.1 analysis and reanalysis
Luana F. Bueno
My colleagues and I are experiencing error and massive delays while downloading GOF3.1 analysis and reanalysis global data that we are used to download for the past years.
Using wget within http://ncss.hycom.org/thredds/ncss/grid/GLBy0.08/expt_93.0?var=surf_el,water_u,water_v,salinity,water_temp&north=66.0&south=46.0&east=359.92&west=0.00&time_start=2022-01-01T00:00:00Z&time_end=2022-01-01T00:00:00Z&accept=netcdf, for example, we cannot download a single file neither for the reanalysis or analysis.
Downloading with python using chromedriver, "http://data.hycom.org/datasets/GLBv0.08/expt_53.X/data/1994/hycom_GLBv0.08_530_1994010112_t015.nc" is taking so much time, from 1 to 11 days.
Trying another way with python using aiohttp.Clientsession, it also fails a lot . But luckily we cache the reading information so the code retries again. For the same dataset . For example it takes more than 40 min just to get 200 MB. And to have 4.5GB it attempts like more than 50 times.
Using python to download the forecast within http://ncss.hycom.org/thredds/ncss/datasets/GLBy0.08/expt_93.0/data/forecasts/hycom_glby_930_2024071512_t168_ssh.nc?var=surf_el&south=52&north=67.5&west =-18.5&east=-0.001&horizStride=1&time_start=2024-07-22T12:00:00Z&time_end=2024-07-22T12:00:00Z&timeStride=1&vertStride=1&accept=netcdf, it keeps working normally for the past days.
We are following the e-mail in the forum and according to Michael, there's an unknown issue causing these data services to flap from working to dead. Could you please clarify this issue for us?
Kind regards,
Luana Bueno
John Osborne
Facilities issue
--
--
You received this message because you are a member of HYCOM.org
To ask a question, send an email to fo...@hycom.org
To unsubscribe from this group and stop receiving emails from it, send an email to forum+un...@hycom.org.
Luana F. Bueno
Thanks for the response, John.
Best of luck in resolving the facilities issue. I look forward to hearing good news from you.