Unable to download files or Site Not Available

[Chris]

For the last couple of days, I've had limited success in downloading hycom files. I've got several different servers, all of them are having the same results. I can browse the directory contents, and I see that the filenames exist, but I am not able to download them.

Programmatically, I try to download via wget, but it just retries. If I try to download via a browser, I get "site cant be reached"

Any status on being able to download the datasets?

The file below is one example:

https://tds.hycom.org/thredds/fileServer/datasets/GLBy0.08/expt_93.0/data/hindcasts/2023/hycom_glby_930_2023101112_t000_ts3z.nc

[Parker MacCready]

I have had similar problems the last few days.

I use a limited-region extraction of hycom daily as boundary conditions for a forecast model, and usually this works fine. I use two methods. In the first I try the NCO ncks command with a string constructed like:

    vstr = 'surf_el,water_temp,salinity,water_u,water_v,depth'
    cmd_list = ['ncks',
        '-d', 'time,'+dstr0+','+dstr1+',8',
        '-d', 'lon,'+str(west)+'.,'+str(east)+'.,1',
        '-d','lat,'+str(south)+'.,'+str(north)+'.,1',
        '-v',vstr, 'https://tds.hycom.org/thredds/dodsC/GLBy0.08/latest',
        '-4', '-O', full_fn_out]
(this is passed to a python subprocess).

My second method is to get one day at a time with a python requests call to a url like:

    url = ('https://ncss.hycom.org/thredds/ncss/GLBy0.08/expt_93.0/FMRC/GLBy0.08_930_FMRC_best.ncd'+
        '?var='+var_list +
        '&north='+str(north)+'&south='+str(south)+'&west='+str(west)+'&east='+str(east) +
        '&time='+dstr_hy +
        '&addLatLon=true&accept=netcdf4') 

In general the first works fine, but sometimes I need to use the second. Today and yesterday neither worked.

I wonder if the servers are overloaded?

Cheers,

Parker

[Michael McDonald]

The backend storage is running slower than normal the past few days while failing disks are replaced in the array, so you likely need to extend your client timeouts and ask for smaller data chunks per request. 

When you see traffic graphs with "green" here, that is a sign data is still flowing.

https://www.hycom.org/tools/status

--
--
You received this message because you are a member of HYCOM.org
To ask a question, send an email to fo...@hycom.org

--

Michael McDonald
HYCOM.org Administrator