Problem accessing FMRC Best Fields

[Parker MacCready]

Dear Forum,

For the past few days I have been having trouble with a routine HYCOM extraction. I use a URL like this:

 - getting hycom fields for 2024.03.26
https://ncss.hycom.org/thredds/ncss/GLBy0.08/expt_93.0/FMRC/GLBy0.08_930_FMRC_best.ncd?var=surf_el,water_temp,salinity,water_u,water_v&north=53&south=39&west=229&east=239&time=2024-03-26-T00:00:00Z&addLatLon=true&accept=netcdf4
 - Attempting to get data, counter = 1
 - Failed with status code:
500
 - took 0.4 seconds
2024-03-26 08:58:17.877132

This failed 4 times this morning (it worked fine for many months previously, until the past few days). The failure mode seems consistent: it is able to get the fields from yesterday and the day before, but fails on the current day.

I do the extraction using python, with the requests module:

r = requests.get(url, timeout=200)
            if r.ok:
                with open(out_fn,'wb') as f:
                    f.write(r.content)
                got_fmrc = True
                r.close()
            elif not r.ok:
                print(' - Failed with status code:')
                print(r.status_code)

I am hoping someone can help with this.

Thanks,

Parker

[Yun Liu]

I have the same issues  including all the  FMRC files

[Michael McDonald]

Parker,
Thanks for bringing this to our attention. Can you be more specific
regarding "past few days"? If I can pinpoint this to a particular date
when issues started, then I can hopefully identify the issue.

> --
> --
> You received this message because you are a member of HYCOM.org
> To ask a question, send an email to fo...@hycom.org
>

--
Michael McDonald
HYCOM.org Administrator

[Parker MacCready]

Since March 18 in my notes. 

Parker MacCready

Leo Maddox Endowed Professor in Oceanography

Research Professor, School of Oceanography

** I live and work on the land and waters of the Squaxin Island Tribe. **
Email: pm...@uw.edu
URL: faculty.washington.edu/pmacc

LiveOcean Daily Forecasts
Cell: (360) 359-1936, Office: (206) 685-9588

pronouns: he/him

[Elle T]

We've also had problems with the FMRC via opendap, I made a post here:  Time1 issue and conflicting time dimensions (google.com).

Hopefully it can be fixed soon - thanks for any help as always!

[Michael McDonald]

Parker and Elle,
Can you please specify the timezone and specific times you are making
these queries (that fail)?

[Parker MacCready]

Michael,

My standard request is made daily at 1:20 AM Pacific Time (shifts automatically between Standard and Daylight time). So it is 4:20 AM EDT/EST.

The requests have been working fine the past two days.

Thanks,

Parker

--

[Parker MacCready]

Michael,

My requests have been failing again today and yesterday. Here is the message from this morning (Pacific Time):

 - getting hycom fields for 2024.04.03
https://ncss.hycom.org/thredds/ncss/GLBy0.08/expt_93.0/FMRC/GLBy0.08_930_FMRC_best.ncd?var=surf_el,water_temp,salinity,water_u,water_v&north=53&south=39&west=229&east=239&time=2024-04-03-T00:00:00Z&addLatLon=true&accept=netcdf4

 - Attempting to get data, counter = 1
 - Failed with status code:
500

 - took 0.5 seconds
2024-03-31 01:23:33.252207

My code tries any failed request 10 times before giving up, waiting 10 seconds between tries. These days when it fails once it seems to go through all 10 tries, usually failing in under 1 sec. with the same 500 status code (server side error?).

The code ran successfully yesterday when I re-ran it by hand around 8 AM Pacific time.

Let me know if more information would help.

Thanks,

Parker

[Michael McDonald]

Please see my post in this thread that might be the cause/issue with
the FMRC you all are experiencing. We are still working on this.

https://groups.google.com/a/hycom.org/g/forum/c/TEwADrYUz2Y/m/65kNe_S9AAAJ