Hyrax Error 400

[Barker, Brittany S]

Hello,

I’m unable to download Daymet for 2024 using the script that had worked for me in prior years. On my server, I’m getting an error “Username/Password Authentication Failed.” I don’t recall having to use a username or password before, though I do have one for accessing NASA data. How do I include this information in my wget request? Is there an example somewhere?

 

Also, I’m getting a “Hyrax – Bad Request (400)” when I click on the web link to access THREDDS. This didn’t happen before either.

 

Thanks for any help,

Brittany

# -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
#
# We're sorry you had a problem using the server.
# Please use the space above to describe what you
# were trying to do and we will try to assist you.
# Thanks,
# OPeNDAP Support.
#
# -- -- -- hyrax error info, please include -- -- --
#
# ReqInfo.getRequestUrl(): https://opendap.earthdata.nasa.gov/thredds/catalogs/ornldaac/Regional_and_Global_Data/DAYMET_COLLECTIONS/DAYMET_COLLECTIONS.html

# request_url: https://opendap.earthdata.nasa.gov/error/error400.jsp
# protocol: HTTP/1.1
# server: opendap.earthdata.nasa.gov
# port: 443
# javax.servlet.forward.request_uri: /thredds/catalogs/ornldaac/Regional_and_Global_Data/DAYMET_COLLECTIONS/DAYMET_COLLECTIONS.html

# query_string: n/a
# status: 400
# message: NgapApi::build_cmr_query_url() - The specified path '/thredds/catalogs/ornldaac/Regional_and_Global_Data/DAYMET_COLLECTIONS/DAYMET_COLLECTIONS' contains neither the '/collections/' nor the '/concepts/' one must be provided.

#
# -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

[Miguel Jimenez]

Hi Brittany, 

Thanks for reaching out. There is a chance that the issues you are experiencing have to do with an ongoing NASA effort to migrate their data archives to the cloud, and enforce EDL authentication. This involves deprecating some on-premises servers which may include various OPeNDAP end points. Unfortunately, some redirects are not configured correctly, and it is unclear if these will in the future (we have no control over those). We have noticed the unfortunate Thredds redirect...

I quickly searched for the OPeNDAP access URL to DAYMET, in particular the collection C2532426483-ORNL_CLOUD, and got for a granule:

  https://opendap.earthdata.nasa.gov/collections/C2532426483-ORNL_CLOUD/granules/Daymet_Daily_V4R1.daymet_v4_daily_na_tmin_2024.nc

This is the Cloud OPeNDAP url access point for NASA’s Earth data. All cloud opendap urls follow the same URL syntax:

 https://opendap.earthdata.nasa.gov/collections/<insert_collection_concept_id>/granules/<insert_granule_id>

There are ways to discover these URLs using filters such as Concept Collection ID, and time-range from the CMR. One tool that can be used to discover such URLs from NASA, is in the following online resource:

   https://pydap.github.io/pydap/en/notebooks/GetCMRURLS.html

Authentication: NASA now requires to authenticate before downloading any data. For enabling your scripts to discover EDL credentials, we recommend to start using a .netrc file, or token based authentication. You can find some examples on using a netrc file with curl or wget in the online resource below:

https://opendap.github.io/documentation/tutorials/ClientAuthentication.html#_curl_a_k_a_lib_curl_or_curl

Hope this helps! Feel free to reach out if you needs additional help

Miguel Jimenez-Urias