FW: [Datastream #GYR-702425]: FTP access

[Chappell, Timothy D]

Support - We are looking for a way to download data from your site without having to click individual links. Is there a FTP, CURL, Python, Citrix solutions available to gather these datasets?


Timothy D. Chappell
Research, Technology & Digital Development
Upstream Integrated Solutions
ExxonMobil Upstream Research Company
22777 Spring Woods Village Parkway
Spring, TX 77389
Phone: 832-624-7967
Cell : 832-577-969

-----Original Message-----
From: Unidata Datastream Support <support-d...@unidata.ucar.edu>
Sent: Wednesday, August 11, 2021 1:53 PM
To: Chappell, Timothy D <timothy.d...@exxonmobil.com>
Cc: Evans, Sarah D <sarah....@exxonmobil.com>
Subject: [Datastream #GYR-702425]: FTP access

External Email - Think Before You Click



Hi again,

re:
> Sarah - Can you provide an example of the dataset you are trying to pull down
> so we can look at "curl command" options to retrieve this data?
> I used the link you provided in a previous email
>
> (http://tds.hycom.org/thredds/catalogs/GLBy0.08/expt_93.0.html)
>
> but support needs a little more information to assist with this effort. Thanks

I thought that you were trying to access one of the THREDDS servers
that we maintain, not one that is operated and supported by others.
The machine on which our main THREDDS server lives also provides
a web interface to the same sets of data served by THREDDS (but
this does not include Hycom data). My comment about using 'wget'
or 'curl' was based on my assuming that you were trying to get
data from us, and that would be possible on our site, but I
have no idea if it would be possible on the hycom.org site.

I just went to the hycom.org main TDS catalog page

http://tds.hycom.org/thredds/catalog.html

clicked on the Info link at the bottom:

http://tds.hycom.org/thredds/serverInfo.html

and see the following contact information for the site:

Contact:
Name: HYCOM.org Forum
Organization: HYbrid Coordinate Ocean Model (HYCOM)
Email: fo...@hycom.org

Host Institution: HYCOM.org

Hopefully, someone will respond to an email sent to fo...@hycom.com
asking about an easier way to access the Hycom data.

re:
> We use the Hindcast Data. From this link I chose the complete
> dataset link
> (http://tds.hycom.org/thredds/catalogs/GLBy0.08/expt_93.0.html?dataset=GLBy0.08-expt_93.0).
> This directs to the download site, where someone would FTP the entire dataset
> (ftps://ftp.hycom.org/datasets/GLBy0.08/expt_93.0).

> This is the description of the data set:
> GOFS 3.1: 41-layer HYCOM + NCODA Global 1/12° Analysis (NRL)/GLBy0.08/expt_93.0/Hindcast Data: Dec-04-2018 to Present *3-hourly*/GLBy0.08_expt_93.0 (ssh, ts3z, and uv3z aggregated)
>
> Documentation about the data set:
> https://www.hycom.org/dataserver/gofs-3pt1/analysis
>
> Contact we have been working with:
> Michael....@HYCOM.org (data manager)

OK, this sounds like you already know who to talk to at Hycom.org.

Best of luck in getting the data you need!

Cheers,

Tom
--
****************************************************************************
Unidata User Support UCAR Unidata Program
(303) 497-8642 P.O. Box 3000
sup...@unidata.ucar.edu Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: GYR-702425
Department: Support Datastream
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.

[Michael McDonald]

Timothy,

Yes. From https://www.hycom.org/dataserver scroll down slightly to see
the "Access Methods" section where we have all of the supported access
methods listed (click the "Read more..." under each (were available)
for additional service details.

e.g.,

* RSYNC
https://www.hycom.org/dataserver/access-methods/rsync

* FTP / FTPS
https://www.hycom.org/dataserver/access-methods/ftp-ftps