Download data

[dani...@gmail.com]

 

 

Dear colleagues,

I would like to download the ESPC-D-V02: Global 1/12° Analysis dataset in an automated way, without any spatial resampling, and preferably one file at a time.

 

However, I have not been able to find any script, API example, or documented method that allows this type of download workflow in Linux.

 

Could anyone please advise on the recommended approach for automating downloads of this dataset? Any example scripts, documentation, or guidance would be greatly appreciated.

 

Thank you very much for your help.

 

Best regards,

 

Daniel Constantino Zacharias

 

[Alan Wallcraft]

lftp can do this, either from the command line or as a ftp client.

For example:

lftp -e "mirror /datasets/force/ncep_cfsr/netcdf .; quit" ftp.hycom.org

Alan.

[dani...@gmail.com]

I did this: 

 

lftp ftp://ftp.hycom.org << EOF

mirror --include-glob "*t0000_u3z.nc" datasets/ESPC-D-V02/data/archive/2024  .

bye

EOF

 

 

And worked!!!!

 

Thanks

 

Daniel

[Michael McDonald]

Daniel,

You can also use rsync to replicate/update data from the server to your devices.

https://rsync.hycom.org/

e.g.,

rsync -av --progress rsync.hycom.org::datasets/ESPC-D-V02/data/archive/2024/*000_u3z.nc . -n

--
--
You received this message because you are a member of HYCOM.org
To ask a question, send an email to fo...@hycom.org

--

Michael McDonald
HYCOM.org Administrator

[dani...@gmail.com]

 

Even better

 

Thank you,

 

Regards

 

Daniel