Need a better way to download the ISCCP H series files

[Dai, Aiguo]

Hello,

I'm trying to download the ISCCP Hseries dataset (from 1983-2017) from

https://www.ncei.noaa.gov/thredds/catalog/cdr/isccp_h/isccp-basic/hgh/catalog.html

However, it requires several clicks to download one single file, and there are 8x12x(2017-1982)=27,843,360 files!

After downloading the files for 2017, my right arm already got hurt. There must be a more efficient way to distribute the dataset. For example, all files for one year can be put in one tar file and then users will only need to download 35 files for the entire dataset. 

PLEASE do something to help users to obtain the dataset more easily.

Thank you,

Aiguo Dai 

--- 
Aiguo Dai, Ph.D.
Distinguished Professor
Department of Atmospheric & Environmental Sciences
University at Albany, SUNY, ETEC Bldg, Room 496 - Harriman Campus
1220 Washington Ave,Albany, NY 12226
Phone:  (518) 442-4474; FAX: (518) 442-5825; e-mail: ad...@albany.edu
Homepage: http://www.atmos.albany.edu/facstaff/adai/
Google Scholar: https://scholar.google.com/citations?user=qYIJJ1AAAAAJ&hl=en
Web of Science: https://publons.com/researcher/3112146/aiguo-dai/

[Ken Knapp - NOAA Federal]

Hi-

Sorry you clicked so many times.

If you search 'bulk' on the ISCCP Q&A forum, you'll find the notice where we provide some instructions on how to perform bulk downloads from the command line. This is the article I am referring to:

https://groups.google.com/g/isccp-qa/c/nNDWtB9M_jY/m/ktvVujH2BQAJ

I hope this helps-

-Ken

--
You received this message because you are subscribed to the Google Groups "ISCCP-QA" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isccp-qa+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/isccp-qa/DM6PR04MB59324DF7E821B30DBFFBBCC8B4B59%40DM6PR04MB5932.namprd04.prod.outlook.com.

--

Ken Knapp,

NOAA/NCEI/CSDB

828-271-4339

Disclaimer: The opinions expressed in this email are those of the author. They do not necessarily reflect the official views or policies of NOAA, Department of Commerce, or the US Government.

[Dai, Aiguo]

There seems to be a typo in the long name for cloud_type_label and cloud_irtype_label in all ISCCP Hseries files. The two long names should be switched (see below)?

--- 
Aiguo Dai, Ph.D.
Distinguished Professor
Department of Atmospheric & Environmental Sciences
University at Albany, SUNY, ETEC Bldg, Room 496 - Harriman Campus
1220 Washington Ave,Albany, NY 12226
Phone:  (518) 442-4474; FAX: (518) 442-5825; e-mail: ad...@albany.edu
Homepage: http://www.atmos.albany.edu/facstaff/adai/
Google Scholar: https://scholar.google.com/citations?user=qYIJJ1AAAAAJ&hl=en
Web of Science: https://publons.com/researcher/3112146/aiguo-dai/

---

From: Ken Knapp - NOAA Federal <ken....@noaa.gov>
Sent: Thursday, March 9, 2023 12:16 PM
To: Dai, Aiguo <ad...@albany.edu>
Cc: iscc...@googlegroups.com <iscc...@googlegroups.com>
Subject: Re: [ISCCP-Q&A] Need a better way to download the ISCCP H series files