Question Regarding Accessing HCP S1200 Dataset Programmatically

42 views
Skip to first unread message

Amir Zarie

unread,
11:27 AM (4 hours ago) 11:27 AM
to hcp-...@humanconnectome.org
Hi,

I am writing to request specific instructions on how to access the HCP S1200 dataset programmatically. I have already signed all the necessary agreement documents and currently have access to both the restricted and unrestricted datasets.

I am looking for a more efficient way to download specific files from the dataset, as I would like to avoid the manual process of downloading them in small batches from the BALSA website. If there are API credentials, command-line tools, or script-based methods you recommend for targeted downloads, please let me know.

Thank you for your assistance.

Best regards,
Amir Zarie


--
Amir Zarie • PhD Candidate, Department of Psychology
Cognition and Aging Neuroscience Laboratory at York University
1006 Sherman Health Science Research Centre
Centre for Vision Research • 4700 Keele Street • Toronto, Ontario • M3J 1P3

Elam, Jennifer

unread,
11:39 AM (4 hours ago) 11:39 AM
to hcp-...@humanconnectome.org
Hi Amir,
We are working on getting a REST-like interface implemented for HCP-YA on BALSA right now and hope to have that up in the next several weeks. In the meantime, you can access individual files from the HCP-YA AWS S3 bucket. 

To get access, you will need to register on balsa.wustl.edu. After registration, click on ConnectomeDB>HCP-Young Adult 2025 and agree to the Terms. Then click on Set/Reset AWS Credentials to get an AWS access key for the HCP bucket. You can find instructions for using the access key under the heading "Connecting to AWS Data Using These Credentials" on https://wiki.humanconnectome.org/docs/How%20To%20Connect%20to%20Connectome%20Data%20via%20AWS.html

Once you are in S3 go to hcp-openaccess>HCP_Resources>GroupAvg and select the file you want to download.

A user posted this about using command line to access the S3 bucket. I haven't tried it myself but he appears to have been successful.

Best,
Jenn

From: Amir Zarie <zari...@gmail.com>
Sent: Thursday, May 14, 2026 10:09 AM
To: hcp-...@humanconnectome.org <hcp-...@humanconnectome.org>
Subject: [hcp-users] Question Regarding Accessing HCP S1200 Dataset Programmatically
 
--
You received this message because you are subscribed to the Google Groups "HCP-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hcp-users+...@humanconnectome.org.
To view this discussion visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/CAE0_KHQN%2BqhC4ewXfz3EVK_nsE2EtwUN69pV6sxXW76pM9hKxw%40mail.gmail.com.

 

The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

Harms, Michael

unread,
12:10 PM (3 hours ago) 12:10 PM
to hcp-...@humanconnectome.org

Just an aside, once we have a REST-like interface operational, it will be intended for small(ish) downloads of specific-files (without needing to download an entire package).

 

It will not be intended as an alternative mechanism to download large amounts of data, and may be throttled to prevent that.

 

Cheers,

-MH

 

-- 

Michael Harms, Ph.D.

-----------------------------------------------------------

Professor of Psychiatry

Washington University School of Medicine

Department of Psychiatry, Box 8134

660 South Euclid Ave.

St. Louis, MO  63110

Elam, Jennifer

unread,
12:12 PM (3 hours ago) 12:12 PM
to hcp-...@humanconnectome.org
Also, there is this way another user posted to use AWS CLI:

Jenn
From: 'Harms, Michael' via HCP-Users <hcp-...@humanconnectome.org>
Sent: Thursday, May 14, 2026 11:10 AM
Reply all
Reply to author
Forward
0 new messages