BALSA 2025 Release

[Aly Kotb]

When we move to BALSA, are we going to be able to use AWS command line to download specific files for a number of subjects like what I did here with the connectome db:

  s3_uri_7 = 's3://hcp-openaccess/HCP_1200/'+subject_id+'/MNINonLinear/fsaverage_LR32k/'+subject_id+ '.R.midthickness.32k_fs_LR.surf.gii'

  s3_uri_8 = 's3://hcp-openaccess/HCP_1200/'+subject_id+'/MNINonLinear/fsaverage_LR32k/'+subject_id+ '.L.midthickness.32k_fs_LR.surf.gii'

  subprocess.run(['aws', 's3', 'cp', s3_uri_7, '/content/drive/MyDrive/0_HCP_Preprocessing/'+subject_id], capture_output=True, text=True)

  subprocess.run(['aws', 's3', 'cp', s3_uri_8, '/content/drive/MyDrive/0_HCP_Preprocessing/'+subject_id], capture_output=True, text=True)

Thanks in advance.

[Elam, Jennifer]

Hi Aly,

Our HCP public datasets Amazon S3 bucket is still available with the HCP-YA data from 2017. If you have a working Amazon S3 access key, you will still be able to use it to download that data or analyze it in the cloud. We are working on getting S3 access key generation and resetting implemented in BALSA, but it’s not there yet.

 

However, do note that the data in S3 is not the updated 2025 data. We hope to eventually update the data on S3, but it is down on the list of priorities for now.

 

Best,

Jenn

 

________________________________________

Jennifer Elam, Ph.D.
Scientific Outreach, Human Connectome Project
Washington University School of Medicine
el...@wustl.edu
www.humanconnectome.org

 

--
You received this message because you are subscribed to the Google Groups "HCP-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hcp-users+...@humanconnectome.org.
To view this discussion visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/a943bffd-77dd-494d-88c7-27aa91b7d79cn%40humanconnectome.org.

 

---

The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

[Aly Kotb]

Thank you for your response.

[Glasser, Matthew]

The more up to date data we just released is what we recommend folks use going forward.

Matt.

To view this discussion visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/28320f72-836c-4731-831d-e2c86fc13bd9n%40humanconnectome.org.

[Andraž Matkovič]

Hi all,
since downloading the 2025 release from AWS is not yet available, could you advise on the best method to download the data on a headless server via CLI?

Best,
Andraž

sreda, 3. september 2025 ob 03:42:51 UTC+2 je oseba glas...@wustl.edu napisala:

[Elam, Jennifer]

Hi Andraz,

We are working on a plan for implementing one or more alternatives to the Aspera GUI, but they are not yet in place. The HCP does not support command line access via Aspera.  For now, we recommend mounting some part of your cluster filesystem with adequate space on a machine where you can install Aspera and open a browser with the Aspera plugin. 

For Linux OSs we recommend using Chrome or Chromium plugins. One group reported Debian 11 with Chrome works, but they did not have success with Debian 12 or 13. This incompatibility might be due to the fact that our Aspera server has been in use for ~12 years and is aging. We should be able to get something else in place in the coming months, but we didn't want to hold up data releases when Aspera is still working for most users. 

Best,

Jenn

---

From: Andraž Matkovič <andraz....@gmail.com>
Sent: Thursday, September 4, 2025 5:26 AM
To: HCP-Users <hcp-...@humanconnectome.org>
Cc: Glasser, Matthew <glas...@wustl.edu>; Elam, Jennifer <el...@wustl.edu>