Group files on aws s3

20 views
Skip to first unread message

Amrit Kashyap

unread,
Apr 28, 2022, 7:45:04 AM4/28/22
to HCP-Users
Hey HCP Users,
I am trying to download this file 1003 Subjects, recon r177 + r227, Group-PCA Eigenmaps but I am having problems with the aspera connect internal error. I mostly use the s3 bucket using AWS to download but I cannot find this file nor the ICA files in the file system. 

Does anyone know a workaround?
Thanks
Amrit

Hodge, Michael

unread,
Apr 28, 2022, 9:49:54 AM4/28/22
to HCP-Users

Hi Amrit,

I believe it's just subject-level data that's on AWS.  Our Aspera server is down for network and filesystem updates, but  that Aspera resource path corresponds to the following REST path:


​Regards,

Mike

From: Amrit Kashyap <amri...@gmail.com>
Sent: Thursday, April 28, 2022 6:44 AM
To: HCP-Users <hcp-...@humanconnectome.org>
Subject: [hcp-users] Group files on aws s3
 

* External Email - Caution *
--
You received this message because you are subscribed to the Google Groups "HCP-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hcp-users+...@humanconnectome.org.
To view this discussion on the web visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/CAJyaY0oUab0ZvwRV1Pj7zMEwan-5BMVXYSDiVJO-VZ5T%2BY8MyA%40mail.gmail.com.

 

The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

Amrit Kashyap

unread,
Apr 28, 2022, 11:28:01 AM4/28/22
to HCP-Users
Hi Mike,
Thank you so much. Indeed I can curl the data directly, but I dont think I have set up the authentication correctly. Do you know I can do that (is that the $JSESSIONID , slash what do I set that to)?
Thanks
Amrit

To view this discussion on the web visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/DM6PR02MB51149C20B1A160BB5578F619C5FD9%40DM6PR02MB5114.namprd02.prod.outlook.com.

Elam, Jennifer

unread,
Apr 28, 2022, 11:35:49 AM4/28/22
to HCP-Users
Hi Amrit,
This page might help you:
For the HCP 1200 Release, unprocessed and processed data for a subject can be accessed via REST calls apart from using other modes such as Connectome In a Box, Aspera, Amazon AWS.. In order to access data for a subject, you will need to register at https://db.humanconnectome.org To get data via REST, in a script, you could use tools like curl. Data organization
Jenn
From: Amrit Kashyap <amri...@gmail.com>
Sent: Thursday, April 28, 2022 10:27 AM
To: HCP-Users <hcp-...@humanconnectome.org>
Subject: Re: [hcp-users] Group files on aws s3
 

Amrit Kashyap

unread,
Apr 28, 2022, 11:45:41 AM4/28/22
to HCP-Users
Amazing Jennifer, thats exactly what I needed!

To view this discussion on the web visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/CH2PR02MB64910377E0FE3279E9044118CCFD9%40CH2PR02MB6491.namprd02.prod.outlook.com.

Amrit Kashyap

unread,
May 13, 2022, 12:08:24 PM5/13/22
to HCP-Users
Hey I tried this a few weeks ago, and it worked perfectly. Now I am getting an error HTTP needs authentication. Any thoughts?

Elam, Jennifer

unread,
May 13, 2022, 1:13:29 PM5/13/22
to HCP-Users
Hi Amrit,
We rebooted the file server and Rest calls are now working. Your JSESSION ID from last time will have expired, so he would need to use his username and password to get a new one. 

Best,
From: Amrit Kashyap <amri...@gmail.com>
Sent: Friday, May 13, 2022 11:08 AM
Reply all
Reply to author
Forward
0 new messages