Inquiry regarding downloading ConnectomeDB data to an HPC cluster via BALSA

[luo jiebin]

Dear BALSA / ConnectomeDB Support Team,

I am writing to seek guidance on the most efficient way to download data from ConnectomeDB to a high-performance computing (HPC) cluster for my research project.

Specifically, I am looking for a command-line based method (such as using curl, wget, or a specific python API/CLI tool) that would allow me to transfer datasets directly to my cluster environment, as browser-based downloads are not feasible for the volume of data required.

Could you please provide information or documentation on:

1. Recommended tools or scripts for batch downloading ConnectomeDB data to a Linux-based HPC.
2. How to manage authentication/credentials via the command line.
3. Any specific BALSA features that facilitate direct data transfer to remote servers.

If there are any existing tutorials or GitHub repositories you recommend, please let me know.

Thank you very much for your time and assistance.

Best regards,

Luo Jiebin

[Tim Coalson]

The supported download method is through Aspera browser plugin, specifically because it is faster than a browser download.  The intention is for users to mount their network storage on a machine that can run a browser with the Aspera plugin.

While our older version of the Aspera server doesn't easily interact with command-line tools, a user has posted a somewhat involved method to use ascp with it:

https://groups.google.com/a/humanconnectome.org/g/hcp-users/c/wiEDvYl1bwQ/m/4nxd-i1MAAAJ

Tim

--
You received this message because you are subscribed to the Google Groups "HCP-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hcp-users+...@humanconnectome.org.
To view this discussion visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/PUWP216MB2749175379C2D99D601E1973987FA%40PUWP216MB2749.KORP216.PROD.OUTLOOK.COM.