Bringing Data Close to Compute at Harvard Dataverse

[Philip Durbin]

This past week Stefano Iacus gave a recorded talk entitled "Bringing Data Close to Compute at Harvard Dataverse" which I just put on DataverseTV: https://dataverse.org/dataversetv

Below is the abstract and direct links:

- video: https://www.youtube.com/watch?v=OZnJsUh9Bp8&t=23381s

- slides: https://docs.google.com/presentation/d/1GG7BByzSOv7E5R7lXTRPZ4YgGPlTPIF82P94vZNyqaA/edit?usp=sharing

"With data becoming increasingly large and machine learning and AI equally popular also outside the hard sciences, we decided to exploit the versatility and cost effectiveness of the MOC infrastructure in terms of high performance computing (NERC) and storage (NESE). Moreover, being MOC an integrated infrastructure, it is possible to run computing on large data without moving data over the Internet.. In this talk we present a proof of concept of this approach where the Dataverse software is integrated with NESE and NERC realizing the goal of computing directly on large data."

For context, this was given at the Massachusetts Open Cloud (MOC) workshop: https://massopen.cloud/2024-workshop/

Thanks,

Phil

--

Philip Durbin
Software Developer for http://dataverse.org
http://www.iq.harvard.edu/people/philip-durbin