HiPSCat office hours 2024-05-31

Melissa DeLucchi

unread,

May 31, 2024, 9:03:29 AM5/31/24

to hipsc...@googlegroups.com, antara.r....@nasa.gov, Brian McLean, bsi...@gmail.com, Carlos Adean, David Shupe, fxpi...@gmail.com, Julia Gschwend, mju...@uw.edu, Max West, Samuel Dillon Wyatt, Sharon Shen, gwyn...@gmail.com, sgr...@ipac.caltech.edu, Susan Mullally, Tom Donaldson, Vandana Desai, msan...@stsci.edu, Erik Tollerud, ldacosta, Jeremy Kubica, Melissa DeLucchi, Kiessling, Alina A (3266), Faisst, Andreas, Bernie Shiao, Brian Hayden, ctsl...@uw.edu, gp...@ipac.caltech.edu, Rick White, Sean McGuire, Steve Lubow, Travis Berger, Raen, Troy J., fri...@slac.stanford.edu, ga...@slac.stanford.edu, Wilson, Tom J.

The meeting this week will be an informal engineering drop-in meeting. I won't be recording, but if anything interesting happens, I will send out some notes following the meeting.

If you know you will be attending and know you have questions, please give me a heads up. This is just so I can directly invite folks who might know the answers.

So far, I know that we will have some questions around pandas/numpy/pyarrow dtypes.

Friday, 1pm eastern, 10am pacific, 2pm Belem.

Zoom link

Upcoming meetings:

June 28: Next demo session

--

=======

Melissa DeLucchi (duh-LOO-kee)

she/they

Melissa DeLucchi

unread,

Jun 6, 2024, 4:35:48 PM6/6/24

to hipsc...@googlegroups.com, antara.r....@nasa.gov, Brian McLean, bsi...@gmail.com, Carlos Adean, David Shupe, fxpi...@gmail.com, Julia Gschwend, mju...@uw.edu, Max West, Samuel Dillon Wyatt, Sharon Shen, gwyn...@gmail.com, sgr...@ipac.caltech.edu, Susan Mullally, Tom Donaldson, Vandana Desai, msan...@stsci.edu, Erik Tollerud, ldacosta, Jeremy Kubica, Melissa DeLucchi, Kiessling, Alina A (3266), Faisst, Andreas, Bernie Shiao, Brian Hayden, ctsl...@uw.edu, gp...@ipac.caltech.edu, Rick White, Sean McGuire, Steve Lubow, Travis Berger, Raen, Troy J., fri...@slac.stanford.edu, ga...@slac.stanford.edu, Wilson, Tom J.

Reminder about office hours tomorrow: Friday June 7, 1pm eastern, 10am pacific, 2pm Belem.

I don't know of any specific topics that will be discussed, but please send them over (or just show up!)

Zoom link

Upcoming meetings:

June 28: Next demo session

Neven Caplar

unread,

Jun 12, 2024, 4:40:49 PM6/12/24

to Melissa DeLucchi, hipsc...@googlegroups.com, antara.r....@nasa.gov, Brian McLean, Brigitta Sipőcz, Carlos Adean, David Shupe, fxpi...@gmail.com, Julia Gschwend, Mario Juric, Max West, Samuel Dillon Wyatt, Sharon Shen, Stephen Gwyn, sgr...@ipac.caltech.edu, Susan Mullally, Tom Donaldson, Vandana Desai, msan...@stsci.edu, Erik Tollerud, ldacosta, Jeremy Kubica, Kiessling, Alina A (3266), Faisst, Andreas, Bernie Shiao, Brian Hayden, ctslater, gp...@ipac.caltech.edu, Rick White, Sean McGuire, Steve Lubow, Travis Berger, Raen, Troy J., fri...@slac.stanford.edu, ga...@slac.stanford.edu, Wilson, Tom J.

Dear all,

Tomorrow, Thursday, June 13, 10 am Pacific, we will be presenting LSDB/HiPSCat as part of the series of LINCC tech talks (zoom:https://ls.st/lincc-talks). Additionally, we will show our work on nested pandas/dask, as part of our efforts to enable large scale analyis of time-domain data.

Please share with your colleagues who might benefit from this overview.

More information is available at https://lsstdiscoveryalliance.org/programs/tech-talks/. The abstract is below.

*********************

LINCC Frameworks LSDB & TAPE – Scalable analysis across large datasetsThis presentation introduces LSDB, a software package that facilitates large-scale analytics across multiple datasets. LSDB’s efficacy lies in its ability to shard expansive datasets and index sources within the Healpix space, leveraging catalog density per index. We will shortly describe the project history and design decisions that we have taken (such as using DASK). We will discuss current and future plans, including supporting science cases, International Virtual Observatory Alliance standardization, and collaboration with NASA. We will then discuss our effort to enable time-domain science, present a use case of searching for rare events and anomalies in existing datasets, and showcase how it can be extended to Rubin-size datasets. We will discuss the challenges of working with LSST-like objects/source tables and then discuss our current plans to refactor the code to implement a “nested” structure that keeps objects and sources tightly coupled. We will demonstrate the current capabilities with a Jupyter notebook demo.

*********************

Kind Regards,

Neven

--------------------------------------------
Neven Caplar
Department of Astronomy
University of Washington
Seattle, WA, USA
www.ncaplar.com

--
You received this message because you are subscribed to the Google Groups "HiPSCat Working Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hipscat-wg+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hipscat-wg/CAJBfyqWvKgXw0GhZf3xZZenT28t0QHOWfJpTrLsfXYZaLV%2BMAg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Reply all

Reply to author

Forward