Fwd: Thank you, HATS/LSDB Working Group!
Melissa DeLucchi
From: Melissa DeLucchi <delu...@andrew.cmu.edu>
Date: Tue, Dec 17, 2024, 9:47 AM
Subject: Thank you, HATS/LSDB Working Group!
To: <gwyn...@gmail.com>, <fxpi...@gmail.com>, <antara.r....@nasa.gov>, Faisst, Andreas <afa...@ipac.caltech.edu>, <bsi...@gmail.com>, Vandana Desai <de...@ipac.caltech.edu>, <gp...@ipac.caltech.edu>, Raen, Troy J. <ra...@ipac.caltech.edu>, <sgr...@ipac.caltech.edu>, David Shupe <sh...@ipac.caltech.edu>, <ctsl...@uw.edu>, Melissa DeLucchi <delu...@andrew.cmu.edu>, Jeremy Kubica <jku...@andrew.cmu.edu>, Max West <max...@uw.edu>, mju...@uw.edu <mju...@uw.edu>, Sean McGuire <sean...@andrew.cmu.edu>, Samuel Dillon Wyatt <swy...@arizona.edu>, Carlos Adean <carlo...@linea.org.br>, Julia Gschwend <ju...@linea.org.br>, ldacosta <ldac...@linea.org.br>, Wilson, Tom J. <T.J.W...@exeter.ac.uk>, Kiessling, Alina A (3266) <Alina.A....@jpl.nasa.gov>, <fri...@slac.stanford.edu>, <ga...@slac.stanford.edu>, Brian Hayden <bha...@stsci.edu>, Erik Tollerud <etol...@stsci.edu>, Steve Lubow <lu...@stsci.edu>, Brian McLean <mcl...@stsci.edu>, <msan...@stsci.edu>, Rick White <r...@stsci.edu>, Bernie Shiao <sh...@stsci.edu>, Susan Mullally <smul...@stsci.edu>, Sharon Shen <ss...@stsci.edu>, Travis Berger <tbe...@stsci.edu>, Tom Donaldson <tdona...@stsci.edu>, Lovro Palaversa <l...@irb.hr>, <mariano.ja...@gmail.com>, <emil...@gmail.com>, <yoclaudi...@gmail.com>, <atza...@uw.edu>, <ecb...@uw.edu>, <jca...@lsst.org>, Gustavo Schwarz <gustavo....@gmail.com>, Jonathan Hargis <jha...@stsci.edu>, <luigi....@gmail.com>, Manon Marchand <manon.m...@astro.unistra.fr>, Mark Allen <mark....@astro.unistra.fr>, Zach Claytor <zcla...@stsci.edu>, <hat...@groups.google.com>
We had a lot of great accomplishments in 2024!
Some of my favorites:
HiPSCat has been transformed into HATS, and we're inching closer to being an archival standard in the field.
Three successful LINCC Frameworks incubator projects, centered around meaningful science using HATS and LSDB:
Macauff probabilistic cross-matching
Gundam ultra-fast correlation
photoD stellar distance estimation
Nearing publication of Andy Tzanidakis' work on discovery of dipper stars in ZTF light curves.
Improving the documentation for HATS and LSDB with narratives and notebooks to introduce new users and contributors to the ecosystem.
Simultaneous release to PyPi and conda-forge
10x-100x speed-ups for some of the most common lazy operations in LSDB
Hosted two busy weeks with LINCC Frameworks and Fornax (one in Pittsburgh with STScI, and another in Seattle with STScI and IPAC)
Full integration with new LINCC Frameworks nested-pandas and nested-dask to support time-domain and spectral workflows within LSDB
Full-sky ZTF time-domain analysis (period extraction) with LSDB and nested-dask
Public hosting of data (data.lsdb.io and MAST public s3 datasets, LineA IDAC)
Proven interoperability with Firefly (visualization used by IPAC and RSP)
Demos, tutorials, talks, posters, at:
MWGaia-DN introductory school in Coimbra, PR
Rare Gems in Big Data in Tuscon, AZ, USA
IVOA interop in Sydney
IVOA interop in Malta
ADASS 2024 in Malta
Recorded LINCC Tech Talk [youtube link]
LSST ISSC Collaboration meeting in Boston, MA, USA
This year, we started a monthly "demo" session, and reserved the remaining Friday slots for less-structured discussions and drop-in office hours / co-working. This seems to be working well, and I would like to continue this throughout the next year.
What's changing?
We've gotten feedback that the calendar entries are sometimes unclear about which are the big demo sessions, and which are informal drop-ins. Folks also sometimes have out-dated invitations to events.
All events are now included in this shared calendar, and indicate the scope of the meeting:
We've also added a monthly meeting every fourth Thursday that is Europe-friendly. This has already proved a very useful time for learning about amazing work happening at CDS and ESA, and making quick iterations on shared libraries. These meetings are included in the Google calendar above.
Keep in touch!
If you have any feedback about the meeting format or content, you're always welcome to reach out to myself, Neven, or Mario directly.
We encourage everyone to join our slack channel, inside the LSST-DA slack workspace (#lincc-frameworks-lsdb).
I want to thank everyone for their contributions to this very ambitious effort! We have big plans for 2025 and beyond!
Cheers,
Melissa, Neven, and all of LINCC Frameworks