Demos prepared for the AGN SC 2025 meeting, Durham, 2025. The noteboooks showcase working with HATS-partitioned survey catalogs via LSDB, and time domain analysis with nested-pandas.
Monday 14, 12:30 - 12:50, OCW017 room - presentation
Monday 14, 14:00 - 15:40, OCW116 room - hackathon (guided notebooks)
Monday 14, 16:10 - 17:30, OCW116 room - hackathon (free coding)
- Slide deck
- LSDB (Main page)(LSDB catalogs)(on GitHub)(on ReadTheDocs)
* Rubin Observatory DP1 documentation page for LSDB
* Working with Rubin data section in LSDB documentation - HATS (on GitHub)(on ReadTheDocs)
- nested-pandas (on GitHub)(on ReadTheDocs)
Make sure that you have access to the Rubin Science Platform and follow the instructions at lsdb.io/dp1. Note that LSDB data is still in soft launch phase, so you have to install lsdb package - e.g., by opening a notebook and running the following command (and restarting the kernel after it):
%pip install lsdb
After that you should be able to access:
lsdb.open_catalog('/rubin/lsdb_data/object_collection')
lsdb.open_catalog('/rubin/lsdb_data/dia_object_collection')
lsdb.open_catalog('/rubin/lsdb_data/object_photoz')
If you want to keep your environment clean, at the end of the workshop, uninstall LSDB and any other packages you may have installed with appropriate commands like
%pip uninstall lsdb
You can follow along with this demo by creating your own local environment. If installing on your own hardware, create a virtual environment and install the relevant packages:
conda create --name lsdb_env python=3.12
conda activate lsdb_env
pip install lsdb
Note that you will have to change the paths to the data to point to a local copy of the Rubin Data Preview 1 data.
In this notebook, we will learn how to:
- Import DASK client
- Load object and source catalogs (lazily)
- Show HATS partitioning with ZTF objects and source
- Perform crossmatching with existing
LSDBcatalogs - Save the results of a science workflow to disk
In this notebook, we will learn:
- What nested pandas is
- How to do basic operations on timeseries
In this notebook, we will learn:
- How to access photo-z catalog derived from Rubin’s Data Preview 1 with LSDB
In this notebook, we will learn how to:
- Crossmatch custom list of positions
- Access Object and diaObject data from Rubin DP1
- Show lightcurves for both Objects and diaObjects
In this notebook, we provide several AGN-related problems:
- Crossmatch SDSS AGNs with Rubin DP1 photo-z catalog
- Crossmatch a large catalog of AGN with Rubin DP1 data
- Run scientific analysis on lightcurves from Rubin DP1
During hackathon (and after), post any questions to #lincc-frameworks-lsdb channel on the Discovery Alliance Slack, that we will monitor extra well to help with any potential problems. See also our Getting help page.
This project is supported by Schmidt Sciences.
This project is based upon work supported by the National Science Foundation under Grant No. AST-2003196.
This project acknowledges support from the DIRAC Institute in the Department of Astronomy at the University of Washington. The DIRAC Institute is supported through generous gifts from the Charles and Lisa Simonyi Fund for Arts and Sciences, and the Washington Research Foundation.