Log of Major Tutorial Updates¶
How to find version histories¶
Notebook tutorials¶
All Jupyter Notebook tutorial headers contain the date “last verified to run”. If the date in the file you are using does not match the date shown in that file in the “main” branch of the tutorial-notebooks repository, your version is out of date.
The history of a given tutorial can be accessed in GitHub by going to the tutorial-notebooks repository, clicking on its file name and then clicking on “history” (near upper-right).
Portal, command line, and API tutorials¶
All Portal, command line, and API tutorials contain the date last verified to run near the top of their page.
All tutorials for the Portal aspect, for the command line (Notebook Aspect), and for the API aspect are kept in the dp0-2_lsst_io repository.
The history of a given tutorial can be accessed in GitHub by going to the DP0.2 documentation repository <https://github.com/lsst/dp0-2_lsst_io>), navigating to the file containing the tutorial and clicking on “history” (near upper-right).
Major Updates Log¶
Mar 26 2025¶
Released new notebook tutorial 17 demonstrating anomaly detection with diaObjects.
Mar 24 2025¶
Tutorial notebooks on custom coadds (09a and 09b) were decommissioned.
They could only be run with LSST Science Pipelines version Weekly 2022_40. Code has evolved significantly and they were no longer a useful learning tool for DP1 preparation.
Mar 17 2025¶
Released new notebook tutorial 16 demonstrating the weak lensing signal around a rich galaxy cluster.
Mar 6 2025¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2025_09.
Two new “How To” Portal tutorials were released, demonstrating how to plot histograms and lightcurves.
All Jupyter Notebook tutorials were migrated to the new repository lsst/tutorial-notebooks.
The new tutorial notebooks repository no longer has a /data folder.
Instead, input data for notebook tutorials is stored in the new Git LFS repository lsst/tutorial-notebooks-data,
which is already cloned into the /project directory and accessed by the tutorials (users do not need to obtain the contents of /data themselves).
The tutorial notebook delivery mechanism in the Notebook Aspect of the RSP also changed.
With the old way, latest version of all notebooks were copied as read-only files into the folder /notebooks/tutorial-notebooks/ in
all users’ home directories whenever a new Notebook server was instantiated.
With the new way, users have a new menu bar item “Tutorials” which provides a drop down menu of all
the tutorials in the tutorial-notebooks repository.
Users select the desired tutorial, and a writeable version automatically opens and is saved into
the folder /notebooks/tutorials/.
Mar 5 2025¶
Three new, short, functionality-focused “How To” Portal tutorials released.
Jan 22 2025¶
Thirteen new, short, functionality-focused “How To” Portal tutorials released.
Dec 19 2024¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2024_50.
Nov 15 2024¶
Tutorial notebook 13a (Image Cutout SciDemo) was updated to demonstrate how to retrieve cutouts without writing to disk, to add more context about use of IVOA, and to optimize the efficiency of TAP queries.
Nov 1 2024¶
Tutorial notebook 03c (Big deepCoadd Cutout) was updated to include an appendix demonstrating an alternative method of identifying overlapping exposures.
Oct 31 2024¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2024_42 (but this prompted no major changes to any tutorials).
Oct 24 2024¶
The dp02 alias for the butler repository holding the DP0.2 data set was updated to
provide read access only.
This change accommodates evolution in the butler service and better aligns with the functionality to be expected
for Data Preview 1.
Tutorial notebooks 09a and 09b (custom coadds) were updated to use the dp02-direct butler repo alias, which connects
to the writeable version of the DP0.2 butler repository.
This functionality, and the -direct option, is temporary and should only be used when
write access to the DP0.2 butler is absolutely necessary.
Oct 22 2024¶
Released new portal tutorial 6 demonstrating various functionalities available in the Firefly-based RSP Portal Asepct.
Sep 19 2024¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2024_37.
Tutorial notebook 04b (intermediate butler queries) was updated to work with the new Butler query system announced in this Community Forum post.
Aug 22 2024¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2024_32.
Tutorial notebook 14 (synthetic source injection) was updated to work without writing the synthetic source catalog to the butler.
Aug 13 2024¶
Released command line tutorial 02, demonstrating butler command line usage. The custom coadd command line tutorial is now labeled as command line tutorial 03.
Jul 29 2024¶
Split tutorial notebook 02 into 02a and 02b, to provide a more detailed introduction to the TAP service for catalog data.
Released new tutorial notebook 02c, an introduction to the ObsTAP service and image queries for metadata and pixel data.
Jun 13 2024¶
Released tutorial notebook 03c, which demonstrates how to create a big cutout image which spans patch and tract boundaries.
Jun 3 2024¶
Tutorial notebook 05, Source Detection and Measurement, has been updated to include a demonstration of forced photometry.
May 2 2024¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2024_16.
Apr 30 2024¶
Released three introductory-level Spanish-language tutorials.
Mar 27 2024¶
Released tutorial notebook 13a on the image cutout tool.
Feb 29 2024¶
Released tutorial notebook 14 on synthetic source injection.
Feb 1 2024¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2024_04.
Dec 6 2023¶
Released new API tutorial 01 (TOPCAT).
Nov 30 2023¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2023_47.
Sep 21 2023¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2023_37.
New tutorial notebooks 12a and 12b on the Point Spread Function data products and their analysis were released.
Jul 31 2023¶
Released new tutorial notebook 11 on working with user packages.
Jun 1 2023¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2023_21.
In notebooks 02 and 06b, deprecated Bokeh keyword arguments “plot_height” and “plot_width” were replaced with “height” and “width”. The same two notebooks were updated to cast the objectId to a string, because Bokeh was not able to handle such large integers.
An update that was required in many notebooks was replacing “get_tap_service()” with “get_tap_service(“tap”)” (due to deprecation of the former syntax).
Finally, calls to the deprecated method “butler.getDirect()” were replaced with “butler.get()” in a few places.
May 24 2023¶
Released Portal tutorials 04 and 05.
May 15 2023¶
Added command line version of Notebook 09a, with a warning that it must be run with uncached RSP image Weekly 2022_40.
Apr 12 2023¶
Notebooks 09a and 09b have been reinstated, with a warning that they must be run with uncached RSP image Weekly 2022_40.
Mar 07 2023¶
Notebook 10 on deblender data products created and released.
Notebook 07b has been updated to use the ForcedSourceOnDiaObjects table.
Feb 16 2023¶
The recommended image of the RSP at data.lsst.cloud was bumped to Weekly 2023_07.
Notebooks 09a and 09b have been temporarily removed from the tutorial-notebooks repository and are undergoing major redevelopment to start the reprocessing for custom coadds at earlier stages of the pipeline.
Notebook 04b, Section 3.3.1 has been updated to show a plot of the bounding boxes of patches which overlap with a calexp.
Notebook 06a, Section 2.1 has been updated to use calexp.visitInfo.id and calexp.filter.bandLabel.
Many notebooks have had minor updates to use SELECT TOP instead of MAXREC (the latter produces an unavoidable but non-fatal warning)
and/or remove the use of the %%time magic as all code cells now have an execution time display built-in.
Feb 06 2023¶
Command line tutorial 01 created and released.
Jan 05 2023¶
Portal Tutorial 01 updated with a new Section 4, illustrating how to copy the URL containing query results for use in a notebook.
Dec 21 2022¶
Notebooks 06a and 06b (data visualization) added instructions for how to output interactive plots to interactive HTML files that can be downloaded, shared, and opened outside of the JupyterLab environment.
Dec 16 2022¶
Notebook 03a (image display) added cutout funtion for calexps (previously only had one for deepCoadds)
Notebook 08 (truth tables) added new Section 3.3 to demonstrate an efficient single-Object search
Use of warning suppression has been modified in many notebooks to align with RTN-045.
ADQL Recipes and Python Functions have been added to the DP0.2 documentation. They include copy-pastable functions and query recipes for users.
Oct 26 2022¶
Notebook 03a (image display) updated to replace use of objectTable via the butler with a TAP query.
Notebook 07a (DiaObject samples) updated to use the recently released ForcedSourceOnDiaObject table.
Notebooks 09a and 09b (custom coadds) added.
Oct 04 2022¶
Notebook 08 (truth tables) updated to optimize TAP query.
Sep 29 2022¶
Notebook 08 (truth tables) added.
The ForcedSourceOnDiaObject, TruthSummary, and MatchesTruth tables were released.
The recommended image of the RSP was bumped to version Weekly 40, and all notebooks were updated accordingly.
Permissions for users’ “notebooks/tutorial-notebooks” directory changed to read-only. For details about the permission change, see How to use the Tutorial Notebooks and NB-Intro-Use-A-NB-faq-readonly.
Aug 20 2022¶
Notebooks 03c (survey property maps) and 04b (intermediate butler queries) added.
June 27 2022¶
All tutorials updated for the release of DP0.2.