opt_lsst

Scripts for maintaining a shared LSST stack on Epyc/Klone Hyak/Mox Hyak

Usage

First time set up

Run the command

$ ./bin/setup.sh

to create a conda installation where the pipelines will be installed.

Run the command

$ ./bin/init.sh

to initialize your .bashrc to load the opt_lsst CLI.

CLI

Setup a version of the pipeline. A default version will be picked if no version is supplied as a command line argument.

$ opt_lsst setup <version>

List the installed versions of the pipelines:

$ opt_lsst list

Install a version of the pipelines:

$ opt_lsst install <version>

Uninstall a version of the pipelines:

$ opt_lsst uninstall <version>

Install a Jupyter kernel for a version of the pipelines

$ opt_lsst kernel <version>

Note that installed kernels will not be removed for versions of the pipelines that go out of date or are unpinned.

Install/uninstall shared stacks based on the list of pinned versions and the most recently released weekly/daily versions.

$ opt_lsst cron

Installing stack versions with a cronjob

Execute cron.sh to install the latest daily and weekly pipeline versions, in addition to host-specific pinned versions.

$ ./bin/cron.sh

Install this script in the crontab to run daily at 9:00 AM:

$ crontab -e
0 9 * * * /path/to/bin/cron.sh

Configuration

Runtime paramaters are stored in the config file in data/<host> where <host> is the hostname of the machine where the pipelines are installed. You can change keep_n_dailies and keep_n_weeklies to increase or decrease the number of daily/weekly versions of the pipelines to keep around. Add a version to the pinned file to always keep that version installed. Change the version in the default file to update which version gets activated by default.

Credits

This code is based on LSST shared-stack code.