Home

Introduction

huntsman-drp is an automated data reduction pipeline for the Huntsman telescope. The DRP is designed to be both user-friendly and highly configurable.

At the heart of the DRP is a mongoDB database, which is used to store all metadata for both raw and calibrated files. This database should not be accessed directly, but rather through the huntsman-drp API. Information on how to use the database can be found here.

There are several docker services associated with the DRP, which perform the following tasks automatically:

• Ingestion: The processes of identifying new raw FITS images and adding their metadata to the mongoDB database. Currently, the astrometric calibration (WCS) is also performed here.

• Master calib creation: The process of creating master calibration frames (biases, darks and flats) when new raw calibs become available and inserting their metadata into the database.

• Data quality monitoring: The gathering and storing of data quality metrics from calibrated images, like the PSF FWHM and magnitude zero point.

The DRP can also be used for making reduced coadd datasets of specific targets using a highly configurable DataReduction class, which is configured using a single configuration file specific to the reduction. More information can be found here.

Starting docker services

Most of the time, the docker services should already be running. If they are not, run:

cd huntsman-config/conf_files/drp
git pull
docker-compose pull
docker-compose --env-file dccompute3.env up

Once the docker services are running, use the following command to enter an interactive control session:

docker exec -it hunts-drp-control /bin/bash

Testing

If you want to test local changes to either huntsman-drp or obs_huntsman, set the following environment variables:

• HUNTSMAN_DRP should point to the local huntsman-drp repository.
• OBS_HUNTSMAN should point to the local obs_huntsman repository.

Then run:

bash ${HUNTSMAN_DRP}/scripts/testing/run-local-tests.sh