Skip to content

Latest commit

 

History

History
30 lines (26 loc) · 858 Bytes

Readme.md

File metadata and controls

30 lines (26 loc) · 858 Bytes
Raw

Pipebox

PipeBox is built on top of the DESDM processing framework and serves as a templating and submission tool that makes submitting many jobs easier.

Installation

Clone repo

git clone [email protected]:DarkEnergySurvey/pipebox.git

Set environment (bash)

cd pipebox
export PIPEBOX_DIR=`pwd` 
export PYTHONPATH=$PIPEBOX_DIR/python/pipebox:$PYTHONPATH

Run set-up script and follow the prompts

create_user_config.py

Submitting a pipeline

submit_{pipeline}.py -h

Required arguments

  • db_section: defined in your .desservices file: for production this will usually be db-desoper
  • target_site: the compute site
  • eups_stack: this refers to the software stack used: {stack name} {stack version}
  • campaign: this refers to the template campaign in $PIPEBOX_DIR/templates/pipelines/{pipeline}/{campaign}