Skip to content

fmidev/weather-satellites-nwc-saf-pps

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Container recipe for PPS

NOTE: Work in progress.

The aim of this container recipe is to build NWC SAF PPS with some additions so that a incoming Posttroll message triggers conversion of data to Level 1C and eventually run the PPS processing.

Static auxiliary data

The static auxiliary data from NWC SAF should be pre-extracted to the proper directory ($DATA_DIR/static/).

NWP data

Up-to-date NWP data should be placed in $DATA_DIR/import/NWP_data by an external system.

Satellite data

The location of satellite data are taken from the incoming Posttroll message. The full path should be accessible within the container. So if the satellite data are in /data/polar/avhrr/ears/l1b the directory should be mounted to the container with the exact same path.

This data are then converted to the L1c format PPS requires before passing it to PPS.

Configuration

Configuration should be mounted to the internal /config directory. In addition to the normal PPS configurations, there are two special required files, described below.

/config/env-variables

This file contains the PPS environment variables, normally which are set in source_me.bash file of PPS. These variables are plenty. The only that might need modification is DATA_DIR, which should point to the parent directory of export/, import/, intermediate/, static/ and tmp/ directories.

run_pps.yaml

The container configuration is simple:

  • subscriber settings for Posttroll
  • (internal) output location of Level 1C files
  • which PPS command to use for processing
  • a glob pattern to determine which files were generated
    • used in publishing the generated data
  • publisher settings for Posttroll
subscriber:
  nameserver: False
  addresses: "<hostname>:<port number>"
  topics:
  - /hrpt/1B/avhrr
  - /ears/avhrr/1b
l1c_out_dir: /data/polar/avhrr/ears/l1c
pps_command: ppsRunAllParallel_inclCMaProb.py
existing_file_pattern: "S_NWC_.nc"
publisher:
  nameservers: False
  port: 40000
  publish_topic: /pps

The PPS product output will be placed in $DATA_DIR/export/.

Compilation with Podman

Place pps_v2021_patch3_conda_packages.tar in the source directory and run

podman build -t pps .

Running with Podman

Assuming the $DATA_DIR directory is under /data and the configuration files are placed in /config/polar-avhrr/pps, use this to run the container:

podman run \
    --rm \
    -v /data:/data:Z \
    -v /config/polar-avhrr/pps:/config:Z \
    pps

About

Recipe to build NCP SAF PPS as a container

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published