Remove old model runs from Zarr

[esheehan-gsl]

Problem

We don’t want our storage in S3 to grow infinitely as new model runs are produced.

Solution

Schedule a clean-up process that removes model runs older than a certain age. The age should not be hard-coded in the job, but set as an environment variable so that it’s easy to adjust without having to redeploy the service.

A Lambda function seems like a good candidate for handling this.

No Gos

Conceivable, we may want to be able to mark certain model runs as saved so they won’t be cleaned up, but for now, we won’t bother.

Rabbit Holes

Describe any solutions to problems that pose a risk to completing this project on time.