Object Store Cleanup

[franTarkenton]

Currently there is a lot of duplication in the object storage bucket that is being used for snowpack analysis.

Some of this could be from the original hatfield dump of the data, others are due to a lack of understanding of the data structures when the original implementation of the automated runs were put into place.

Specific Items to evalute:

• Check code, to see if we can figure out how the following folders are getting populated:

  • modis_terra
  • modis-terra

• evaluate the archive process for the snowpack data, ie processes that populate data in the folder "snowpack_archive" This is where the daily runs of the comparisons for the snowpack analysis for a specific day vs historical norms are being stored.

• suspect that the data in "snowpack_archive/modis-terra" should actually be going to just the folder "modis-terra"