Resolve intermittent issues with EFS Filesystem backups

[eporter23]

See also prior notes about backups and retention schedules:

2020 Project Notes
Wiki page

After a meeting on 7/12/24, we are discussing altering the current process as follows:

Split the current backup job into 2 separate ones:

branding (banner images)
Frequency of backups:

• 1x a month

Retention of backups:

• prior month only

derivatives and IIIF manifests (thumbnails and cached manifests)
Frequency of backups:

• weekly

Retention of backups:

• Retain most recent 4 weekly backups
• Retain 1st week of backups for last 3 months
• Retain 1st week of 1 year prior (July and December)

[eporter23]

@jcrompton42 can you tag me on this when you are done, as a reminder for me to update the wiki and other docs?

[jcrompton42]

absolutely!

[jcrompton42]

I have made 2 lambda functions- curate-backups and curate-backup-check, to asynchronously call backups and send notifications to slack. I am going to leave this open for a few weeks to monitor that the scheduling is correct.

[eporter23]

Thanks @jcrompton42 !