Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve archiving #2

Open
chrisjwood16 opened this issue Nov 20, 2024 · 0 comments
Open

Improve archiving #2

chrisjwood16 opened this issue Nov 20, 2024 · 0 comments

Comments

@chrisjwood16
Copy link
Collaborator

Need to archive previous years to single resource_from value and de-duplicate to keep sqlite file within allowable limits.
There will be only 1 pre_xxxx value.
So as of Nov 2024 we have pre_2024 or the individual data from 2024.
Once 202501 data published need to automatically set any 2024 resource_from fields to pre-2025 - set any other pre- values to pre-2025, remove duplicates and vacumm.
Also need to ensure that no date_from / date_to dates are in the pre-2025 period
Remove any hard coded 2024 values
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@chrisjwood16