Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to specify a date range on the /pipeline endpoint #41

Open
robertodauria opened this issue Jan 26, 2021 · 0 comments
Open

Allow to specify a date range on the /pipeline endpoint #41

robertodauria opened this issue Jan 26, 2021 · 0 comments

Comments

@robertodauria
Copy link
Contributor

Currently the /pipeline endpoint only accepts one parameter; year. This means statistics are recalculated for the whole year every time the pipeline is run. This is not necessary since the statistics are calculated on a daily basis, thus a change in a past day doesn't change it's corresponding histogram rows unless the underlying data changed -- and we want to manage such special cases differently anyway. In general, we can just upload the past 1-2 days every day without removing all the previous days' rows and calculating them again.

To do so, the /pipeline endpoint should support the from and to parameters.

The export phase won't need to be changed as a single histogram_daily_stats.json file includes data for a whole year and we can't generate one day at a time.

@robertodauria robertodauria added the enhancement New feature or request label Jan 26, 2021
@robertodauria robertodauria self-assigned this Jan 26, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants