Skip to content
This repository has been archived by the owner on Jul 7, 2023. It is now read-only.

Monitoring script #107

Open
2 tasks
TathagataChakraborti opened this issue Dec 9, 2021 · 0 comments
Open
2 tasks

Monitoring script #107

TathagataChakraborti opened this issue Dec 9, 2021 · 0 comments
Assignees
Labels
backend Issues pertaining to data extraction and storage enhancement New feature or request

Comments

@TathagataChakraborti
Copy link
Member

We need some sort of ping when bulletin schemas change. Since we already have CI/CD set up, all we need are some checks and balances on the extraction script that can catch things like these and log it as a report at the end of the daily run:

  • total parse error i.e. no data extracted
  • number of tables detected != number of tables extracted

Others? @MayankAgarwal

This way we don't have to check manually when schemas need updating.

@TathagataChakraborti TathagataChakraborti added enhancement New feature or request backend Issues pertaining to data extraction and storage labels Dec 9, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
backend Issues pertaining to data extraction and storage enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants