Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Built assert statement to compare num comments in db to num comments in API #175

Open
andrewjtdunn opened this issue May 14, 2024 · 1 comment
Labels

Comments

@andrewjtdunn
Copy link
Contributor

I'm building the exploratory code right now to compare number of comments in the different sources, but ideally we'd have something integrated into the data pipeline to flag issues.

pull_reg_gov_data would need to be updated with a parameter to return all data returned from the API response. Then we'd need to compare ["meta"]["totalElements"] to number of comments on a document in the regulations_comment table

@andrewjtdunn
Copy link
Contributor Author

idea: build cron job to run a weekly report checking what API says should be the number against what we have the database

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant