Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated data update failed late Aug 2021 #120

Closed
madwort opened this issue Sep 1, 2021 · 2 comments
Closed

Automated data update failed late Aug 2021 #120

madwort opened this issue Sep 1, 2021 · 2 comments

Comments

@madwort
Copy link
Contributor

madwort commented Sep 1, 2021

This is similar but possibly different to #119

The top level symptom is a new normalisation spreadsheet has been uploaded, but the new data has not gone live, as something has gone wrong with euctr-tracker-code/deploy/loaddata-eutrialstracker_live.sh (run from crontab).

If we look at our production euctr-tracker-data repository, we can see that it is in an inconsistent state, possibly due to the weirdness about the earlier Aug tracker data:

server:/blah/euctr-tracker-data$ git status
On branch master
Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded.
  (use "git pull" to update your local branch)

Changes to be committed:
  (use "git reset HEAD <file>..." to unstage)

	modified:   new_trials.csv
	new file:   normalized_sponsor_names.xlsx

nb. repo is at 329efbd1730049067626ead07f5e17d7670a3f55 , which is behind upstream at c3ce0f81e4ac82c5a62fc3eb3e2576f9680e29cb

@madwort
Copy link
Contributor Author

madwort commented Sep 1, 2021

I think this is because the normalisation file was incorrectly removed by this automatic commit ebmdatalab/euctr-tracker-data@329efbd - cleaned up the repo to what I think is the correct state, will manually run the loaddata step

@madwort
Copy link
Contributor Author

madwort commented Sep 1, 2021

appears to have worked - trials count has changed from 10028/13874 to 10396/14207. production git data repo now looks clean & git history is correct - hopefully will work automatically next time!!

@madwort madwort closed this as completed Sep 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant