Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add input data #3

Open
damianooldoni opened this issue Oct 7, 2019 · 6 comments
Open

Add input data #3

damianooldoni opened this issue Oct 7, 2019 · 6 comments
Assignees

Comments

@damianooldoni
Copy link
Contributor

This issue comes from @amyjsdavis 's reply, #1 (comment).
Indeed, big files cannot be set in GitHub.

  1. If data are already published on internet, a link to the source is sufficient.
  2. If data are not yet published, they need to be published. You can publish them via Zenodo with label dataset and open access. In this way you can document, archive and, most of all, cite them! Example: https://zenodo.org/record/1288628.
  3. If data cannot be published due to copyright restrictions, then a solution should be found during the Core Group meeting.

You can always ask @peterdesmet or me for advices.

@damianooldoni damianooldoni changed the title Methods to reference big file in workflow Methods to store big files and references in workflow Oct 7, 2019
@qgroom
Copy link
Contributor

qgroom commented Oct 7, 2019

Meise has a lot of experience in pushing large volumes of large files to Zenodo through their API. If this needs to be done then we can either advise or do it.

@amyjsdavis
Copy link
Contributor

amyjsdavis commented Oct 7, 2019 via email

@damianooldoni
Copy link
Contributor Author

Hi @amyjsdavis. Thanks for adding workflow to README.
Next step, I think, is adding input data ( or link to get them) to the repo. I have just added link to European data cube. Could you please do the same with other data sources? For example, you mention KMI and CHELSA data. How can I or somebody else trying to reproduce our workflow get these data?

@damianooldoni damianooldoni changed the title Methods to store big files and references in workflow Add input data Dec 1, 2019
@amyjsdavis
Copy link
Contributor

amyjsdavis commented Dec 1, 2019

Hi @damianooldoni I will add these in the near future, but the work flow right I provided is just high level. I thought that was all you needed for now. It is not meant to be reproducible yet, or for anyone to actually use. There are steps, code and commenting missing, as well as some model selection issues that I am working on. It is the best I can do for now, but more to come in a week or so.

@amyjsdavis
Copy link
Contributor

In addition, the RMI data has not been released yet.

@damianooldoni
Copy link
Contributor Author

damianooldoni commented Dec 1, 2019

Thanks @amyjsdavis. I don't need more details for meeting tomorrow, that's not the reason I wrote here today, no worries ☺️ . I was just going through open issues. I thought this issue could be tackled easily as it involves input data, not modelling or producing outputs.

Still, let us know if you need help publishing input data on Zenodo or for any other kind of help 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

3 participants