Skip to content
This repository has been archived by the owner on Jun 13, 2023. It is now read-only.

Package Proposal #22

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

ZacharyWills
Copy link
Contributor

Adding spec, notes and some examples for semi-reproducible cataloging of a RUN. This is a relatively flexible item, since no automation has been produced yet. Eventually existing tooling will make this spec more difficult to change.

Open to comments and discussion.

I've added the necessary framework for semi-reproducible cataloging of a RUN. This is a relatively flexible item, since no automation has been produced yet. Eventually existing tooling will make this spec more difficult to change.
Copy link
Collaborator

@jameshalgren jameshalgren left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to preserve the original readme.md in some other location?

@@ -1,61 +0,0 @@
# CIROH Cloud Terraform Configuration
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems like we need to preserve some of this as a Terraform_README.md

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah these were just Matt D.'s notes on the prototype from a while back

Comment on lines +3 to +9
Get the files from the appropriate bucket & RUN_CONFIG
```
wget --no-parent https://awi-ciroh-ngen-data.s3.us-east-2.amazonaws.com/AWI_001/AWI_03W_113060_001.tar.gz .

tar -xvf AWI_03W_113060_001.tar.gz
```
Then we can confirm file location and integrity against the example JSON file.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We discussed splitting the tar into several pieces. This will work for tomorrow. If we can set up the split files, that would be more consistent with the eventual goal.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a stopgap for sure, I can add a TODO there if you like

@ZacharyWills
Copy link
Contributor Author

I can split the cloud stuff into separate "discipline" tar files, but that would require me to work the Bucket into a different shape to allow for pointing at the bucket locations that would be new. The current situation points to local files after you get the .tar.gz to get the files locally, but you could also get them specifically from the bucket piecemeal.

@jameshalgren jameshalgren marked this pull request as draft April 26, 2023 16:59
@ZacharyWills
Copy link
Contributor Author

On hold while the wrapper script and data mounting standardization changes are proposed and merged

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants