-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
National Water Model data from S3 to HSDS #6
Comments
@ajelenak-thg, do you have a notebook demonstrating writing to HSDS from xarray? Which makes me wonder: any plans for |
No, @rsignell-usgs, I don't have a notebook for that.
My thinking is that we would tackle this functionality through whatever xarray currently uses for writing out HDF5 files (ooops, I meant netCDF-4...): h5netcdf and h5pyd. |
@ajelenak-thg , oh yes, that makes sense. |
@ajelenak-thg - that's something we can try out right now isn't it? (Using your PR on h5netcdf) |
I think so, and with the latest h5pyd. Haven't tried myself yet. |
As part of the NOAA Big Data Project, the National Water Model data is now on AWS S3:
From Conor Delaney:
@jreadey what is the best way to convert some of this data to HSDS?
Here's the list of files that I would like to create the HSDS dataset from (using the RENCI opendap to illustrate the dataset):
Could we just modify this somehow (perhaps using FUSE) to read the NetCDF files from S3?
The text was updated successfully, but these errors were encountered: