This repository has been archived by the owner on Sep 11, 2023. It is now read-only.
Convert NWP grib files to Zarr intermediate #344
Labels
data
New data source or feature; or modification of existing data source
enhancement
New feature or request
Detailed Description
#122 found that it'll be way too slow to load NWPs from native files directly. So we need to convert to Zarr first.
All of "file 3" listed in this Met Office PDF look useful for helping to predict the evolution of clouds.
Related issues:
.nat
EUMETSAT files to Zarr intermediate Satip#14Also see:
Something like this should work:
And load twice: Once with
stepType=instant
and one withstepType=accum
. And watch for all the fun exceptions that cfgrib throws :)This looks like it'll be quite slow. So definitely need to parallelise. If it's super-slow then might be best to FTP new grib files to the cloud and do the processing in parallel in the cloud.
The text was updated successfully, but these errors were encountered: