Skip to content
This repository has been archived by the owner on Sep 11, 2023. It is now read-only.

Re-chunk Satellite Zarr with one chunk for all channels and full spatial extent #44

Closed
JackKelly opened this issue Jul 6, 2021 · 3 comments
Closed

Re-chunk Satellite Zarr with one chunk for all channels and full spatial extent #44

JackKelly opened this issue Jul 6, 2021 · 3 comments

Comments

@JackKelly
Copy link
Member

Hmmm... script keeps getting killed. Maybe try on a dedicated "data processing" VM with 128 GB of RAM?
@JackKelly JackKelly mentioned this issue Jul 6, 2021
Closed
@JackKelly JackKelly changed the title Re-chunk Satellite Zarr with one chunk for all channels Re-chunk Satellite Zarr with one chunk for all channels and full spatial extent Jul 7, 2021
@JackKelly
Copy link
Member Author

This still needs doing. The chunks in all_zarr_in16_single_timestep.zarr are far too small to be efficient:

image

@JackKelly
Copy link
Member Author

This will no longer be necessary if #90 works

@JackKelly JackKelly mentioned this issue Oct 1, 2021
Closed
4 tasks
@JackKelly JackKelly mentioned this issue Oct 20, 2021
Closed
@JackKelly
Copy link
Member Author

Redundant now that openclimatefix/Satip#14 is done

@JackKelly JackKelly mentioned this issue Nov 8, 2021
Closed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JackKelly