Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Satellite normalization #87

Open
peterdudfield opened this issue Dec 6, 2024 · 0 comments · May be fixed by #97
Open

Satellite normalization #87

peterdudfield opened this issue Dec 6, 2024 · 0 comments · May be fixed by #97
Assignees

Comments

@peterdudfield
Copy link
Contributor

peterdudfield commented Dec 6, 2024

Detailed Description

Currently we don't have any satellite normalisation, as its between 0 and 1, but we should have, like we did in ocf-datapipes. This is because some channels has very similar values, and normalising by mean and std, means the ML model can learn more easily the behaviour of that channel

Context

  • old scaling is done with some constant values here
  • before we had it as an option, but we should do this as default
  • Similar to NWP normalization

Possible Implementation

  • add satellite normalization in torch_datasets here
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants