1 feature improved configuration and data structures

[theissenhelen]

Currently, the configurations are passed via hydra from yaml files. This PR adds structured configs (or schemas) and basic config validation via Pydantic base models.

Some advantageous are:

• validation and feedback to the user before starting a training run
• syntax highlighting and auto-complete
• data transformations
• decluttering the configs by introducing defaults in the schemas
• better documentation of the configs
• deprecation management
• easier to define configs for unit testing

Main changes are:

• schemas that mimic the current structure of the configs
• a new command Anemoi-training config validate --name debug.yaml
• For developers: If you make changes to the configs, these need to be represented in the structured configs/schemas.

ToDo:

• support python versions 3.9 - 3.11
• test special use cases such as LAM
• autodocs
• check for missing config entries
• no-validate flag

[FussyDuck]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ theissenhelen
❌ chebertpinard
_{You have signed the CLA already but the status is still pending? Let us recheck it.}