multiple input data files for pv

[peterdudfield]

Pull Request

Description

PV data can have two datasources

add legacy config code - issue to remove #631

update on_premise.yaml - Need PV from 2020 and 2021 from pv output.org

Fixes #554

How Has This Been Tested?

• unittests

• ran preparel_ml_script.py using gcp.yaml (not on leonardo)

• added tests for old pv confgiruation

• No

• Yes

Checklist:

• My code follows OCF's coding style guidelines
• I have performed a self-review of my own code
• I have made corresponding changes to the documentation
• I have added tests that prove my fix is effective or that my feature works
• I have checked my code and corrected any misspellings

[codecov-commenter]

Codecov Report

Merging #562 (49521d8) into main (2d09fbd) will increase coverage by 0.10%.
The diff coverage is 98.41%.

@@            Coverage Diff             @@
##             main     #562      +/-   ##
==========================================
+ Coverage   93.21%   93.32%   +0.10%     
==========================================
  Files          45       45              
  Lines        2993     3041      +48     
==========================================
+ Hits         2790     2838      +48     
  Misses        203      203              

Impacted Files	Coverage Δ
...wcasting_dataset/data_sources/pv/pv_data_source.py	97.53% <97.29%> (+0.34%)	⬆️
nowcasting_dataset/config/model.py	93.53% <100.00%> (+0.67%)	⬆️
nowcasting_dataset/consts.py	100.00% <100.00%> (ø)
...wcasting_dataset/data_sources/datasource_output.py	88.23% <100.00%> (ø)
nowcasting_dataset/manager/base.py	98.14% <100.00%> (+0.10%)	⬆️

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

[JackKelly]

Looks good! A few comments. Nothing major 🙂

Thanks loads for tackling this - it'll be great to have all this lovely PV data for training!