Skip to content

Commit

Permalink
small corrections to documentation and template
Browse files Browse the repository at this point in the history
  • Loading branch information
zakwatts committed Jan 18, 2024
1 parent e8c60ed commit d2e51b2
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 4 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -156,7 +156,7 @@ In this function the datamodule argument looks for a config under `PVNet/configs

Its important that the dates set for the training, validation and testing in the datamodule (`streamed_batches.yaml`) config are within the ranges of the dates set for the input features in the configuration (`gcp_configuration.yaml`).

If downloading data from gcp bucket or satellite data make sure to authenticate gcloud:
If downloading private data from a gcp bucket make sure to authenticate gcloud (the public satellite data does not need authentication):

```
gcloud auth login
Expand All @@ -167,7 +167,6 @@ For files stored in multiple locations they can be added as list. For example fr
```
satellite:
satellite_zarr_path: gs://solar-pv-nowcasting-data/satellite/EUMETSAT/SEVIRI_RSS/v4/2020_nonhrv.zarr
```

To satellite data hosted by Google:
Expand All @@ -178,7 +177,7 @@ satellite:
- "gs://public-datasets-eumetsat-solar-forecasting/satellite/EUMETSAT/SEVIRI_RSS/v4/2020_nonhrv.zarr"
- "gs://public-datasets-eumetsat-solar-forecasting/satellite/EUMETSAT/SEVIRI_RSS/v4/2021_nonhrv.zarr"
```
Datapipes is currently set up to use 12 channels from the satellite data which is the YEAR_nonhrv.zarr rather than YEAR_hrv.zarr.
Datapipes is currently set up to use 11 channels from the satellite data, the 12th of which is HRV and is not included in these.


### Training PVNet
Expand Down
1 change: 0 additions & 1 deletion configs.example/datamodule/streamed_batches.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@ _target_: pvnet.data.datamodule.DataModule
# Path to the data configuration yaml file. You can find examples in the configuration subdirectory
# in configs.example/datamodule/configuration
# Use the full local path such as: /FULL/PATH/PVNet/configs/datamodule/configuration/gcp_configuration.yaml"
num_workers: 20
configuration: "PLACEHOLDER.yaml"
num_workers: 20
prefetch_factor: 2
Expand Down
1 change: 1 addition & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -23,4 +23,5 @@ hydra-core
python-dotenv
hydra-optuna-sweeper
rich
# gcsfs is only needed when getting data from Google Cloud Storage
gcsfs

0 comments on commit d2e51b2

Please sign in to comment.