Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

📊 climate: era5 surface temperature data December 2024 #3697

Merged
merged 4 commits into from
Dec 27, 2024

Conversation

veronikasamborska1994
Copy link
Contributor

@veronikasamborska1994 veronikasamborska1994 commented Dec 5, 2024

hi @Marigold - looks like they've started to only update the data in the grib format so I am making some changes to read the data in the new format - I know there were issues with this code in the past so thought it'd be good if you reviewed this!

@owidbot
Copy link
Contributor

owidbot commented Dec 5, 2024

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-era5-dec-2024

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences
= Dataset garden/climate/2023-12-20/surface_temperature
  = Table surface_temperature
    ~ Dim country
+       + New values: 195 / 198705 (0.10%)
                time        country
          2024-11-15     Azerbaijan
          2024-11-15 Cayman Islands
          2024-11-15        Iceland
          2024-11-15     Mauritania
          2024-11-15          Syria
    ~ Dim time
+       + New values: 195 / 198705 (0.10%)
                 country       time
              Azerbaijan 2024-11-15
          Cayman Islands 2024-11-15
                 Iceland 2024-11-15
              Mauritania 2024-11-15
                   Syria 2024-11-15
    ~ Column anomaly_above_0 (changed metadata, new data, changed data)
-       -       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 13-October-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^^^^^
+       +       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 19-Nov-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^
-       -     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                          --- ^^^
+       +     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                           ^^^^
-       -     date_accessed: '2024-10-13'
        ?                            ^^^
+       +     date_accessed: '2024-12-05'
        ?                           ++ ^
-       -     date_published: '2019-04-18'
        ?                             ---
+       +     date_published: '2019-12-04'
        ?                           +++
-       -       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                       --- ^^^
+       +       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                        ^^^^

+       + New values: 195 / 198705 (0.10%)
                 country       time  anomaly_above_0
              Azerbaijan 2024-11-15         0.676227
          Cayman Islands 2024-11-15         0.427959
                 Iceland 2024-11-15             <NA>
              Mauritania 2024-11-15         2.169111
                   Syria 2024-11-15         0.473109
        ~ Changed values: 333 / 198705 (0.17%)
                    country       time  anomaly_above_0 -  anomaly_above_0 +
                   Cameroon 2024-09-15           0.702833           0.714495
                     Canada 2024-09-15           3.043921           3.043594
                 Cape Verde 2024-10-15           0.378155            0.40591
          Equatorial Guinea 2024-09-15           0.799829           0.762281
                    Somalia 2024-10-15           1.751368           1.718592
    ~ Column anomaly_below_0 (changed metadata, new data, changed data)
-       -       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 13-October-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^^^^^
+       +       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 19-Nov-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^
-       -     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                          --- ^^^
+       +     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                           ^^^^
-       -     date_accessed: '2024-10-13'
        ?                            ^^^
+       +     date_accessed: '2024-12-05'
        ?                           ++ ^
-       -     date_published: '2019-04-18'
        ?                             ---
+       +     date_published: '2019-12-04'
        ?                           +++
-       -       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                       --- ^^^
+       +       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                        ^^^^

+       + New values: 195 / 198705 (0.10%)
                 country       time  anomaly_below_0
              Azerbaijan 2024-11-15             <NA>
          Cayman Islands 2024-11-15             <NA>
                 Iceland 2024-11-15        -0.151801
              Mauritania 2024-11-15             <NA>
                   Syria 2024-11-15             <NA>
        ~ Changed values: 56 / 198705 (0.03%)
               country       time  anomaly_below_0 -  anomaly_below_0 +
              Eswatini 2024-09-15          -0.153383          -0.166006
           Isle of Man 2024-09-15          -0.196747          -0.185089
            Kyrgyzstan 2024-09-15           -0.10115          -0.089222
                 Niger 2024-09-15          -0.403528           -0.35149
          South Africa 2024-09-15          -0.332178          -0.333288
    ~ Column temperature_2m (changed metadata, new data, changed data)
-       -       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 13-October-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^^^^^
+       +       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 19-Nov-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^
-       -     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                          --- ^^^
+       +     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                           ^^^^
-       -     date_accessed: '2024-10-13'
        ?                            ^^^
+       +     date_accessed: '2024-12-05'
        ?                           ++ ^
-       -     date_published: '2019-04-18'
        ?                             ---
+       +     date_published: '2019-12-04'
        ?                           +++
-       -       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                       --- ^^^
+       +       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                        ^^^^

+       + New values: 195 / 198705 (0.10%)
                 country       time  temperature_2m
              Azerbaijan 2024-11-15        7.404119
          Cayman Islands 2024-11-15       27.087738
                 Iceland 2024-11-15       -1.584782
              Mauritania 2024-11-15       26.371941
                   Syria 2024-11-15       13.935539
        ~ Changed values: 381 / 198705 (0.19%)
                   country       time  temperature_2m -  temperature_2m +
                 Guatemala 2024-09-15         24.845797         24.858412
                Luxembourg 2024-10-15         11.407206         11.405532
          Papua New Guinea 2024-10-15          24.31859         24.286854
                  Slovakia 2024-10-15          9.388906          9.382662
                   Vanuatu 2024-10-15         24.850454         24.846794
    ~ Column temperature_anomaly (changed metadata, new data, changed data)
-       -       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 13-October-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^^^^^
+       +       Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., Thépaut, J-N. (2023): ERA5 monthly averaged data on single levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS), DOI: 10.24381/cds.f17050d7 (Accessed on 19-Nov-2024)
        ?                                                                                                                                                                                                                                                                                                                                                                                           ^ ^^^
-       -     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                          --- ^^^
+       +     url_main: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                           ^^^^
-       -     date_accessed: '2024-10-13'
        ?                            ^^^
+       +     date_accessed: '2024-12-05'
        ?                           ++ ^
-       -     date_published: '2019-04-18'
        ?                             ---
+       +     date_published: '2019-12-04'
        ?                           +++
-       -       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-pressure-levels-monthly-means?tab=overview
        ?                                                                       --- ^^^
+       +       url: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels-monthly-means?tab=overview
        ?                                                                        ^^^^

+       + New values: 195 / 198705 (0.10%)
                 country       time  temperature_anomaly
              Azerbaijan 2024-11-15             0.676227
          Cayman Islands 2024-11-15             0.427959
                 Iceland 2024-11-15            -0.151801
              Mauritania 2024-11-15             2.169111
                   Syria 2024-11-15             0.473109
        ~ Changed values: 389 / 198705 (0.20%)
                country       time  temperature_anomaly -  temperature_anomaly +
           Burkina Faso 2024-09-15              -0.179939              -0.180243
          Faroe Islands 2024-09-15              -0.508323              -0.492046
                   Iraq 2024-10-15              -1.205311              -1.206623
                 Norway 2024-09-15               1.391551               1.398015
                 Poland 2024-10-15               1.225059                1.22751


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-12-27 10:09:04 UTC
Execution time: 18.28 seconds

Copy link
Collaborator

@Marigold Marigold left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@veronikasamborska1994 veronikasamborska1994 merged commit 85130a2 into master Dec 27, 2024
8 checks passed
@veronikasamborska1994 veronikasamborska1994 deleted the era5-dec-2024 branch December 27, 2024 10:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants