diff --git a/etl/steps/archive/garden/agriculture/2023-04-21/uk_long_term_yields.meta.yml b/etl/steps/archive/garden/agriculture/2023-04-21/uk_long_term_yields.meta.yml index cad6d14caa9..f6fc66d533f 100644 --- a/etl/steps/archive/garden/agriculture/2023-04-21/uk_long_term_yields.meta.yml +++ b/etl/steps/archive/garden/agriculture/2023-04-21/uk_long_term_yields.meta.yml @@ -5,7 +5,7 @@ dataset: • Data from 1270 to 1870 is taken from Table 3.06 of Broadberry et al. (2015). The data in this table is based on the Medieval Accounts Database, the Early Modern Probate Inventories Database and the Modern Farm Accounts Database. Seed sown per acre from the Medieval and Modern Databases. Pulses for the modern period and all seeds sown for the early modern period are taken from Overton and Campbell (1996), Allen (2005). This comprises crop yield estimates only for England. For this dataset, we have assumed that yields in England are also representative of average UK yields. The data was given as decadal averages, and we have assumed, for each value, the middle year in each decade. - All values of yield in bushels per acre have been converted to tonnes per hectare, using the conversion factors given by the USDA for the different commodities. + All values of yield in bushels per acre have been converted to tonnes per hectare, using the conversion factors given by [the USDA](https://www.ers.usda.gov/webdocs/publications/41880/33132_ah697_002.pdf) for the different commodities. • Data from 1870 to 1960 is taken from Table 4 of Brassley (2000). The data in this table is based on the book "A hundred Years of British food and farming: a statistical survey", by H. F. Marks (ed. D. K. Britton, 1989). The data is provided over 5-year periods. We have assumed, for each value, the middle year in each 5-year set. diff --git a/etl/steps/archive/garden/bp/2022-07-11/statistical_review.meta.yml b/etl/steps/archive/garden/bp/2022-07-11/statistical_review.meta.yml index 43544c0466d..cb5f9df1ae4 100644 --- a/etl/steps/archive/garden/bp/2022-07-11/statistical_review.meta.yml +++ b/etl/steps/archive/garden/bp/2022-07-11/statistical_review.meta.yml @@ -10,9 +10,9 @@ dataset: date_accessed: 2021-07-08 url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -38,4 +38,4 @@ dataset: * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). diff --git a/etl/steps/archive/garden/bp/2022-07-14/energy_mix.meta.yml b/etl/steps/archive/garden/bp/2022-07-14/energy_mix.meta.yml index 2a7cdcbfc45..df15ba6753e 100644 --- a/etl/steps/archive/garden/bp/2022-07-14/energy_mix.meta.yml +++ b/etl/steps/archive/garden/bp/2022-07-14/energy_mix.meta.yml @@ -10,9 +10,9 @@ dataset: date_accessed: 2022-07-08 url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -38,9 +38,9 @@ dataset: * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). description: | - Raw data on energy consumption is sourced from the BP Statistical Review of World Energy. + Raw data on energy consumption is sourced from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). Primary energy in exajoules (EJ) has been converted to TWh by Our World in Data based on a conversion factor of 1,000,000 / 3,600 (~277.778). @@ -48,11 +48,11 @@ dataset: Also, for non-fossil based electricity, there are two ways to define primary energy: * One is "direct primary energy", which corresponds to the electricity generation (in TWh). * The other is "input-equivalent primary energy" (also called "primary energy using the substitution method"). - This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in BP's methodology document. For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. + This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in [BP's methodology document](https://www.bp.com/content/dam/bp/business-sites/en/global/corporate/pdfs/energy-economics/statistical-review/bp-stats-review-2022-methodology.pdf). For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. Additional metrics have been calculated by Our World in Data: – Annual change in energy consumption by source: this is calculated as the difference from the previous year. – % of total primary energy: calculated as each source's share of primary energy (direct energy and primary energy using the substitution method) from all sources. – Per capita energy by source: calculated as primary energy consumption by source, divided by population. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). diff --git a/etl/steps/archive/garden/bp/2022-07-14/statistical_review.meta.yml b/etl/steps/archive/garden/bp/2022-07-14/statistical_review.meta.yml index 2f0d0a72c4a..66ca1356bab 100644 --- a/etl/steps/archive/garden/bp/2022-07-14/statistical_review.meta.yml +++ b/etl/steps/archive/garden/bp/2022-07-14/statistical_review.meta.yml @@ -10,9 +10,9 @@ dataset: date_accessed: 2022-07-08 url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -38,4 +38,4 @@ dataset: * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). diff --git a/etl/steps/archive/garden/bp/2022-12-28/energy_mix.meta.yml b/etl/steps/archive/garden/bp/2022-12-28/energy_mix.meta.yml index 6194cbd2c3e..2d10be74f44 100644 --- a/etl/steps/archive/garden/bp/2022-12-28/energy_mix.meta.yml +++ b/etl/steps/archive/garden/bp/2022-12-28/energy_mix.meta.yml @@ -10,9 +10,9 @@ dataset: date_accessed: 2022-07-08 url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -38,9 +38,9 @@ dataset: * "North America" - All North American countries + "Other Caribbean" + "Other North America". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). description: | - Raw data on energy consumption is sourced from the BP Statistical Review of World Energy. + Raw data on energy consumption is sourced from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). Primary energy in exajoules (EJ) has been converted to TWh by Our World in Data based on a conversion factor of 1,000,000 / 3,600 (~277.778). @@ -48,11 +48,11 @@ dataset: Also, for non-fossil based electricity, there are two ways to define primary energy: * One is "direct primary energy", which corresponds to the electricity generation (in TWh). * The other is "input-equivalent primary energy" (also called "primary energy using the substitution method"). - This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in BP's methodology document. For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. + This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in [BP's methodology document](https://www.bp.com/content/dam/bp/business-sites/en/global/corporate/pdfs/energy-economics/statistical-review/bp-stats-review-2022-methodology.pdf). For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. Additional metrics have been calculated by Our World in Data: - Annual change in energy consumption by source: this is calculated as the difference from the previous year. - % of total primary energy: calculated as each source's share of primary energy (direct energy and primary energy using the substitution method) from all sources. - Per capita energy by source: calculated as primary energy consumption by source, divided by population. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). diff --git a/etl/steps/archive/garden/bp/2022-12-28/statistical_review.meta.yml b/etl/steps/archive/garden/bp/2022-12-28/statistical_review.meta.yml index 73718ad6fc3..dc37f21437f 100644 --- a/etl/steps/archive/garden/bp/2022-12-28/statistical_review.meta.yml +++ b/etl/steps/archive/garden/bp/2022-12-28/statistical_review.meta.yml @@ -10,9 +10,9 @@ dataset: date_accessed: 2022-07-08 url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -38,7 +38,7 @@ dataset: * "North America" - All North American countries + "Other Caribbean" + "Other North America". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). tables: {} diff --git a/etl/steps/archive/garden/bp/2023-02-20/energy_mix.meta.yml b/etl/steps/archive/garden/bp/2023-02-20/energy_mix.meta.yml index fc23c52d6a4..0ded5ea0272 100644 --- a/etl/steps/archive/garden/bp/2023-02-20/energy_mix.meta.yml +++ b/etl/steps/archive/garden/bp/2023-02-20/energy_mix.meta.yml @@ -3,43 +3,75 @@ dataset: title: Energy mix (BP, 2023) short_name: energy_mix sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa". - * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". - * "Europe" - All European countries + "Other Europe". - * "North America" - All North American countries + "Other Caribbean" + "Other North America". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: >- + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes + countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" + to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding + up (when possible) the contributions from the countries in the region. + + + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: + + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, + North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. + + * "Australasia (BP)": Australia, New Zealand. + + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + + * "North America (BP)": US (excluding US territories), Canada, Mexico + + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, + Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. + + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + + + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: + + * "Africa" - All African countries + "Other Africa". + + * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". + + * "Europe" - All European countries + "Other Europe". + + * "North America" - All North American countries + "Other Caribbean" + "Other North America". + + * "Oceania" - All Oceanian countries. + + * "South America" - All South American countries + "Other South America". + + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other + regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions + [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). description: | - Raw data on energy consumption is sourced from the BP Statistical Review of World Energy. + Raw data on energy consumption is sourced from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). Primary energy in exajoules (EJ) has been converted to TWh by Our World in Data based on a conversion factor of 1,000,000 / 3,600 (~277.778). @@ -47,11 +79,11 @@ dataset: Also, for non-fossil based electricity, there are two ways to define primary energy: * One is "direct primary energy", which corresponds to the electricity generation (in TWh). * The other is "input-equivalent primary energy" (also called "primary energy using the substitution method"). - This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in BP's methodology document. For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. + This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in [BP's methodology document](https://www.bp.com/content/dam/bp/business-sites/en/global/corporate/pdfs/energy-economics/statistical-review/bp-stats-review-2022-methodology.pdf). For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. Additional metrics have been calculated by Our World in Data: - Annual change in energy consumption by source: this is calculated as the difference from the previous year. - % of total primary energy: calculated as each source's share of primary energy (direct energy and primary energy using the substitution method) from all sources. - Per capita energy by source: calculated as primary energy consumption by source, divided by population. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). diff --git a/etl/steps/archive/garden/demography/2022-11-30/life_expectancy.meta.yml b/etl/steps/archive/garden/demography/2022-11-30/life_expectancy.meta.yml index 434acc43d9d..571856518f6 100644 --- a/etl/steps/archive/garden/demography/2022-11-30/life_expectancy.meta.yml +++ b/etl/steps/archive/garden/demography/2022-11-30/life_expectancy.meta.yml @@ -2,310 +2,250 @@ dataset: namespace: demography short_name: life_expectancy title: Life Expectancy (various sources) - description: | + description: >- This dataset has been created using multiple sources. We use UN WPP for data since 1950 (estimates and medium variant) and a combination of other sources before this year. + For continents, we use UN's definitions for values after 1950 and Riley (2005) definitions for values prior to 1950. Note that Riley reports "Americas", while the UN reports "Northern America" and "Latin America and the Caribbean" separately. - SOURCES - World Population Prospects - UN (2022) - World Population Prospects 2022 is the 27th edition of the official estimates and projections of the global population that have been published by the United Nations since 1951. The estimates are based on all available sources of data on population size and levels of fertility, mortality and international migration for 237 countries or areas. More details at https://population.un.org/wpp/Publications/. + **SOURCES** + + + **World Population Prospects - UN (2022)** + + World Population Prospects 2022 is the 27th edition of the official estimates and projections of the global population that have been published by the United Nations since 1951. + The estimates are based on all available sources of data on population size and levels of fertility, mortality and international migration for 237 countries or areas. + More details at https://population.un.org/wpp/Publications/. + + + **Life Tables - Human Mortality Database (2022-11-04)** + + To facilitate rapid downloads, the database has been organized into zipped data files. Two series of files are intended for different purposes and for different users. + For users who want to obtain all available data for an individual country or for all countries, the zipped data files labeled "By country" are recommended. The file + organization follows internal practices and is not particularly user-friendly, but all publicly-available HMD data are included in this set.For users who only want + information of a given kind for all countries, the files "By statistic" are recommended. In this case the file organization is simpler, but only certain parts of + the database (i.e., items labeled "Complete Data Series" on country pages) are available in this format. - Life Tables - Human Mortality Database (2022-11-04) - To facilitate rapid downloads, the database has been organized into zipped data files. Two series of files are intended for different purposes and for different users. For users who want to obtain all available data for an individual country or for all countries, the zipped data files labeled "By country" are recommended. The file organization follows internal practices and is not particularly user-friendly, but all publicly-available HMD data are included in this set.For users who only want information of a given kind for all countries, the files "By statistic" are recommended. In this case the file organization is simpler, but only certain parts of the database (i.e., items labeled "Complete Data Series" on country pages) are available in this format. More details can be found at https://www.mortality.org/Data/ExplanatoryNotes. - Life Expectancy at Birth (Total) - Zijdeman et al. (2015) + + **Life Expectancy at Birth (Total) - Zijdeman et al. (2015)** + This dataset provides Period Life Expectancy at birth per country and year. The overall aim of the dataset is to cover the entire world for the period 1500-2000. The current version (version 2) was build as part of the OECD "How was life" project. The dataset has nearly global coverage for the post 1950 period, while pre 1950 the coverage decreases the more historic the time period. Depending on sources, the data are annual estimates, 5 yearly or decadel estimates + The sources used are: - - UN World Population Project. - - http://www.mortality.org. - - http://www.gapminder.org. - - http://stats.oecd.org. - - Montevideo-Oxford Latin America Economic History Database. - - http://www.ons.gov.uk/ons/datasets-and-tables/index.html. - - http://www.abs.gov.au/ausstats/abs@.nsf/web+pages/statistics?opendocument#from-banner=LN. - - Kannisto, V., Nieminen, M. & Turpeinen, O. (1999). Finnish Life Tables since 1751, Demographic Research, 1(1), DOI: 10.4054/DemRes.1999.1.1 + + - [UN World Population Project](http://esa.un.org/wpp/). + + - [Human Mortality Database](http://www.mortality.org). + + - [Gapminder](http://www.gapminder.org). + + - [OECD](http://stats.oecd.org). + + - [Montevideo-Oxford Latin America Economic History Database](http://www.lac.ox.ac.uk/moxlad-database). + + - [ONS](http://www.ons.gov.uk/ons/datasets-and-tables/index.html). + + - [Australian Bureau of Statistics](http://www.abs.gov.au/ausstats/abs@.nsf/web+pages/statistics?opendocument#from-banner=LN). + + - Kannisto, V., Nieminen, M. & Turpeinen, O. (1999). Finnish Life Tables since 1751, Demographic Research, 1(1), DOI: 10.4054/DemRes.1999.1.1 + For specifics concerning (selections of) the sources, see the R-file below, with which the dataset was created. + Link to paper can be found at https://clio-infra.eu/docs/Total_life_expectancy.docx. licenses: - - name: CC BY 3.0 IGO - url: http://creativecommons.org/licenses/by/3.0/igo/ - - name: CC BY 4.0 - url: https://www.mortality.org/Data/UserAgreement - - name: CC0 1.0 Universal (CC0 1.0) Public Domain Dedication License - url: https://datasets.iisg.amsterdam/dataset.xhtml?persistentId=hdl:10622/LKYT53 - - name: JSTOR - url: https://about.jstor.org/terms/ - version: "2022-11-30" + - name: CC BY 3.0 IGO + url: http://creativecommons.org/licenses/by/3.0/igo/ + - name: CC BY 4.0 + url: https://www.mortality.org/Data/UserAgreement + - name: CC0 1.0 Universal (CC0 1.0) Public Domain Dedication License + url: https://datasets.iisg.amsterdam/dataset.xhtml?persistentId=hdl:10622/LKYT53 + - name: JSTOR + url: https://about.jstor.org/terms/ + version: '2022-11-30' sources: - - name: - United Nations, Department of Economic and Social Affairs, Population Division - (2022) - url: https://population.un.org/wpp/Download/ - owid_data_url: https://walden.nyc3.digitaloceanspaces.com/un/2022-07-11/un_wpp.zip - date_accessed: "2022-09-09" - publication_date: "2022-07-11" - publication_year: 2022 - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles - owid_data_url: https://walden.nyc3.digitaloceanspaces.com/hmd/2022-11-04/life_tables.zip - date_accessed: "2022-11-04" - publication_year: 2022 - - name: Zijdeman et al. (2015) (via clio-infra.eu) - url: https://clio-infra.eu/Indicators/LifeExpectancyatBirthTotal.html - source_data_url: https://clio-infra.eu/data/LifeExpectancyatBirth(Total)_Broad.xlsx - owid_data_url: https://walden.nyc3.digitaloceanspaces.com/papers/2022-11-01/zijdeman_et_al_2015.xlsx - date_accessed: "2022-11-01" - publication_year: 2015 - - name: Riley (2005) - url: https://doi.org/10.1111/j.1728-4457.2005.00083.x - source_data_url: https://u.demog.berkeley.edu/~jrw/Biblio/Eprints/%20P-S/riley.2005_estimates.global.e0.pdf - owid_data_url: https://walden.nyc3.digitaloceanspaces.com/papers/2022-11-01/riley_2005.pdf - date_accessed: "2022-11-01" - publication_date: "2005-10-21" - publication_year: 2005 + - name: United Nations, Department of Economic and Social Affairs, Population Division (2022) + url: https://population.un.org/wpp/Download/ + owid_data_url: https://walden.nyc3.digitaloceanspaces.com/un/2022-07-11/un_wpp.zip + date_accessed: '2022-09-09' + publication_date: '2022-07-11' + publication_year: 2022 + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles + owid_data_url: https://walden.nyc3.digitaloceanspaces.com/hmd/2022-11-04/life_tables.zip + date_accessed: '2022-11-04' + publication_year: 2022 + - name: Zijdeman et al. (2015) (via clio-infra.eu) + url: https://clio-infra.eu/Indicators/LifeExpectancyatBirthTotal.html + source_data_url: https://clio-infra.eu/data/LifeExpectancyatBirth(Total)_Broad.xlsx + owid_data_url: https://walden.nyc3.digitaloceanspaces.com/papers/2022-11-01/zijdeman_et_al_2015.xlsx + date_accessed: '2022-11-01' + publication_year: 2015 + - name: Riley (2005) + url: https://doi.org/10.1111/j.1728-4457.2005.00083.x + source_data_url: https://u.demog.berkeley.edu/~jrw/Biblio/Eprints/%20P-S/riley.2005_estimates.global.e0.pdf + owid_data_url: https://walden.nyc3.digitaloceanspaces.com/papers/2022-11-01/riley_2005.pdf + date_accessed: '2022-11-01' + publication_date: '2005-10-21' + publication_year: 2005 tables: historical: title: Life Expectancy (various sources) - Historical variables: life_expectancy_0_hist: title: Life expectancy at birth (historical) - description: - "The average number of years that a newborn could expect to live, - if he or she were to pass through life exposed to the sex- and age-specific - death rates prevailing at the time of his or her birth, for a specific year, - in a given country, territory, or geographic area. - - - Definition from the WHO. - - " + description: "The average number of years that a newborn could expect to live, if he or she were to pass through life + exposed to the sex- and age-specific death rates prevailing at the time of his or her birth, for a specific year, + in a given country, territory, or geographic area.\n\nDefinition from the WHO.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Zijdeman et al. (2015) - url: https://clio-infra.eu/Indicators/LifeExpectancyatBirthTotal.html - - name: Riley (2005) - url: https://doi.org/10.1111/j.1728-4457.2005.00083.x + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Zijdeman et al. (2015) + url: https://clio-infra.eu/Indicators/LifeExpectancyatBirthTotal.html + - name: Riley (2005) + url: https://doi.org/10.1111/j.1728-4457.2005.00083.x life_expectancy_15_hist: title: Life expectancy at 15 (historical) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 15 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 15 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles life_expectancy_65_hist: title: Life expectancy at 65 (historical) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 65 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 65 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles life_expectancy_80_hist: title: Life expectancy at 80 (historical) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 80 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 80 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles life_expectancy: title: Life Expectancy (various sources) variables: life_expectancy_0: title: Life expectancy at birth - description: - "The average number of years that a newborn could expect to live, - if he or she were to pass through life exposed to the sex- and age-specific - death rates prevailing at the time of his or her birth, for a specific year, - in a given country, territory, or geographic area. - - - Definition from the WHO. - - " + description: "The average number of years that a newborn could expect to live, if he or she were to pass through life + exposed to the sex- and age-specific death rates prevailing at the time of his or her birth, for a specific year, + in a given country, territory, or geographic area.\n\nDefinition from the WHO.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Zijdeman et al. (2015) - url: https://clio-infra.eu/Indicators/LifeExpectancyatBirthTotal.html - - name: Riley (2005) - url: https://doi.org/10.1111/j.1728-4457.2005.00083.x + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Zijdeman et al. (2015) + url: https://clio-infra.eu/Indicators/LifeExpectancyatBirthTotal.html + - name: Riley (2005) + url: https://doi.org/10.1111/j.1728-4457.2005.00083.x life_expectancy_15: title: Life expectancy at 15 - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 15 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 15 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles life_expectancy_65: title: Life expectancy at 65 - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 65 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 65 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles life_expectancy_80: title: Life expectancy at 80 - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 80 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 80 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles projection: title: Life Expectancy (various sources) - Projection variables: life_expectancy_0_proj: title: Life expectancy at birth (projection) - description: - "The average number of years that a newborn could expect to live, - if he or she were to pass through life exposed to the sex- and age-specific - death rates prevailing at the time of his or her birth, for a specific year, - in a given country, territory, or geographic area. - - - Definition from the WHO. - - " + description: "The average number of years that a newborn could expect to live, if he or she were to pass through life + exposed to the sex- and age-specific death rates prevailing at the time of his or her birth, for a specific year, + in a given country, territory, or geographic area.\n\nDefinition from the WHO.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ life_expectancy_15_proj: title: Life expectancy at 15 (projection) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 15 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 15 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ life_expectancy_65_proj: title: Life expectancy at 65 (projection) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 65 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 65 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ - - name: Human Mortality Database - url: https://www.mortality.org/Data/ZippedDataFiles + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ + - name: Human Mortality Database + url: https://www.mortality.org/Data/ZippedDataFiles life_expectancy_80_proj: title: Life expectancy at 80 (projection) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 80 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 80 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - name: UN WPP (2022) - url: https://population.un.org/wpp/Download/ + - name: UN WPP (2022) + url: https://population.un.org/wpp/Download/ diff --git a/etl/steps/archive/garden/eia/2022-07-27/energy_consumption.meta.yml b/etl/steps/archive/garden/eia/2022-07-27/energy_consumption.meta.yml index cf9b7d315fb..ea8551ecde8 100644 --- a/etl/steps/archive/garden/eia/2022-07-27/energy_consumption.meta.yml +++ b/etl/steps/archive/garden/eia/2022-07-27/energy_consumption.meta.yml @@ -4,24 +4,21 @@ dataset: title: Total energy consumption (EIA, 2022) short_name: energy_consumption description: | - Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their Bulk Download Facility. - - EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with our region definitions). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their [Bulk Download Facility](https://www.eia.gov/opendata/bulkfiles.php). + EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. sources: - - - name: Our World in Data based on EIA's total energy consumption (2022) - published_by: U.S. Energy Information Administration (EIA) - publication_year: 2022 - date_accessed: 2022-07-27 - url: https://www.eia.gov/opendata/bulkfiles.php - + - name: Our World in Data based on EIA's total energy consumption (2022) + published_by: U.S. Energy Information Administration (EIA) + publication_year: 2022 + date_accessed: 2022-07-27 + url: https://www.eia.gov/opendata/bulkfiles.php tables: energy_consumption: variables: - energy_consumption: - title: Total energy consumption (TWh) - short_unit: TWh - unit: terawatt-hours - display: - name: Total energy consumption + energy_consumption: + title: Total energy consumption (TWh) + short_unit: TWh + unit: terawatt-hours + display: + name: Total energy consumption diff --git a/etl/steps/archive/garden/ember/2022-12-13/yearly_electricity.meta.yml b/etl/steps/archive/garden/ember/2022-12-13/yearly_electricity.meta.yml index 27e8777d08d..2e8d5986346 100644 --- a/etl/steps/archive/garden/ember/2022-12-13/yearly_electricity.meta.yml +++ b/etl/steps/archive/garden/ember/2022-12-13/yearly_electricity.meta.yml @@ -4,19 +4,17 @@ dataset: title: Yearly Electricity Data (Ember, 2022) short_name: yearly_electricity description: | - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on Ember's Yearly Electricity Data (2022). - published_by: Ember - publication_year: 2022 - date_accessed: 2022-12-13 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - + - name: Our World in Data based on Ember's Yearly Electricity Data (2022). + published_by: Ember + publication_year: 2022 + date_accessed: 2022-12-13 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ tables: capacity: variables: @@ -132,38 +130,38 @@ tables: variables: clean__pct: title: Clean (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Clean fossil__pct: title: Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil gas_and_other_fossil__pct: title: Gas and Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas and Other Fossil hydro__bioenergy_and_other_renewables__pct: title: Hydro, Bioenergy and Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro, Bioenergy and Other Renewables renewables__pct: title: Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables wind_and_solar__pct: title: Wind and Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind and Solar clean__twh: @@ -204,56 +202,56 @@ tables: name: Wind and Solar bioenergy__pct: title: Bioenergy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy coal__pct: title: Coal (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal gas__pct: title: Gas (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro__pct: title: Hydro (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro nuclear__pct: title: Nuclear (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear other_fossil__pct: title: Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Fossil other_renewables__pct: title: Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Renewables solar__pct: title: Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar wind__pct: title: Wind (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind bioenergy__twh: diff --git a/etl/steps/archive/garden/ember/2023-02-20/yearly_electricity.meta.yml b/etl/steps/archive/garden/ember/2023-02-20/yearly_electricity.meta.yml index 1ac20d0c922..3229696770d 100644 --- a/etl/steps/archive/garden/ember/2023-02-20/yearly_electricity.meta.yml +++ b/etl/steps/archive/garden/ember/2023-02-20/yearly_electricity.meta.yml @@ -4,23 +4,21 @@ dataset: title: Yearly Electricity Data (Ember, 2023) short_name: yearly_electricity description: | - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on Ember's Yearly Electricity Data (2023). - published_by: Ember - publication_year: 2023 - publication_date: 2023-01-31 - date_accessed: 2023-02-20 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - + - name: Our World in Data based on Ember's Yearly Electricity Data (2023). + published_by: Ember + publication_year: 2023 + publication_date: 2023-01-31 + date_accessed: 2023-02-20 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ tables: capacity: - title: "Capacity" + title: Capacity variables: clean__gw: title: Clean (GW) @@ -113,7 +111,7 @@ tables: display: name: Wind electricity_demand: - title: "Electricity demand" + title: Electricity demand variables: demand__twh: title: Demand (TWh) @@ -132,42 +130,42 @@ tables: display: name: Demand per capita electricity_generation: - title: "Electricity generation" + title: Electricity generation variables: clean__pct: title: Clean (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Clean fossil__pct: title: Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil gas_and_other_fossil__pct: title: Gas and Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas and Other Fossil hydro__bioenergy_and_other_renewables__pct: title: Hydro, Bioenergy and Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro, Bioenergy and Other Renewables renewables__pct: title: Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables wind_and_solar__pct: title: Wind and Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind and Solar clean__twh: @@ -208,56 +206,56 @@ tables: name: Wind and Solar bioenergy__pct: title: Bioenergy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy coal__pct: title: Coal (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal gas__pct: title: Gas (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro__pct: title: Hydro (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro nuclear__pct: title: Nuclear (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear other_fossil__pct: title: Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Fossil other_renewables__pct: title: Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Renewables solar__pct: title: Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar wind__pct: title: Wind (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind bioenergy__twh: @@ -321,7 +319,7 @@ tables: display: name: Total Generation electricity_imports: - title: "Electricity imports" + title: Electricity imports variables: net_imports__twh: title: Net Imports (TWh) @@ -330,7 +328,7 @@ tables: display: name: Net Imports power_sector_emissions: - title: "Power sector emissions" + title: Power sector emissions variables: clean__mtco2: title: Clean (mtCO2) diff --git a/etl/steps/archive/garden/ember/2023-06-01/yearly_electricity.meta.yml b/etl/steps/archive/garden/ember/2023-06-01/yearly_electricity.meta.yml index 8addeefc83d..1cff8a10da4 100644 --- a/etl/steps/archive/garden/ember/2023-06-01/yearly_electricity.meta.yml +++ b/etl/steps/archive/garden/ember/2023-06-01/yearly_electricity.meta.yml @@ -1,7 +1,7 @@ dataset: title: Yearly Electricity Data (Ember, 2023b) description: | - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. @@ -102,7 +102,7 @@ tables: display: name: Wind electricity_demand: - title: "Electricity demand" + title: Electricity demand variables: demand__twh: title: Demand (TWh) @@ -121,42 +121,42 @@ tables: display: name: Demand per capita electricity_generation: - title: "Electricity generation" + title: Electricity generation variables: clean__pct: title: Clean (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Clean fossil__pct: title: Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil gas_and_other_fossil__pct: title: Gas and Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas and Other Fossil hydro__bioenergy_and_other_renewables__pct: title: Hydro, Bioenergy and Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro, Bioenergy and Other Renewables renewables__pct: title: Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables wind_and_solar__pct: title: Wind and Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind and Solar clean__twh: @@ -197,56 +197,56 @@ tables: name: Wind and Solar bioenergy__pct: title: Bioenergy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy coal__pct: title: Coal (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal gas__pct: title: Gas (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro__pct: title: Hydro (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro nuclear__pct: title: Nuclear (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear other_fossil__pct: title: Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Fossil other_renewables__pct: title: Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Renewables solar__pct: title: Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar wind__pct: title: Wind (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind bioenergy__twh: @@ -310,7 +310,7 @@ tables: display: name: Total Generation electricity_imports: - title: "Electricity imports" + title: Electricity imports variables: net_imports__twh: title: Net Imports (TWh) @@ -319,7 +319,7 @@ tables: display: name: Net Imports power_sector_emissions: - title: "Power sector emissions" + title: Power sector emissions variables: clean__mtco2: title: Clean (mtCO2) diff --git a/etl/steps/archive/garden/emissions/2023-05-03/owid_co2.meta.yml b/etl/steps/archive/garden/emissions/2023-05-03/owid_co2.meta.yml index 080d012dcff..34dd2c1b65f 100644 --- a/etl/steps/archive/garden/emissions/2023-05-03/owid_co2.meta.yml +++ b/etl/steps/archive/garden/emissions/2023-05-03/owid_co2.meta.yml @@ -3,7 +3,7 @@ dataset: description: | OWID CO2 dataset. - This dataset will be loaded by the co2-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the co2-data repository](https://github.com/owid/co2-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' original metadata. diff --git a/etl/steps/archive/garden/energy/2022-07-20/fossil_fuel_production.meta.yml b/etl/steps/archive/garden/energy/2022-07-20/fossil_fuel_production.meta.yml index 9f22a9b9c77..e552be31878 100644 --- a/etl/steps/archive/garden/energy/2022-07-20/fossil_fuel_production.meta.yml +++ b/etl/steps/archive/garden/energy/2022-07-20/fossil_fuel_production.meta.yml @@ -3,136 +3,172 @@ dataset: version: 2022-07-20 title: Fossil fuel production (BP & Shift, 2022) short_name: fossil_fuel_production - description: | - This dataset on fossil fuel production is generated by combining the latest data from the BP Statistical Review of World Energy and The Shift Dataportal. + description: >- + This dataset on fossil fuel production is generated by combining the latest data from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) + and [The Shift Dataportal](https://www.theshiftdataportal.org/energy). + BP provide fossil fuel production data from 1965 onwards (and crude prices from 1861 onwards). The Shift Dataportal provides long-term data from 1900, but only extends to 2016. - To maintain consistency with the energy datasets on Our World in Data, we have taken BP data as preference – meaning if BP provides data for the given country and year, this is used. Where data is not available from BP for a given country, or pre-1965 we rely on data from Shift. + + To maintain consistency with the energy datasets on Our World in Data, we have taken BP data as preference – meaning if BP provides data for the given country and year, this is used. + Where data is not available from BP for a given country, or pre-1965 we rely on data from Shift. + We have converted primary production in exajoules to terawatt-hours using the conversion factor: 1,000,000 / 3,600 ~ 278. - Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe (BP)", or "Other CIS (BP)"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa (BP)". - * "Asia" - All Asian countries + "Other Middle East (BP)" + "Other CIS (BP)" + "Other Asia Pacific (BP)". - * "Europe" - All European countries + "Other Europe (BP)". - * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. - - - name: Our World in Data based on The Shift Dataportal (2022) - published_by: The Shift Dataportal - date_accessed: 2022-07-18 - url: https://www.theshiftdataportal.org/energy + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: >- + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America + includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions + like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These + aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + + + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), + denoted with "(BP)", are: + + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, + Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. + + * "Australasia (BP)": Australia, New Zealand. + + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + + * "North America (BP)": US (excluding US territories), Canada, Mexico + + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, + Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. + + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + + + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe (BP)", or "Other CIS (BP)"). We define our regions in the following way: + + * "Africa" - All African countries + "Other Africa (BP)". + + * "Asia" - All Asian countries + "Other Middle East (BP)" + "Other CIS (BP)" + "Other Asia Pacific (BP)". + + * "Europe" - All European countries + "Other Europe (BP)". + + * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". + + * "Oceania" - All Oceanian countries. + + * "South America" - All South American countries + "Other South America (BP)". + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included + (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions + [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). + - name: Our World in Data based on The Shift Dataportal (2022) + published_by: The Shift Dataportal + date_accessed: 2022-07-18 + url: https://www.theshiftdataportal.org/energy tables: fossil_fuel_production: variables: annual_change_in_coal_production__pct: - title: "Annual change in coal production (%)" - short_unit: "%" - unit: "%" + title: Annual change in coal production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_coal_production__twh: - title: "Annual change in coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_gas_production__pct: - title: "Annual change in gas production (%)" - short_unit: "%" - unit: "%" + title: Annual change in gas production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_gas_production__twh: - title: "Annual change in gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_oil_production__pct: - title: "Annual change in oil production (%)" - short_unit: "%" - unit: "%" + title: Annual change in oil production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in oil production" + name: Annual change in oil production annual_change_in_oil_production__twh: - title: "Annual change in oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in oil production" + name: Annual change in oil production coal_production__twh: - title: "Coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Coal production" + name: Coal production numDecimalPlaces: 0 coal_production_per_capita__kwh: - title: "Coal production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Coal production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Coal production per capita" + name: Coal production per capita numDecimalPlaces: 0 gas_production__twh: - title: "Gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Gas production" + name: Gas production numDecimalPlaces: 0 gas_production_per_capita__kwh: - title: "Gas production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Gas production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Gas production per capita" + name: Gas production per capita numDecimalPlaces: 0 oil_production__twh: - title: "Oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Oil production" + name: Oil production numDecimalPlaces: 0 oil_production_per_capita__kwh: - title: "Oil production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Oil production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Oil production per capita" + name: Oil production per capita numDecimalPlaces: 0 diff --git a/etl/steps/archive/garden/energy/2022-07-29/primary_energy_consumption.meta.yml b/etl/steps/archive/garden/energy/2022-07-29/primary_energy_consumption.meta.yml index 03bd51a31c3..cdee70489d7 100644 --- a/etl/steps/archive/garden/energy/2022-07-29/primary_energy_consumption.meta.yml +++ b/etl/steps/archive/garden/energy/2022-07-29/primary_energy_consumption.meta.yml @@ -3,75 +3,117 @@ dataset: version: 2022-07-29 title: Primary energy consumption (BP & EIA, 2022) short_name: primary_energy_consumption - description: | + description: >- Primary energy consumption data was compiled by Our World in Data based on two key data sources: - 1. BP Statistical Review of World Energy. - 2. International energy data from the U.S. Energy Information Administration (EIA). - BP provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset with energy data from the EIA. Where BP provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. + 1. [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + 2. [International energy data from the U.S. Energy Information Administration (EIA)](https://www.eia.gov/international/data/world/total-energy/more-total-energy-data). + + + BP provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset + with energy data from the EIA. Where BP provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. + + + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). + + + To calculate energy per unit of GDP, we use total real GDP figures from [the Maddison Project Database, version 2020](https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020). - To calculate energy per unit of GDP, we use total real GDP figures from the Maddison Project Database, version 2020. This dataset is based on Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update ”. GDP is measured in 2011$ which are PPP-adjusted. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe (BP)", or "Other CIS (BP)"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa (BP)". - * "Asia" - All Asian countries + "Other Middle East (BP)" + "Other CIS (BP)" + "Other Asia Pacific (BP)". - * "Europe" - All European countries + "Other Europe (BP)". - * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. - - - name: Our World in Data based on EIA International energy data (2022) - published_by: U.S. Energy Information Administration (EIA) - date_accessed: 2022-07-27 - url: https://www.eia.gov/opendata/bulkfiles.php - description: | - Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their Bulk Download Facility. - - EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with our region definitions). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - - name: Maddison Project Database 2020 (Bolt and van Zanden, 2020) - published_by: Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update“. - date_accessed: 2022-04-12 - url: https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020 + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: >- + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, + whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). + For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data + aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + + + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), + denoted with "(BP)", are: + + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, + Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, + Papua New Guinea and Oceania. + + * "Australasia (BP)": Australia, New Zealand. + + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + + * "North America (BP)": US (excluding US territories), Canada, Mexico + + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, + Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, + Japan, Mexico, New Zealand, South Korea, US. + + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + + + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe (BP)", or "Other CIS (BP)"). We define our regions in the following way: + + * "Africa" - All African countries + "Other Africa (BP)". + + * "Asia" - All Asian countries + "Other Middle East (BP)" + "Other CIS (BP)" + "Other Asia Pacific (BP)". + + * "Europe" - All European countries + "Other Europe (BP)". + + * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". + + * "Oceania" - All Oceanian countries. + + * "South America" - All South American countries + "Other South America (BP)". + + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). + Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included + in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). + - name: Our World in Data based on EIA International energy data (2022) + published_by: U.S. Energy Information Administration (EIA) + date_accessed: 2022-07-27 + url: https://www.eia.gov/opendata/bulkfiles.php + description: | + Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their [Bulk Download Facility](https://www.eia.gov/opendata/bulkfiles.php). + EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with + [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data + using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the + contributions from the countries in the region. + - name: Maddison Project Database 2020 (Bolt and van Zanden, 2020) + published_by: "Bolt, Jutta and Jan Luiten van Zanden (2020), 'Maddison style estimates of the evolution of the world economy. A new 2020 update'." + date_accessed: 2022-04-12 + url: https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020 tables: primary_energy_consumption: variables: annual_change_in_primary_energy_consumption__pct: title: Annual change in primary energy consumption (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Annual change in primary energy consumption annual_change_in_primary_energy_consumption__twh: @@ -84,7 +126,9 @@ tables: title: GDP short_unit: $ unit: 2011 int-$ - description: Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over + time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. display: numDecimalPlaces: 0 population: diff --git a/etl/steps/archive/garden/energy/2022-12-13/electricity_mix.meta.yml b/etl/steps/archive/garden/energy/2022-12-13/electricity_mix.meta.yml index 8cad213e6bc..1d5e478c1b7 100644 --- a/etl/steps/archive/garden/energy/2022-12-13/electricity_mix.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-13/electricity_mix.meta.yml @@ -5,9 +5,9 @@ dataset: short_name: electricity_mix description: | Data is compiled by Our World in Data based on three main sources: - - BP Statistical Review of World Energy. - - Ember Yearly Electricity Data (2022). - - Ember European Electricity Review (2022). + - [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + - [Ember Yearly Electricity Data (2022)](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + - [Ember European Electricity Review (2022)](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: - Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -18,16 +18,16 @@ dataset: - IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. - WRI: Annual global capacity data for Other Fossil where other sources are not available. - European carbon intensities rely on data from the European Environment Agency (EEA). - - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found here. - - A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found [here](https://ember-climate.org/app/uploads/2022/07/Ember-Electricity-Data-Methodology.pdf). + - A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on Ember as the primary source of electricity consumption data. While BP provides primary energy (not just electricity) consumption data and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990), BP does not provide data for all countries or for all sources of electricity (for example, only Ember provides data on electricity from bioenergy). So, where data from Ember is available for a given country and year, we rely on it as the primary source. We then supplement this with data from BP where data from Ember is not available. Our World in Data has converted absolute electricity production by source to the share in the mix by dividing each by total electricity production. - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -53,33 +53,29 @@ dataset: * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Our World in Data based on Ember's Yearly Electricity Data (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-12-13 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Our World in Data based on Ember's European Electricity Review (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Our World in Data based on Ember's Yearly Electricity Data (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-12-13 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Our World in Data based on Ember's European Electricity Review (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: electricity_mix: variables: @@ -91,8 +87,8 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: @@ -109,8 +105,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -121,8 +117,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -133,8 +129,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -145,8 +141,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -157,14 +153,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -175,8 +171,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -187,8 +183,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -199,8 +195,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -211,8 +207,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -333,8 +329,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -346,8 +342,8 @@ tables: name: Solar solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar total_demand__twh: @@ -358,8 +354,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -388,7 +384,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/archive/garden/energy/2022-12-13/owid_energy.meta.yml b/etl/steps/archive/garden/energy/2022-12-13/owid_energy.meta.yml index 74e313af5b4..71459dcc410 100644 --- a/etl/steps/archive/garden/energy/2022-12-13/owid_energy.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-13/owid_energy.meta.yml @@ -6,7 +6,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/archive/garden/energy/2022-12-13/uk_historical_electricity.meta.yml b/etl/steps/archive/garden/energy/2022-12-13/uk_historical_electricity.meta.yml index 2a846181815..a864510d549 100644 --- a/etl/steps/archive/garden/energy/2022-12-13/uk_historical_electricity.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-13/uk_historical_electricity.meta.yml @@ -4,33 +4,28 @@ dataset: title: UK historical electricity (DUKES, 2022b) short_name: uk_historical_electricity description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). - All other data is sourced from the BP's Statistical Review of World Energy and Ember's Yearly Electricity Data. Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. + All other data is sourced from the [BP's Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [Ember's Yearly Electricity Data](https://ember-climate.org/data-catalogue/yearly-electricity-data/). Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. sources: - - - name: Digest of UK Energy Statistics - published_by: UK's Department for Business, Energy & Industrial Strategy - date_accessed: 2022-09-21 - url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data - - - name: BP Statistical Review of World Energy - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Ember's Yearly Electricity Data - published_by: Ember - publication_year: 2022 - date_accessed: 2022-12-13 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Ember's European Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Digest of UK Energy Statistics + published_by: UK's Department for Business, Energy & Industrial Strategy + date_accessed: 2022-09-21 + url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data + - name: BP Statistical Review of World Energy + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Ember's Yearly Electricity Data + published_by: Ember + publication_year: 2022 + date_accessed: 2022-12-13 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Ember's European Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: uk_historical_electricity: variables: diff --git a/etl/steps/archive/garden/energy/2022-12-28/electricity_mix.meta.yml b/etl/steps/archive/garden/energy/2022-12-28/electricity_mix.meta.yml index 7717edf5a75..84faa0b650e 100644 --- a/etl/steps/archive/garden/energy/2022-12-28/electricity_mix.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-28/electricity_mix.meta.yml @@ -5,9 +5,9 @@ dataset: short_name: electricity_mix description: | Data is compiled by Our World in Data based on three main sources: - - BP Statistical Review of World Energy. - - Ember Yearly Electricity Data (2022). - - Ember European Electricity Review (2022). + - [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + - [Ember Yearly Electricity Data (2022)](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + - [Ember European Electricity Review (2022)](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: - Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -18,16 +18,16 @@ dataset: - IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. - WRI: Annual global capacity data for Other Fossil where other sources are not available. - European carbon intensities rely on data from the European Environment Agency (EEA). - - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found here. - - A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found [here](https://ember-climate.org/app/uploads/2022/07/Ember-Electricity-Data-Methodology.pdf). + - A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on Ember as the primary source of electricity consumption data. While BP provides primary energy (not just electricity) consumption data and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990), BP does not provide data for all countries or for all sources of electricity (for example, only Ember provides data on electricity from bioenergy). So, where data from Ember is available for a given country and year, we rely on it as the primary source. We then supplement this with data from BP where data from Ember is not available. Our World in Data has converted absolute electricity production by source to the share in the mix by dividing each by total electricity production. - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -53,33 +53,29 @@ dataset: * "North America" - All North American countries + "Other Caribbean" + "Other North America". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Our World in Data based on Ember's Yearly Electricity Data (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-12-13 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Our World in Data based on Ember's European Electricity Review (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Our World in Data based on Ember's Yearly Electricity Data (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-12-13 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Our World in Data based on Ember's European Electricity Review (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: electricity_mix: variables: @@ -91,8 +87,8 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: @@ -109,8 +105,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -121,8 +117,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -133,8 +129,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -145,8 +141,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -157,14 +153,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -175,8 +171,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -187,8 +183,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -199,8 +195,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -211,8 +207,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -333,8 +329,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -346,8 +342,8 @@ tables: name: Solar solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar total_demand__twh: @@ -358,8 +354,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -388,7 +384,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/archive/garden/energy/2022-12-28/fossil_fuel_production.meta.yml b/etl/steps/archive/garden/energy/2022-12-28/fossil_fuel_production.meta.yml index f7e0eb61cda..ae2b1aab34e 100644 --- a/etl/steps/archive/garden/energy/2022-12-28/fossil_fuel_production.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-28/fossil_fuel_production.meta.yml @@ -3,136 +3,167 @@ dataset: version: 2022-12-28 title: Fossil fuel production (BP & Shift, 2022b) short_name: fossil_fuel_production - description: | - This dataset on fossil fuel production is generated by combining the latest data from the BP Statistical Review of World Energy and The Shift Dataportal. + description: >- + This dataset on fossil fuel production is generated by combining the latest data from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) + and [The Shift Dataportal](https://www.theshiftdataportal.org/energy). BP provide fossil fuel production data from 1965 onwards (and crude prices from 1861 onwards). The Shift Dataportal provides long-term data from 1900, but only extends to 2016. - To maintain consistency with the energy datasets on Our World in Data, we have taken BP data as preference - meaning if BP provides data for the given country and year, this is used. Where data is not available from BP for a given country, or pre-1965 we rely on data from Shift. + To maintain consistency with the energy datasets on Our World in Data, we have taken BP data as preference - meaning if BP provides data for the given country and year, this is used. Where data is not available + from BP for a given country, or pre-1965 we rely on data from Shift. We have converted primary production in exajoules to terawatt-hours using the conversion factor: 1,000,000 / 3,600 ~ 278. - Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa". - * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". - * "Europe" - All European countries + "Other Europe". - * "North America" - All North American countries + "Other Caribbean" + "Other North America". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. - - - name: Our World in Data based on The Shift Dataportal (2022) - published_by: The Shift Dataportal - date_accessed: 2022-07-18 - url: https://www.theshiftdataportal.org/energy + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: >- + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes + countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like + "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These + aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), + denoted with "(BP)", are: + + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. + + * "Australasia (BP)": Australia, New Zealand. + + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + + * "North America (BP)": US (excluding US territories), Canada, Mexico + + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. + + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + + + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: + + * "Africa" - All African countries + "Other Africa". + + * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". + + * "Europe" - All European countries + "Other Europe". + + * "North America" - All North American countries + "Other Caribbean" + "Other North America". + + * "Oceania" - All Oceanian countries. + + * "South America" - All South American countries + "Other South America". + + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). + Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). + Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). + - name: Our World in Data based on The Shift Dataportal (2022) + published_by: The Shift Dataportal + date_accessed: 2022-07-18 + url: https://www.theshiftdataportal.org/energy tables: fossil_fuel_production: variables: annual_change_in_coal_production__pct: - title: "Annual change in coal production (%)" - short_unit: "%" - unit: "%" + title: Annual change in coal production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_coal_production__twh: - title: "Annual change in coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_gas_production__pct: - title: "Annual change in gas production (%)" - short_unit: "%" - unit: "%" + title: Annual change in gas production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_gas_production__twh: - title: "Annual change in gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_oil_production__pct: - title: "Annual change in oil production (%)" - short_unit: "%" - unit: "%" + title: Annual change in oil production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in oil production" + name: Annual change in oil production annual_change_in_oil_production__twh: - title: "Annual change in oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in oil production" + name: Annual change in oil production coal_production__twh: - title: "Coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Coal production" + name: Coal production numDecimalPlaces: 0 coal_production_per_capita__kwh: - title: "Coal production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Coal production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Coal production per capita" + name: Coal production per capita numDecimalPlaces: 0 gas_production__twh: - title: "Gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Gas production" + name: Gas production numDecimalPlaces: 0 gas_production_per_capita__kwh: - title: "Gas production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Gas production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Gas production per capita" + name: Gas production per capita numDecimalPlaces: 0 oil_production__twh: - title: "Oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Oil production" + name: Oil production numDecimalPlaces: 0 oil_production_per_capita__kwh: - title: "Oil production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Oil production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Oil production per capita" + name: Oil production per capita numDecimalPlaces: 0 diff --git a/etl/steps/archive/garden/energy/2022-12-28/owid_energy.meta.yml b/etl/steps/archive/garden/energy/2022-12-28/owid_energy.meta.yml index 7e57fdc9f3d..aae6ccecf70 100644 --- a/etl/steps/archive/garden/energy/2022-12-28/owid_energy.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-28/owid_energy.meta.yml @@ -6,7 +6,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/archive/garden/energy/2022-12-28/primary_energy_consumption.meta.yml b/etl/steps/archive/garden/energy/2022-12-28/primary_energy_consumption.meta.yml index a192a847059..ccc4663fda6 100644 --- a/etl/steps/archive/garden/energy/2022-12-28/primary_energy_consumption.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-28/primary_energy_consumption.meta.yml @@ -3,75 +3,107 @@ dataset: version: 2022-12-28 title: Primary energy consumption (BP & EIA, 2022) short_name: primary_energy_consumption - description: | + description: >- Primary energy consumption data was compiled by Our World in Data based on two key data sources: - 1. BP Statistical Review of World Energy. - 2. International energy data from the U.S. Energy Information Administration (EIA). - BP provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset with energy data from the EIA. Where BP provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. + 1. [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + 2. [International energy data from the U.S. Energy Information Administration (EIA)](https://www.eia.gov/international/data/world/total-energy/more-total-energy-data). - To calculate energy per unit of GDP, we use total real GDP figures from the Maddison Project Database, version 2020. + + BP provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset with energy data + from the EIA. Where BP provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. + + + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). + + + To calculate energy per unit of GDP, we use total real GDP figures from [the Maddison Project Database, version 2020](https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020). This dataset is based on Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update ”. GDP is measured in 2011$ which are PPP-adjusted. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa". - * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". - * "Europe" - All European countries + "Other Europe". - * "North America" - All North American countries + "Other Caribbean" + "Other North America". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. - - - name: Our World in Data based on EIA International energy data (2022) - published_by: U.S. Energy Information Administration (EIA) - date_accessed: 2022-07-27 - url: https://www.eia.gov/opendata/bulkfiles.php - description: | - Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their Bulk Download Facility. - - EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with our region definitions). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - - name: Maddison Project Database 2020 (Bolt and van Zanden, 2020) - published_by: Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update“. - date_accessed: 2022-04-12 - url: https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020 + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: >- + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + + + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: + + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, + Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. + + * "Australasia (BP)": Australia, New Zealand. + + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + + * "North America (BP)": US (excluding US territories), Canada, Mexico + + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, + Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. + + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + + + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: + + * "Africa" - All African countries + "Other Africa". + + * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". + + * "Europe" - All European countries + "Other Europe". + + * "North America" - All North American countries + "Other Caribbean" + "Other North America". + + * "Oceania" - All Oceanian countries. + + * "South America" - All South American countries + "Other South America". + + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to + other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions + [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). + - name: Our World in Data based on EIA International energy data (2022) + published_by: U.S. Energy Information Administration (EIA) + date_accessed: 2022-07-27 + url: https://www.eia.gov/opendata/bulkfiles.php + description: | + Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their [Bulk Download Facility](https://www.eia.gov/opendata/bulkfiles.php). + EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + - name: Maddison Project Database 2020 (Bolt and van Zanden, 2020) + published_by: "Bolt, Jutta and Jan Luiten van Zanden (2020), 'Maddison style estimates of the evolution of the world economy. A new 2020 update'." + date_accessed: 2022-04-12 + url: https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020 tables: primary_energy_consumption: variables: annual_change_in_primary_energy_consumption__pct: title: Annual change in primary energy consumption (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Annual change in primary energy consumption annual_change_in_primary_energy_consumption__twh: @@ -84,7 +116,9 @@ tables: title: GDP short_unit: $ unit: 2011 int-$ - description: Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over + time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. display: numDecimalPlaces: 0 population: diff --git a/etl/steps/archive/garden/energy/2022-12-28/uk_historical_electricity.meta.yml b/etl/steps/archive/garden/energy/2022-12-28/uk_historical_electricity.meta.yml index 81510523a6e..fc14f13a220 100644 --- a/etl/steps/archive/garden/energy/2022-12-28/uk_historical_electricity.meta.yml +++ b/etl/steps/archive/garden/energy/2022-12-28/uk_historical_electricity.meta.yml @@ -4,33 +4,28 @@ dataset: title: UK historical electricity (DUKES, 2022c) short_name: uk_historical_electricity description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). - All other data is sourced from the BP's Statistical Review of World Energy and Ember's Yearly Electricity Data. Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. + All other data is sourced from the [BP's Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [Ember's Yearly Electricity Data](https://ember-climate.org/data-catalogue/yearly-electricity-data/). Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. sources: - - - name: Digest of UK Energy Statistics - published_by: UK's Department for Business, Energy & Industrial Strategy - date_accessed: 2022-09-21 - url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data - - - name: BP Statistical Review of World Energy - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Ember's Yearly Electricity Data - published_by: Ember - publication_year: 2022 - date_accessed: 2022-12-13 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Ember's European Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Digest of UK Energy Statistics + published_by: UK's Department for Business, Energy & Industrial Strategy + date_accessed: 2022-09-21 + url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data + - name: BP Statistical Review of World Energy + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Ember's Yearly Electricity Data + published_by: Ember + publication_year: 2022 + date_accessed: 2022-12-13 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Ember's European Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: uk_historical_electricity: variables: diff --git a/etl/steps/archive/garden/energy/2023-01-04/photovoltaic_cost_and_capacity.meta.yml b/etl/steps/archive/garden/energy/2023-01-04/photovoltaic_cost_and_capacity.meta.yml index 7da43f4504d..2b1a86bc023 100644 --- a/etl/steps/archive/garden/energy/2023-01-04/photovoltaic_cost_and_capacity.meta.yml +++ b/etl/steps/archive/garden/energy/2023-01-04/photovoltaic_cost_and_capacity.meta.yml @@ -1,48 +1,47 @@ all_sources: - - nemet_2009: &source-nemet_2009 - name: G. G. Nemet (2009) - published_by: | - Interim monitoring of cost dynamics for publicly supported energy technologies. Energy Policy 37(3): 825-835. by Nemet, G. F. (2009). - url: https://www.sciencedirect.com/science/article/abs/pii/S0301421508005910 - date_accessed: '2023-01-04' - publication_date: '2009-03-01' - publication_year: 2009 - description: | - Photovoltaic cost and capacity data between 1975 and 2003 has been taken from Nemet (2009). +- nemet_2009: &source-nemet_2009 + name: G. G. Nemet (2009) + published_by: | + Interim monitoring of cost dynamics for publicly supported energy technologies. Energy Policy 37(3): 825-835. by Nemet, G. F. (2009). + url: https://www.sciencedirect.com/science/article/abs/pii/S0301421508005910 + date_accessed: '2023-01-04' + publication_date: '2009-03-01' + publication_year: 2009 + description: | + Photovoltaic cost and capacity data between 1975 and 2003 has been taken from Nemet (2009). - Prices from Nemet (2009) have been converted to 2021 US$ using the US GDP deflator: https://www.multpl.com/gdp-deflator/table/by-year - - farmer_lafond_2016: &source-farmer_lafond_2016 - name: J. D. Farmer & F. Lafond (2016) - published_by: | - How predictable is technological progress? J. D. Farmer & F. Lafond, Research Policy Volume 45, Issue 3, April 2016, Pages 647-665. - url: https://www.sciencedirect.com/science/article/pii/S0048733315001699 - date_accessed: '2023-01-04' - publication_date: '2016-04-01' - publication_year: 2016 - description: | - Photovoltaic cost data between 2004 and 2009 has been taken from Farmer & Lafond (2016). + Prices from Nemet (2009) have been converted to 2021 US$ using the US GDP deflator: https://www.multpl.com/gdp-deflator/table/by-year +- farmer_lafond_2016: &source-farmer_lafond_2016 + name: J. D. Farmer & F. Lafond (2016) + published_by: | + How predictable is technological progress? J. D. Farmer & F. Lafond, Research Policy Volume 45, Issue 3, April 2016, Pages 647-665. + url: https://www.sciencedirect.com/science/article/pii/S0048733315001699 + date_accessed: '2023-01-04' + publication_date: '2016-04-01' + publication_year: 2016 + description: | + Photovoltaic cost data between 2004 and 2009 has been taken from Farmer & Lafond (2016). - According to Farmer & Lafond (2016), the data are mostly taken from the Santa-Fe Performance Curve Database. The database has been constructed from personal communications and from Colpier and Cornland (2002), Goldemberg et al. (2004), Lieberman (1984), Lipman and Sperling (1999), Zhao (1999), McDonald and Schrattenholzer (2001), Neij et al. (2003), Moore (2006), Nemet (2006), Schilling and Esmundo (2009). The data on photovoltaic prices has been collected from public releases of Strategies Unlimited, Navigant and SPV Market Research. The data on nuclear energy is from Koomey and Hultman (2007) and Cooper (2009). The DNA sequencing data is from Wetterstrand (2015) (cost per human-size genome), and for each year the last available month (September for 2001-2002 and October afterwards) was taken and corrected for inflation using the US GDP deflator. - - Prices from Farmer & Lafond (2016) have been converted to 2021 US$ using the US GDP deflator: https://www.multpl.com/gdp-deflator/table/by-year - - irena_capacity: &source-irena_capacity - name: International Renewable Energy Agency (IRENA) - published_by: © 2022 by International Renewable Energy Agency (IRENA) - url: https://www.irena.org/Statistics/Download-query-tools - date_accessed: '2022-10-20' - publication_date: '2022-07-01' - publication_year: 2022 - description: | - Photovoltaic capacity data between 2004 and 2021 has been taken from IRENA. - - irena_costs: &source-irena_costs - name: International Renewable Energy Agency (IRENA) - published_by: International Renewable Energy Agency (IRENA) © 2022 by IRENA - url: https://irena.org/publications/2022/Jul/Renewable-Power-Generation-Costs-in-2021 - date_accessed: '2022-10-20' - publication_year: 2022 - description: | - Photovoltaic cost data between 2010 and 2021 has been taken from IRENA. + According to Farmer & Lafond (2016), the data are mostly taken from the Santa-Fe [Performance Curve Database](https://pcdb.santafe.edu/). The database has been constructed from personal communications and from [Colpier and Cornland (2002)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0095), [Goldemberg et al. (2004)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0130), [Lieberman (1984)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0180), [Lipman and Sperling (1999)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0190), [Zhao (1999)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0310), [McDonald and Schrattenholzer (2001)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0205), [Neij et al. (2003)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0235), [Moore (2006)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0215), [Nemet (2006)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0240), [Schilling and Esmundo (2009)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0265). The data on photovoltaic prices has been collected from public releases of Strategies Unlimited, Navigant and SPV Market Research. The data on nuclear energy is from [Koomey and Hultman (2007)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0165) and [Cooper (2009)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0100). The DNA sequencing data is from [Wetterstrand (2015)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0290) (cost per human-size genome), and for each year the last available month (September for 2001-2002 and October afterwards) was taken and corrected for inflation using the US GDP deflator. + Prices from Farmer & Lafond (2016) have been converted to 2021 US$ using the US GDP deflator: https://www.multpl.com/gdp-deflator/table/by-year +- irena_capacity: &source-irena_capacity + name: International Renewable Energy Agency (IRENA) + published_by: "© 2022 by International Renewable Energy Agency (IRENA)" + url: https://www.irena.org/Statistics/Download-query-tools + date_accessed: '2022-10-20' + publication_date: '2022-07-01' + publication_year: 2022 + description: | + Photovoltaic capacity data between 2004 and 2021 has been taken from IRENA. +- irena_costs: &source-irena_costs + name: International Renewable Energy Agency (IRENA) + published_by: "International Renewable Energy Agency (IRENA) \xA9 2022 by IRENA" + url: https://irena.org/publications/2022/Jul/Renewable-Power-Generation-Costs-in-2021 + date_accessed: '2022-10-20' + publication_year: 2022 + description: | + Photovoltaic cost data between 2010 and 2021 has been taken from IRENA. dataset: namespace: energy short_name: photovoltaic_cost_and_capacity @@ -52,26 +51,26 @@ dataset: converted to 2021 US$ using the US GDP deflator: https://www.multpl.com/gdp-deflator/table/by-year version: '2023-01-04' sources: - - *source-nemet_2009 - - *source-farmer_lafond_2016 - - *source-irena_capacity - - *source-irena_costs + - *source-nemet_2009 + - *source-farmer_lafond_2016 + - *source-irena_capacity + - *source-irena_costs tables: photovoltaic_cost_and_capacity: variables: cost: title: Solar photovoltaic module price - short_unit: '$/W' - unit: '2021 US$ per Watt' + short_unit: $/W + unit: 2021 US$ per Watt description: | Global average price of solar photovoltaic modules. IRENA presents solar PV module price series for a number of different module technologies. Here we have adopted the series for thin film a-Si/u-Si or Global Index (from Q4 2013). sources: - - *source-nemet_2009 - - *source-farmer_lafond_2016 - - *source-irena_costs + - *source-nemet_2009 + - *source-farmer_lafond_2016 + - *source-irena_costs cost_source: title: Data source for cost data unit: '' @@ -80,11 +79,11 @@ tables: title: Solar photovoltaic cumulative capacity description: | Global cumulative capacity of solar photovoltaics. - short_unit: 'MW' - unit: 'megawatts' + short_unit: MW + unit: megawatts sources: - - *source-nemet_2009 - - *source-irena_capacity + - *source-nemet_2009 + - *source-irena_capacity cumulative_capacity_source: title: Data source for cumulative capacity data unit: '' diff --git a/etl/steps/archive/garden/energy/2023-02-20/electricity_mix.meta.yml b/etl/steps/archive/garden/energy/2023-02-20/electricity_mix.meta.yml index 30d2ec07878..6f87b79675d 100644 --- a/etl/steps/archive/garden/energy/2023-02-20/electricity_mix.meta.yml +++ b/etl/steps/archive/garden/energy/2023-02-20/electricity_mix.meta.yml @@ -5,9 +5,9 @@ dataset: short_name: electricity_mix description: | Data is compiled by Our World in Data based on three main sources: - - BP Statistical Review of World Energy. - - Ember Yearly Electricity Data (2023). - - Ember European Electricity Review (2022). + - [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + - [Ember Yearly Electricity Data (2023)](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + - [Ember European Electricity Review (2022)](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: - Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -18,16 +18,16 @@ dataset: - IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. - WRI: Annual global capacity data for Other Fossil where other sources are not available. - European carbon intensities rely on data from the European Environment Agency (EEA). - - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found here. - - A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found [here](https://ember-climate.org/app/uploads/2022/07/Ember-Electricity-Data-Methodology.pdf). + - A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on Ember as the primary source of electricity consumption data. While BP provides primary energy (not just electricity) consumption data and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990), BP does not provide data for all countries or for all sources of electricity (for example, only Ember provides data on electricity from bioenergy). So, where data from Ember is available for a given country and year, we rely on it as the primary source. We then supplement this with data from BP where data from Ember is not available. Our World in Data has converted absolute electricity production by source to the share in the mix by dividing each by total electricity production. - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -53,36 +53,32 @@ dataset: * "North America" - All North American countries + "Other Caribbean" + "Other North America". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - publication_year: 2022 - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Our World in Data based on Ember's Yearly Electricity Data (2023) - published_by: Ember - publication_year: 2023 - publication_date: 2023-01-31 - date_accessed: 2023-02-20 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Our World in Data based on Ember's European Electricity Review (2022) - published_by: Ember - publication_year: 2022 - publication_date: 2022-02-01 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + publication_year: 2022 + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Our World in Data based on Ember's Yearly Electricity Data (2023) + published_by: Ember + publication_year: 2023 + publication_date: 2023-01-31 + date_accessed: 2023-02-20 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Our World in Data based on Ember's European Electricity Review (2022) + published_by: Ember + publication_year: 2022 + publication_date: 2022-02-01 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: electricity_mix: variables: @@ -94,8 +90,8 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: @@ -112,8 +108,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -124,8 +120,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -136,8 +132,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -148,8 +144,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -160,14 +156,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -178,8 +174,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -190,8 +186,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -202,8 +198,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -214,8 +210,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -343,8 +339,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -362,14 +358,14 @@ tables: name: Solar and wind solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar solar_and_wind_share_of_electricity__pct: title: Solar and wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar and wind total_demand__twh: @@ -380,8 +376,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -410,7 +406,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/archive/garden/energy/2023-02-20/fossil_fuel_production.meta.yml b/etl/steps/archive/garden/energy/2023-02-20/fossil_fuel_production.meta.yml index a14ff8f9944..019333dba95 100644 --- a/etl/steps/archive/garden/energy/2023-02-20/fossil_fuel_production.meta.yml +++ b/etl/steps/archive/garden/energy/2023-02-20/fossil_fuel_production.meta.yml @@ -4,7 +4,7 @@ dataset: title: Fossil fuel production (BP & Shift, 2023) short_name: fossil_fuel_production description: | - This dataset on fossil fuel production is generated by combining the latest data from the BP Statistical Review of World Energy and The Shift Dataportal. + This dataset on fossil fuel production is generated by combining the latest data from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [The Shift Dataportal](https://www.theshiftdataportal.org/energy). BP provide fossil fuel production data from 1965 onwards (and crude prices from 1861 onwards). The Shift Dataportal provides long-term data from 1900, but only extends to 2016. @@ -12,127 +12,124 @@ dataset: We have converted primary production in exajoules to terawatt-hours using the conversion factor: 1,000,000 / 3,600 ~ 278. - Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: | + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa". - * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". - * "Europe" - All European countries + "Other Europe". - * "North America" - All North American countries + "Other Caribbean" + "Other North America". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. - - - name: Our World in Data based on The Shift Dataportal (2022) - published_by: The Shift Dataportal - date_accessed: 2022-07-18 - url: https://www.theshiftdataportal.org/energy + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. + * "Australasia (BP)": Australia, New Zealand. + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + * "North America (BP)": US (excluding US territories), Canada, Mexico + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: + * "Africa" - All African countries + "Other Africa". + * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". + * "Europe" - All European countries + "Other Europe". + * "North America" - All North American countries + "Other Caribbean" + "Other North America". + * "Oceania" - All Oceanian countries. + * "South America" - All South American countries + "Other South America". + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). + - name: Our World in Data based on The Shift Dataportal (2022) + published_by: The Shift Dataportal + date_accessed: 2022-07-18 + url: https://www.theshiftdataportal.org/energy tables: fossil_fuel_production: variables: annual_change_in_coal_production__pct: - title: "Annual change in coal production (%)" - short_unit: "%" - unit: "%" + title: Annual change in coal production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_coal_production__twh: - title: "Annual change in coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_gas_production__pct: - title: "Annual change in gas production (%)" - short_unit: "%" - unit: "%" + title: Annual change in gas production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_gas_production__twh: - title: "Annual change in gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_oil_production__pct: - title: "Annual change in oil production (%)" - short_unit: "%" - unit: "%" + title: Annual change in oil production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in oil production" + name: Annual change in oil production annual_change_in_oil_production__twh: - title: "Annual change in oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in oil production" + name: Annual change in oil production coal_production__twh: - title: "Coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Coal production" + name: Coal production numDecimalPlaces: 0 coal_production_per_capita__kwh: - title: "Coal production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Coal production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Coal production per capita" + name: Coal production per capita numDecimalPlaces: 0 gas_production__twh: - title: "Gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Gas production" + name: Gas production numDecimalPlaces: 0 gas_production_per_capita__kwh: - title: "Gas production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Gas production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Gas production per capita" + name: Gas production per capita numDecimalPlaces: 0 oil_production__twh: - title: "Oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Oil production" + name: Oil production numDecimalPlaces: 0 oil_production_per_capita__kwh: - title: "Oil production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Oil production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Oil production per capita" + name: Oil production per capita numDecimalPlaces: 0 diff --git a/etl/steps/archive/garden/energy/2023-02-20/owid_energy.meta.yml b/etl/steps/archive/garden/energy/2023-02-20/owid_energy.meta.yml index 76b3c2e6264..a684fa8a9c2 100644 --- a/etl/steps/archive/garden/energy/2023-02-20/owid_energy.meta.yml +++ b/etl/steps/archive/garden/energy/2023-02-20/owid_energy.meta.yml @@ -6,7 +6,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/archive/garden/energy/2023-02-20/primary_energy_consumption.meta.yml b/etl/steps/archive/garden/energy/2023-02-20/primary_energy_consumption.meta.yml index 2f128994faa..b32d357b973 100644 --- a/etl/steps/archive/garden/energy/2023-02-20/primary_energy_consumption.meta.yml +++ b/etl/steps/archive/garden/energy/2023-02-20/primary_energy_consumption.meta.yml @@ -5,73 +5,69 @@ dataset: short_name: primary_energy_consumption description: | Primary energy consumption data was compiled by Our World in Data based on two key data sources: - 1. BP Statistical Review of World Energy. - 2. International energy data from the U.S. Energy Information Administration (EIA). + 1. [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + 2. [International energy data from the U.S. Energy Information Administration (EIA)](https://www.eia.gov/international/data/world/total-energy/more-total-energy-data). BP provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset with energy data from the EIA. Where BP provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). - To calculate energy per unit of GDP, we use total real GDP figures from the Maddison Project Database, version 2020. + To calculate energy per unit of GDP, we use total real GDP figures from [the Maddison Project Database, version 2020](https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020). This dataset is based on Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update ”. GDP is measured in 2011$ which are PPP-adjusted. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - description: | - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + description: | + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: - * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. - * "Australasia (BP)": Australia, New Zealand. - * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. - * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. - * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama - * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. - * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. - * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. - * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. - * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. - * "North America (BP)": US (excluding US territories), Canada, Mexico - * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. - * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. - * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. - * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. - * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. - * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: + * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. + * "Australasia (BP)": Australia, New Zealand. + * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. + * "Caribbean (BP)": Atlantic islands between the US Gulf Coast and South America, including Puerto Rico, US Virgin Islands and Bermuda. + * "Central America (BP)": Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua, Panama + * "Eastern Africa (BP)": Territories on the east coast of Africa from Sudan to Mozambique. Also Madagascar, Malawi, Uganda, Zambia, Zimbabwe. + * "Europe (BP)": European members of the OECD plus Albania, Bosnia-Herzegovina, Bulgaria, Croatia, Cyprus, Georgia, Gibraltar, Latvia, Lithuania, Malta, Montenegro, North Macedonia, Romania, Serbia and Ukraine. + * "Middle Africa (BP)": Angola, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Republic of Congo, Equatorial Guinea, Gabon, Sao Tome & Principe. + * "Middle East (BP)": Arabian Peninsula, Iran, Iraq, Israel, Jordan, Lebanon, Syria. + * "Non-OECD (BP)" - Organization for Economic Co-operation and Development: All countries that are not members of the OECD. + * "North America (BP)": US (excluding US territories), Canada, Mexico + * "Northern Africa (BP)": Territories on the north coast of Africa from Egypt to Western Sahara. + * "OECD (BP)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, UK, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, US. + * "OPEC (BP)" - Organization of the Petroleum Exporting Countries: Iran, Iraq, Kuwait, Saudi Arabia, United Arab Emirates, Algeria, Libya, Angola, Equatorial Guinea, Gabon, Nigeria, Republic of Congo, Venezuela. + * "South and Central America (BP)": Caribbean (including Puerto Rico and US Virgin Islands), Bermuda, Central and South America. + * "Southern Africa (BP)": Botswana, Lesotho, Namibia, South Africa, Swaziland. + * "Western Africa (BP)": Territories on the west coast of Africa from Mauritania to Nigeria, including Burkina Faso, Cape Verde, Mali and Niger. - Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: - * "Africa" - All African countries + "Other Africa". - * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". - * "Europe" - All European countries + "Other Europe". - * "North America" - All North American countries + "Other Caribbean" + "Other North America". - * "Oceania" - All Oceanian countries. - * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. - - - name: Our World in Data based on EIA International energy data (2022) - published_by: U.S. Energy Information Administration (EIA) - date_accessed: 2022-07-27 - url: https://www.eia.gov/opendata/bulkfiles.php - description: | - Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their Bulk Download Facility. - - EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with our region definitions). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - - - name: Maddison Project Database 2020 (Bolt and van Zanden, 2020) - published_by: Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update“. - date_accessed: 2022-04-12 - url: https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020 + Additionally, BP includes some regions that are not explicitly defined (e.g. "Other Europe", or "Other CIS"). We define our regions in the following way: + * "Africa" - All African countries + "Other Africa". + * "Asia" - All Asian countries + "Other Middle East" + "Other CIS" + "Other Asia Pacific". + * "Europe" - All European countries + "Other Europe". + * "North America" - All North American countries + "Other Caribbean" + "Other North America". + * "Oceania" - All Oceanian countries. + * "South America" - All South American countries + "Other South America". + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). + - name: Our World in Data based on EIA International energy data (2022) + published_by: U.S. Energy Information Administration (EIA) + date_accessed: 2022-07-27 + url: https://www.eia.gov/opendata/bulkfiles.php + description: | + Total energy consumption, extracted from EIA's international energy data from the EIA, downloaded using their [Bulk Download Facility](https://www.eia.gov/opendata/bulkfiles.php). + EIA's region definitions sometimes differ from Our World in Data's definitions. For example, in EIA's data, Russia is not included in Europe, whereas Our World in Data includes Russia in Europe (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "Europe (EIA)" to refer to EIA's original data using their definition of the region, as well as "Europe", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + - name: Maddison Project Database 2020 (Bolt and van Zanden, 2020) + published_by: Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update“. + date_accessed: 2022-04-12 + url: https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020 tables: primary_energy_consumption: variables: annual_change_in_primary_energy_consumption__pct: title: Annual change in primary energy consumption (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Annual change in primary energy consumption annual_change_in_primary_energy_consumption__twh: @@ -84,7 +80,9 @@ tables: title: GDP short_unit: $ unit: 2011 int-$ - description: Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over + time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. display: numDecimalPlaces: 0 population: diff --git a/etl/steps/archive/garden/energy/2023-02-20/uk_historical_electricity.meta.yml b/etl/steps/archive/garden/energy/2023-02-20/uk_historical_electricity.meta.yml index d402b4068be..ce5838830bc 100644 --- a/etl/steps/archive/garden/energy/2023-02-20/uk_historical_electricity.meta.yml +++ b/etl/steps/archive/garden/energy/2023-02-20/uk_historical_electricity.meta.yml @@ -4,33 +4,28 @@ dataset: title: UK historical electricity (DUKES, 2023) short_name: uk_historical_electricity description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). - All other data is sourced from the BP's Statistical Review of World Energy and Ember's Yearly Electricity Data. Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. + All other data is sourced from the [BP's Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [Ember's Yearly Electricity Data](https://ember-climate.org/data-catalogue/yearly-electricity-data/). Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. sources: - - - name: Digest of UK Energy Statistics - published_by: UK's Department for Business, Energy & Industrial Strategy - date_accessed: 2022-09-21 - url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data - - - name: BP Statistical Review of World Energy - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Ember's Yearly Electricity Data - published_by: Ember - publication_year: 2023 - date_accessed: 2023-02-20 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Ember's European Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Digest of UK Energy Statistics + published_by: UK's Department for Business, Energy & Industrial Strategy + date_accessed: 2022-09-21 + url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data + - name: BP Statistical Review of World Energy + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Ember's Yearly Electricity Data + published_by: Ember + publication_year: 2023 + date_accessed: 2023-02-20 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Ember's European Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: uk_historical_electricity: variables: diff --git a/etl/steps/archive/garden/energy/2023-06-01/electricity_mix.meta.yml b/etl/steps/archive/garden/energy/2023-06-01/electricity_mix.meta.yml index 59d35762173..927e7973624 100644 --- a/etl/steps/archive/garden/energy/2023-06-01/electricity_mix.meta.yml +++ b/etl/steps/archive/garden/energy/2023-06-01/electricity_mix.meta.yml @@ -2,9 +2,9 @@ dataset: title: Electricity mix (BP & Ember, 2023b) description: | Data is compiled by Our World in Data based on three main sources: - - BP Statistical Review of World Energy. - - Ember Yearly Electricity Data (2023). - - Ember European Electricity Review (2022). + - [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + - [Ember Yearly Electricity Data (2023)](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + - [Ember European Electricity Review (2022)](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: - Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -15,16 +15,16 @@ dataset: - IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. - WRI: Annual global capacity data for Other Fossil where other sources are not available. - European carbon intensities rely on data from the European Environment Agency (EEA). - - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found here. - - A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found [here](https://ember-climate.org/app/uploads/2022/07/Ember-Electricity-Data-Methodology.pdf). + - A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on Ember as the primary source of electricity consumption data. While BP provides primary energy (not just electricity) consumption data and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990), BP does not provide data for all countries or for all sources of electricity (for example, only Ember provides data on electricity from bioenergy). So, where data from Ember is available for a given country and year, we rely on it as the primary source. We then supplement this with data from BP where data from Ember is not available. Our World in Data has converted absolute electricity production by source to the share in the mix by dividing each by total electricity production. - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -50,15 +50,14 @@ dataset: * "North America" - All North American countries + "Other Caribbean" + "Other North America". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa" is included in "Other Africa"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. - tables: electricity_mix: variables: @@ -70,14 +69,14 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: title: Carbon intensity of electricity (gCO2/kWh) - short_unit: gCO₂ - unit: grams of CO₂ equivalent per kilowatt-hour + short_unit: "gCO₂" + unit: "grams of CO₂ equivalent per kilowatt-hour" display: name: Carbon intensity of electricity per kilowatt-hour coal_generation__twh: @@ -88,8 +87,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -100,8 +99,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -112,8 +111,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -124,8 +123,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -136,14 +135,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -154,8 +153,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -166,8 +165,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -178,8 +177,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -190,8 +189,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -319,8 +318,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -338,14 +337,14 @@ tables: name: Solar and wind solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar solar_and_wind_share_of_electricity__pct: title: Solar and wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar and wind total_demand__twh: @@ -356,8 +355,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -386,7 +385,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/archive/garden/energy/2023-06-01/fossil_fuel_production.meta.yml b/etl/steps/archive/garden/energy/2023-06-01/fossil_fuel_production.meta.yml index 8deca18c3fd..1da62f05000 100644 --- a/etl/steps/archive/garden/energy/2023-06-01/fossil_fuel_production.meta.yml +++ b/etl/steps/archive/garden/energy/2023-06-01/fossil_fuel_production.meta.yml @@ -1,7 +1,7 @@ dataset: title: Fossil fuel production (BP & Shift, 2023b) description: | - This dataset on fossil fuel production is generated by combining the latest data from the BP Statistical Review of World Energy and The Shift Dataportal. + This dataset on fossil fuel production is generated by combining the latest data from [the BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [The Shift Dataportal](https://www.theshiftdataportal.org/energy). BP provide fossil fuel production data from 1965 onwards (and crude prices from 1861 onwards). The Shift Dataportal provides long-term data from 1900, but only extends to 2016. @@ -9,86 +9,85 @@ dataset: We have converted primary production in exajoules to terawatt-hours using the conversion factor: 1,000,000 / 3,600 ~ 278. - Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. - + Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). tables: fossil_fuel_production: variables: annual_change_in_coal_production__pct: - title: "Annual change in coal production (%)" - short_unit: "%" - unit: "%" + title: Annual change in coal production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_coal_production__twh: - title: "Annual change in coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_gas_production__pct: - title: "Annual change in gas production (%)" - short_unit: "%" - unit: "%" + title: Annual change in gas production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_gas_production__twh: - title: "Annual change in gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_oil_production__pct: - title: "Annual change in oil production (%)" - short_unit: "%" - unit: "%" + title: Annual change in oil production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in oil production" + name: Annual change in oil production annual_change_in_oil_production__twh: - title: "Annual change in oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in oil production" + name: Annual change in oil production coal_production__twh: - title: "Coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Coal production" + name: Coal production numDecimalPlaces: 0 coal_production_per_capita__kwh: - title: "Coal production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Coal production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Coal production per capita" + name: Coal production per capita numDecimalPlaces: 0 gas_production__twh: - title: "Gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Gas production" + name: Gas production numDecimalPlaces: 0 gas_production_per_capita__kwh: - title: "Gas production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Gas production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Gas production per capita" + name: Gas production per capita numDecimalPlaces: 0 oil_production__twh: - title: "Oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Oil production" + name: Oil production numDecimalPlaces: 0 oil_production_per_capita__kwh: - title: "Oil production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Oil production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Oil production per capita" + name: Oil production per capita numDecimalPlaces: 0 diff --git a/etl/steps/archive/garden/energy/2023-06-01/owid_energy.meta.yml b/etl/steps/archive/garden/energy/2023-06-01/owid_energy.meta.yml index f57599a2b1f..46dba0e979d 100644 --- a/etl/steps/archive/garden/energy/2023-06-01/owid_energy.meta.yml +++ b/etl/steps/archive/garden/energy/2023-06-01/owid_energy.meta.yml @@ -3,7 +3,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/archive/garden/energy/2023-06-01/primary_energy_consumption.meta.yml b/etl/steps/archive/garden/energy/2023-06-01/primary_energy_consumption.meta.yml index b639cbdabb2..94f7d7ad975 100644 --- a/etl/steps/archive/garden/energy/2023-06-01/primary_energy_consumption.meta.yml +++ b/etl/steps/archive/garden/energy/2023-06-01/primary_energy_consumption.meta.yml @@ -2,23 +2,22 @@ dataset: title: Primary energy consumption (BP & EIA, 2023b) description: | Primary energy consumption data was compiled by Our World in Data based on two key data sources: - 1. BP Statistical Review of World Energy. - 2. International energy data from the U.S. Energy Information Administration (EIA). + 1. [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + 2. [International energy data from the U.S. Energy Information Administration (EIA)](https://www.eia.gov/international/data/world/total-energy/more-total-energy-data). BP provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset with energy data from the EIA. Where BP provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). - To calculate energy per unit of GDP, we use total real GDP figures from the Maddison Project Database, version 2020. + To calculate energy per unit of GDP, we use total real GDP figures from [the Maddison Project Database, version 2020](https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020). This dataset is based on Bolt, Jutta and Jan Luiten van Zanden (2020), “Maddison style estimates of the evolution of the world economy. A new 2020 update ”. GDP is measured in 2011$ which are PPP-adjusted. - tables: primary_energy_consumption: variables: annual_change_in_primary_energy_consumption__pct: title: Annual change in primary energy consumption (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Annual change in primary energy consumption annual_change_in_primary_energy_consumption__twh: @@ -31,7 +30,9 @@ tables: title: GDP short_unit: $ unit: 2011 int-$ - description: Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over + time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. display: numDecimalPlaces: 0 population: diff --git a/etl/steps/archive/garden/energy/2023-06-01/uk_historical_electricity.meta.yml b/etl/steps/archive/garden/energy/2023-06-01/uk_historical_electricity.meta.yml index eb54240e8cd..69b8f77b574 100644 --- a/etl/steps/archive/garden/energy/2023-06-01/uk_historical_electricity.meta.yml +++ b/etl/steps/archive/garden/energy/2023-06-01/uk_historical_electricity.meta.yml @@ -1,10 +1,9 @@ dataset: title: UK historical electricity (DUKES, 2023b) description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. - - All other data is sourced from the BP's Statistical Review of World Energy and Ember's Yearly Electricity Data. Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). + All other data is sourced from the [BP's Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [Ember's Yearly Electricity Data](https://ember-climate.org/data-catalogue/yearly-electricity-data/). Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. tables: uk_historical_electricity: variables: diff --git a/etl/steps/archive/garden/gcp/2022-09-29/global_carbon_budget_additional.meta.yml b/etl/steps/archive/garden/gcp/2022-09-29/global_carbon_budget_additional.meta.yml index 42842c8f29d..d2f2462dfac 100644 --- a/etl/steps/archive/garden/gcp/2022-09-29/global_carbon_budget_additional.meta.yml +++ b/etl/steps/archive/garden/gcp/2022-09-29/global_carbon_budget_additional.meta.yml @@ -1,25 +1,23 @@ dataset: title: Global Carbon Budget (Global Carbon Project, v2021b) sources: - - - name: Global Carbon Project (2021) - published_by: Global Carbon Budget - Global Carbon Project (2021) - description: | - The Global Carbon Budget dataset is available here and here. + - name: Global Carbon Project (2021) + published_by: Global Carbon Budget - Global Carbon Project (2021) + description: | + The Global Carbon Budget dataset is available [here](https://www.icos-cp.eu/science-and-impact/global-carbon-budget/2021) and [here](https://doi.org/10.5281/zenodo.5569235). - Variables include each country, region and World Bank income group's share of the global population; production-based (territorial); and consumption-based (trade-adjusted) carbon dioxide emissions. + Variables include each country, region and World Bank income group's share of the global population; production-based (territorial); and consumption-based (trade-adjusted) carbon dioxide emissions. - This was calculated by Our World in Data based on CO₂ figures produced by the Global Carbon Project. This is given as production (territorial) emissions in addition to trade-adjusted consumption-based emissions. Consumption-based emissions are national or regional emissions which have been adjusted for trade (i.e. territorial/production emissions minus emissions embedded in exports, plus emissions embedded in imports). If a country's consumption-based emissions are higher than its production emissions it is a net importer of carbon dioxide. + This was calculated by Our World in Data based on CO₂ figures produced by the Global Carbon Project. This is given as production (territorial) emissions in addition to trade-adjusted consumption-based emissions. Consumption-based emissions are national or regional emissions which have been adjusted for trade (i.e. territorial/production emissions minus emissions embedded in exports, plus emissions embedded in imports). If a country's consumption-based emissions are higher than its production emissions it is a net importer of carbon dioxide. - Note that consumption-based emissions are not available for all countries; although those without complete data are a small fraction (3%) of the global total. Each country's share of world emissions are based on the share of the global total minus categories termed 'bunkers' and 'statistical differences' (which include cross-boundary emissions such as international travel and shipping. + Note that consumption-based emissions are not available for all countries; although those without complete data are a small fraction (3%) of the global total. Each country's share of world emissions are based on the share of the global total minus categories termed 'bunkers' and 'statistical differences' (which include cross-boundary emissions such as international travel and shipping. - Calculation of each country's share of the global population is calculated using our population dataset, based on different sources). + Calculation of each country's share of the global population is calculated using our population dataset, based on [different sources](https://ourworldindata.org/population-sources)). - Data on global emissions has been converted by Our World in Data from tonnes of carbon to tonnes of carbon dioxide (CO₂) using a conversion factor of 3.664. - - The full reference for the Carbon Budget 2021 is: - Global Carbon Budget 2021, by Pierre Friedlingstein, Matthew W. Jones, Michael O'Sullivan, Robbie M. Andrew, Dorothee C. E. Bakker, Judith Hauck, Corinne Le Quéré, Glen P. Peters, Wouter Peters, Julia Pongratz, Stephen Sitch, Josep G. Canadell, Philippe Ciais, Rob B. Jackson, Simone R. Alin, Peter Anthoni, Nicholas R. Bates, Meike Becker, Nicolas Bellouin, Laurent Bopp, Thi Tuyet Trang Chau, Frédéric Chevallier, Louise P. Chini, Margot Cronin, Kim I. Currie, Bertrand Decharme, Laique M. Djeutchouang, Xinyu Dou, Wiley Evans, Richard A. Feely, Liang Feng, Thomas Gasser, Dennis Gilfillan, Thanos Gkritzalis, Giacomo Grassi, Luke Gregor, Nicolas Gruber, Özgür Gürses, Ian Harris, Richard A. Houghton, George C. Hurtt, Yosuke Iida, Tatiana Ilyina, Ingrid T. Luijkx, Atul Jain, Steve D. Jones, Etsushi Kato, Daniel Kennedy, Kees Klein Goldewijk, Jürgen Knauer, Jan Ivar Korsbakken, Arne Körtzinger, Peter Landschützer, Siv K. Lauvset, Nathalie Lefèvre, Sebastian Lienert, Junjie Liu, Gregg Marland, Patrick C. McGuire, Joe R. Melton, David R. Munro, Julia E. M. S. Nabel, Shin-Ichiro Nakaoka, Yosuke Niwa, Tsuneo Ono, Denis Pierrot, Benjamin Poulter, Gregor Rehder, Laure Resplandy, Eddy Robertson, Christian Rödenbeck, Thais M. Rosan, Jörg Schwinger, Clemens Schwingshackl, Roland Séférian, Adrienne J. Sutton, Colm Sweeney, Toste Tanhua, Pieter P. Tans, Hanqin Tian, Bronte Tilbrook, Francesco Tubiello, Guido R. van der Werf, Nicolas Vuichard, Chisato Wada, Rik Wanninkhof, Andrew J. Watson, David Willis, Andrew J. Wiltshire, Wenping Yuan, Chao Yue, Xu Yue, Sönke Zaehle and Jiye Zeng (2022), Earth System Science Data, 14, 1917–2005, 2022, DOI: 10.5194/essd-14-1917-2022. + Data on global emissions has been converted by Our World in Data from tonnes of carbon to tonnes of carbon dioxide (CO₂) using a conversion factor of 3.664. + The full reference for the Carbon Budget 2021 is: + [Global Carbon Budget 2021](https://doi.org/10.5194/essd-14-1917-2022), by Pierre Friedlingstein, Matthew W. Jones, Michael O'Sullivan, Robbie M. Andrew, Dorothee C. E. Bakker, Judith Hauck, Corinne Le Quéré, Glen P. Peters, Wouter Peters, Julia Pongratz, Stephen Sitch, Josep G. Canadell, Philippe Ciais, Rob B. Jackson, Simone R. Alin, Peter Anthoni, Nicholas R. Bates, Meike Becker, Nicolas Bellouin, Laurent Bopp, Thi Tuyet Trang Chau, Frédéric Chevallier, Louise P. Chini, Margot Cronin, Kim I. Currie, Bertrand Decharme, Laique M. Djeutchouang, Xinyu Dou, Wiley Evans, Richard A. Feely, Liang Feng, Thomas Gasser, Dennis Gilfillan, Thanos Gkritzalis, Giacomo Grassi, Luke Gregor, Nicolas Gruber, Özgür Gürses, Ian Harris, Richard A. Houghton, George C. Hurtt, Yosuke Iida, Tatiana Ilyina, Ingrid T. Luijkx, Atul Jain, Steve D. Jones, Etsushi Kato, Daniel Kennedy, Kees Klein Goldewijk, Jürgen Knauer, Jan Ivar Korsbakken, Arne Körtzinger, Peter Landschützer, Siv K. Lauvset, Nathalie Lefèvre, Sebastian Lienert, Junjie Liu, Gregg Marland, Patrick C. McGuire, Joe R. Melton, David R. Munro, Julia E. M. S. Nabel, Shin-Ichiro Nakaoka, Yosuke Niwa, Tsuneo Ono, Denis Pierrot, Benjamin Poulter, Gregor Rehder, Laure Resplandy, Eddy Robertson, Christian Rödenbeck, Thais M. Rosan, Jörg Schwinger, Clemens Schwingshackl, Roland Séférian, Adrienne J. Sutton, Colm Sweeney, Toste Tanhua, Pieter P. Tans, Hanqin Tian, Bronte Tilbrook, Francesco Tubiello, Guido R. van der Werf, Nicolas Vuichard, Chisato Wada, Rik Wanninkhof, Andrew J. Watson, David Willis, Andrew J. Wiltshire, Wenping Yuan, Chao Yue, Xu Yue, Sönke Zaehle and Jiye Zeng (2022), Earth System Science Data, 14, 1917–2005, 2022, DOI: 10.5194/essd-14-1917-2022. tables: global_carbon_budget_additional: variables: @@ -29,14 +27,14 @@ tables: short_unit: t consumption_emissions_as_share_of_global: title: "Consumption-based CO₂ emissions (% of global total)" - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' consumption_emissions_per_capita: title: "Consumption-based CO₂ per capita" unit: tonnes of CO₂ per capita short_unit: t global_bunker_emissions: - title: "Global bunker emissions" + title: Global bunker emissions unit: tonnes short_unit: t global_fossil_emissions: @@ -55,17 +53,17 @@ tables: short_unit: t description: "Global CO₂ emissions from land use change." global_population: - title: "Global population" + title: Global population unit: persons short_unit: persons population: - title: "Population" + title: Population unit: persons short_unit: persons population_as_share_of_global: title: Share of global population - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' production_emissions: title: "Production-based CO₂ emissions" unit: tonnes diff --git a/etl/steps/archive/garden/gcp/2022-11-11/global_carbon_budget.meta.yml b/etl/steps/archive/garden/gcp/2022-11-11/global_carbon_budget.meta.yml index ef45c542109..4668cd55152 100644 --- a/etl/steps/archive/garden/gcp/2022-11-11/global_carbon_budget.meta.yml +++ b/etl/steps/archive/garden/gcp/2022-11-11/global_carbon_budget.meta.yml @@ -3,10 +3,10 @@ dataset: short_name: global_carbon_budget title: Global Carbon Budget (Global Carbon Project, 2022) description: | - The Global Carbon Budget dataset is available here. + The Global Carbon Budget dataset is available [here](https://globalcarbonbudget.org/archive/). Full reference: - Friedlingstein, P., O'Sullivan, M., Jones, M. W., Andrew, R. M., Gregor, L., Hauck, J., Le Quéré, C., Luijkx, I. T., Olsen, A., Peters, G. P., Peters, W., Pongratz, J., Schwingshackl, C., Sitch, S., Canadell, J. G., Ciais, P., Jackson, R. B., Alin, S. R., Alkama, R., Arneth, A., Arora, V. K., Bates, N. R., Becker, M., Bellouin, N., Bittig, H. C., Bopp, L., Chevallier, F., Chini, L. P., Cronin, M., Evans, W., Falk, S., Feely, R. A., Gasser, T., Gehlen, M., Gkritzalis, T., Gloege, L., Grassi, G., Gruber, N., Gürses, Ö., Harris, I., Hefner, M., Houghton, R. A., Hurtt, G. C., Iida, Y., Ilyina, T., Jain, A. K., Jersild, A., Kadono, K., Kato, E., Kennedy, D., Klein Goldewijk, K., Knauer, J., Korsbakken, J. I., Landschützer, P., Lefèvre, N., Lindsay, K., Liu, J., Liu, Z., Marland, G., Mayot, N., McGrath, M. J., Metzl, N., Monacci, N. M., Munro, D. R., Nakaoka, S.-I., Niwa, Y., O'Brien, K., Ono, T., Palmer, P. I., Pan, N., Pierrot, D., Pocock, K., Poulter, B., Resplandy, L., Robertson, E., Rödenbeck, C., Rodriguez, C., Rosan, T. M., Schwinger, J., Séférian, R., Shutler, J. D., Skjelvan, I., Steinhoff, T., Sun, Q., Sutton, A. J., Sweeney, C., Takao, S., Tanhua, T., Tans, P. P., Tian, X., Tian, H., Tilbrook, B., Tsujino, H., Tubiello, F., van der Werf, G. R., Walker, A. P., Wanninkhof, R., Whitehead, C., Willstrand Wranne, A., Wright, R., Yuan, W., Yue, C., Yue, X., Zaehle, S., Zeng, J., and Zheng, B.: Global Carbon Budget 2022, Earth Syst. Sci. Data, 14, 4811-4900, https://doi.org/10.5194/essd-14-4811-2022, 2022. + Friedlingstein, P., O'Sullivan, M., Jones, M. W., Andrew, R. M., Gregor, L., Hauck, J., Le Quéré, C., Luijkx, I. T., Olsen, A., Peters, G. P., Peters, W., Pongratz, J., Schwingshackl, C., Sitch, S., Canadell, J. G., Ciais, P., Jackson, R. B., Alin, S. R., Alkama, R., Arneth, A., Arora, V. K., Bates, N. R., Becker, M., Bellouin, N., Bittig, H. C., Bopp, L., Chevallier, F., Chini, L. P., Cronin, M., Evans, W., Falk, S., Feely, R. A., Gasser, T., Gehlen, M., Gkritzalis, T., Gloege, L., Grassi, G., Gruber, N., Gürses, Ö., Harris, I., Hefner, M., Houghton, R. A., Hurtt, G. C., Iida, Y., Ilyina, T., Jain, A. K., Jersild, A., Kadono, K., Kato, E., Kennedy, D., Klein Goldewijk, K., Knauer, J., Korsbakken, J. I., Landschützer, P., Lefèvre, N., Lindsay, K., Liu, J., Liu, Z., Marland, G., Mayot, N., McGrath, M. J., Metzl, N., Monacci, N. M., Munro, D. R., Nakaoka, S.-I., Niwa, Y., O'Brien, K., Ono, T., Palmer, P. I., Pan, N., Pierrot, D., Pocock, K., Poulter, B., Resplandy, L., Robertson, E., Rödenbeck, C., Rodriguez, C., Rosan, T. M., Schwinger, J., Séférian, R., Shutler, J. D., Skjelvan, I., Steinhoff, T., Sun, Q., Sutton, A. J., Sweeney, C., Takao, S., Tanhua, T., Tans, P. P., Tian, X., Tian, H., Tilbrook, B., Tsujino, H., Tubiello, F., van der Werf, G. R., Walker, A. P., Wanninkhof, R., Whitehead, C., Willstrand Wranne, A., Wright, R., Yuan, W., Yue, C., Yue, X., Zaehle, S., Zeng, J., and Zheng, B.: Global Carbon Budget 2022, Earth Syst. Sci. Data, 14, 4811-4900, https://doi.org/10.5194/essd-14-4811-2022, 2022. Variables include each country, region and World Bank income group's share of the global population; production-based (territorial); and consumption-based (trade-adjusted) carbon dioxide emissions. @@ -14,7 +14,7 @@ dataset: Note that consumption-based emissions are not available for all countries; although those without complete data are a small fraction (3%) of the global total. Each country's share of world emissions are based on the share of the global total minus categories termed 'bunkers' and 'statistical differences' (which include cross-boundary emissions such as international travel and shipping. - Calculation of each country's share of the global population is calculated using our population dataset, based on different sources). + Calculation of each country's share of the global population is calculated using our population dataset, based on [different sources](https://ourworldindata.org/population-sources)). Data on global emissions has been converted by Our World in Data from tonnes of carbon to tonnes of carbon dioxide (CO₂) using a conversion factor of 3.664. @@ -313,7 +313,9 @@ tables: title: "GDP" unit: "2011 international-$" short_unit: "$" - description: "Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries." + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) + and price differences between countries. global_cumulative_emissions_from_cement: title: "Global cumulative CO₂ emissions from cement" unit: "tonnes" diff --git a/etl/steps/archive/garden/gcp/2023-04-28/global_carbon_budget.meta.yml b/etl/steps/archive/garden/gcp/2023-04-28/global_carbon_budget.meta.yml index d69c0584f73..42f40dd8a28 100644 --- a/etl/steps/archive/garden/gcp/2023-04-28/global_carbon_budget.meta.yml +++ b/etl/steps/archive/garden/gcp/2023-04-28/global_carbon_budget.meta.yml @@ -1,10 +1,10 @@ dataset: title: Global Carbon Budget (Global Carbon Project, 2023) description: | - The Global Carbon Budget dataset is available here. + The Global Carbon Budget dataset is available [here](https://globalcarbonbudget.org/archive/). Full reference: - Friedlingstein, P., O'Sullivan, M., Jones, M. W., Andrew, R. M., Gregor, L., Hauck, J., Le Quéré, C., Luijkx, I. T., Olsen, A., Peters, G. P., Peters, W., Pongratz, J., Schwingshackl, C., Sitch, S., Canadell, J. G., Ciais, P., Jackson, R. B., Alin, S. R., Alkama, R., Arneth, A., Arora, V. K., Bates, N. R., Becker, M., Bellouin, N., Bittig, H. C., Bopp, L., Chevallier, F., Chini, L. P., Cronin, M., Evans, W., Falk, S., Feely, R. A., Gasser, T., Gehlen, M., Gkritzalis, T., Gloege, L., Grassi, G., Gruber, N., Gürses, Ö., Harris, I., Hefner, M., Houghton, R. A., Hurtt, G. C., Iida, Y., Ilyina, T., Jain, A. K., Jersild, A., Kadono, K., Kato, E., Kennedy, D., Klein Goldewijk, K., Knauer, J., Korsbakken, J. I., Landschützer, P., Lefèvre, N., Lindsay, K., Liu, J., Liu, Z., Marland, G., Mayot, N., McGrath, M. J., Metzl, N., Monacci, N. M., Munro, D. R., Nakaoka, S.-I., Niwa, Y., O'Brien, K., Ono, T., Palmer, P. I., Pan, N., Pierrot, D., Pocock, K., Poulter, B., Resplandy, L., Robertson, E., Rödenbeck, C., Rodriguez, C., Rosan, T. M., Schwinger, J., Séférian, R., Shutler, J. D., Skjelvan, I., Steinhoff, T., Sun, Q., Sutton, A. J., Sweeney, C., Takao, S., Tanhua, T., Tans, P. P., Tian, X., Tian, H., Tilbrook, B., Tsujino, H., Tubiello, F., van der Werf, G. R., Walker, A. P., Wanninkhof, R., Whitehead, C., Willstrand Wranne, A., Wright, R., Yuan, W., Yue, C., Yue, X., Zaehle, S., Zeng, J., and Zheng, B.: Global Carbon Budget 2022, Earth Syst. Sci. Data, 14, 4811-4900, https://doi.org/10.5194/essd-14-4811-2022, 2022. + Friedlingstein, P., O'Sullivan, M., Jones, M. W., Andrew, R. M., Gregor, L., Hauck, J., Le Quéré, C., Luijkx, I. T., Olsen, A., Peters, G. P., Peters, W., Pongratz, J., Schwingshackl, C., Sitch, S., Canadell, J. G., Ciais, P., Jackson, R. B., Alin, S. R., Alkama, R., Arneth, A., Arora, V. K., Bates, N. R., Becker, M., Bellouin, N., Bittig, H. C., Bopp, L., Chevallier, F., Chini, L. P., Cronin, M., Evans, W., Falk, S., Feely, R. A., Gasser, T., Gehlen, M., Gkritzalis, T., Gloege, L., Grassi, G., Gruber, N., Gürses, Ö., Harris, I., Hefner, M., Houghton, R. A., Hurtt, G. C., Iida, Y., Ilyina, T., Jain, A. K., Jersild, A., Kadono, K., Kato, E., Kennedy, D., Klein Goldewijk, K., Knauer, J., Korsbakken, J. I., Landschützer, P., Lefèvre, N., Lindsay, K., Liu, J., Liu, Z., Marland, G., Mayot, N., McGrath, M. J., Metzl, N., Monacci, N. M., Munro, D. R., Nakaoka, S.-I., Niwa, Y., O'Brien, K., Ono, T., Palmer, P. I., Pan, N., Pierrot, D., Pocock, K., Poulter, B., Resplandy, L., Robertson, E., Rödenbeck, C., Rodriguez, C., Rosan, T. M., Schwinger, J., Séférian, R., Shutler, J. D., Skjelvan, I., Steinhoff, T., Sun, Q., Sutton, A. J., Sweeney, C., Takao, S., Tanhua, T., Tans, P. P., Tian, X., Tian, H., Tilbrook, B., Tsujino, H., Tubiello, F., van der Werf, G. R., Walker, A. P., Wanninkhof, R., Whitehead, C., Willstrand Wranne, A., Wright, R., Yuan, W., Yue, C., Yue, X., Zaehle, S., Zeng, J., and Zheng, B.: Global Carbon Budget 2022, Earth Syst. Sci. Data, 14, 4811-4900, https://doi.org/10.5194/essd-14-4811-2022, 2022. Variables include each country, region and World Bank income group's share of the global population; production-based (territorial); and consumption-based (trade-adjusted) carbon dioxide emissions. @@ -12,7 +12,7 @@ dataset: Note that consumption-based emissions are not available for all countries; although those without complete data are a small fraction (3%) of the global total. - Calculation of each country's share of the global population is calculated using our population dataset, based on different sources). + Calculation of each country's share of the global population is calculated using our population dataset, based on [different sources]("https://ourworldindata.org/population-sources)). Data on global emissions has been converted by Our World in Data from tonnes of carbon to tonnes of carbon dioxide (CO₂) using a conversion factor of 3.664. @@ -310,7 +310,9 @@ tables: title: "GDP" unit: "2011 international-$" short_unit: "$" - description: "Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries." + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time + (inflation) and price differences between countries. global_cumulative_emissions_from_cement: title: "Global cumulative CO₂ emissions from cement" unit: "tonnes" diff --git a/etl/steps/archive/garden/papers/2023-01-04/farmer_lafond_2016.meta.yml b/etl/steps/archive/garden/papers/2023-01-04/farmer_lafond_2016.meta.yml index a6083a834aa..1ddc2bf061d 100644 --- a/etl/steps/archive/garden/papers/2023-01-04/farmer_lafond_2016.meta.yml +++ b/etl/steps/archive/garden/papers/2023-01-04/farmer_lafond_2016.meta.yml @@ -71,7 +71,7 @@ dataset: + Vinyl chloride is measured in 1966 USD/lbs. + Wind turbine (Denmark) is measured in DKK/kW. - According to Farmer & Lafond (2016), the data are mostly taken from the Santa-Fe Performance Curve Database. The database has been constructed from personal communications and from Colpier and Cornland (2002), Goldemberg et al. (2004), Lieberman (1984), Lipman and Sperling (1999), Zhao (1999), McDonald and Schrattenholzer (2001), Neij et al. (2003), Moore (2006), Nemet (2006), Schilling and Esmundo (2009). The data on photovoltaic prices has been collected from public releases of Strategies Unlimited, Navigant and SPV Market Research. The data on nuclear energy is from Koomey and Hultman (2007) and Cooper (2009). The DNA sequencing data is from Wetterstrand (2015) (cost per human-size genome), and for each year the last available month (September for 2001-2002 and October afterwards) was taken and corrected for inflation using the US GDP deflator. + According to Farmer & Lafond (2016), the data are mostly taken from the Santa-Fe [Performance Curve Database](https://pcdb.santafe.edu/). The database has been constructed from personal communications and from [Colpier and Cornland (2002)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0095), [Goldemberg et al. (2004)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0130), [Lieberman (1984)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0180), [Lipman and Sperling (1999)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0190), [Zhao (1999)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0310), [McDonald and Schrattenholzer (2001)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0205), [Neij et al. (2003)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0235), [Moore (2006)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0215), [Nemet (2006)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0240), [Schilling and Esmundo (2009)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0265). The data on photovoltaic prices has been collected from public releases of Strategies Unlimited, Navigant and SPV Market Research. The data on nuclear energy is from [Koomey and Hultman (2007)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0165) and [Cooper (2009)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0100). The DNA sequencing data is from [Wetterstrand (2015)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0290) (cost per human-size genome), and for each year the last available month (September for 2001-2002 and October afterwards) was taken and corrected for inflation using the US GDP deflator. licenses: - name: Creative Commons 4.0 url: https://www.sciencedirect.com/science/article/pii/S0048733315001699 diff --git a/etl/steps/archive/garden/rff/2022-09-14/emissions_weighted_carbon_price.meta.yml b/etl/steps/archive/garden/rff/2022-09-14/emissions_weighted_carbon_price.meta.yml index 6a5c42ba695..f60c3b175f8 100644 --- a/etl/steps/archive/garden/rff/2022-09-14/emissions_weighted_carbon_price.meta.yml +++ b/etl/steps/archive/garden/rff/2022-09-14/emissions_weighted_carbon_price.meta.yml @@ -14,125 +14,124 @@ dataset: - Each sector’s contribution to a country’s CO2 emissions (e.g. what percentage of a country’s emissions come from electricity, or road transport) They then weight each sector’s carbon price by the relevant sector’s contribution to CO2 emissions, and aggregate these figures to get an economy-wide weighted carbon price. - A full technical note on this methodology is provided by the authors here. - + A full technical note on this methodology is provided by the authors [here](https://www.rff.org/publications/working-papers/emissions-weighted-carbon-price-sources-and-methods/). sources: - - - name: Dolphin, Pollitt and Newbery (2020). Emissions-weighted Carbon Price. - published_by: "Dolphin, G., Pollitt, M. and Newbery, D. 2020. The political economy of carbon pricing: a panel analysis. Oxford Economic Papers 72(2): 472-500." - publication_year: 2022 - publication_date: 2022-01-18 - url: https://github.com/g-dolphin/ECP - + - name: Dolphin, Pollitt and Newbery (2020). Emissions-weighted Carbon Price. + published_by: >- + Dolphin, G., Pollitt, M. and Newbery, D. 2020. The political economy of carbon pricing: a panel analysis. + Oxford Economic Papers 72(2): 472-500. + publication_year: 2022 + publication_date: 2022-01-18 + url: https://github.com/g-dolphin/ECP tables: emissions_weighted_carbon_price: title: Emissions-weighted carbon price variables: co2_with_ets_as_share_of_co2: title: CO2 emissions covered by an ETS as a share of the country's CO2 emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_ets_as_share_of_ghg: title: CO2 emissions covered by an ETS as a share of the country's GHG emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_ets_as_share_of_world_co2: title: CO2 emissions covered by an ETS as a share of the world's CO2 emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_ets_as_share_of_world_ghg: title: CO2 emissions covered by an ETS as a share of the world's GHG emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_as_share_of_co2: title: CO2 emissions covered by a carbon tax as a share of the country's CO2 emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_as_share_of_ghg: title: CO2 emissions covered by a carbon tax as a share of the country's GHG emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_as_share_of_world_co2: title: CO2 emissions covered by a carbon tax as a share of the world's CO2 emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_as_share_of_world_ghg: title: CO2 emissions covered by a carbon tax as a share of the world's GHG emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_or_ets_as_share_of_co2: title: CO2 emissions covered by a carbon tax or an ETS as a share of the country's CO2 emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_or_ets_as_share_of_ghg: title: CO2 emissions covered by a carbon tax or an ETS as a share of the country's GHG emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_or_ets_as_share_of_world_co2: title: CO2 emissions covered by a carbon tax or an ETS as a share of the world's CO2 emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 co2_with_tax_or_ets_as_share_of_world_ghg: title: CO2 emissions covered by a carbon tax or an ETS as a share of the world's GHG emissions - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: numDecimalPlaces: 2 price_with_ets_weighted_by_share_of_co2: title: Average price on emissions covered by an ETS, weighted by the share of the country's CO2 emissions - unit: "2019 US$ per tonne of carbon dioxide equivalents" - short_unit: "2019 US$/ tCO2e" + unit: 2019 US$ per tonne of carbon dioxide equivalents + short_unit: 2019 US$/ tCO2e display: numDecimalPlaces: 2 price_with_ets_weighted_by_share_of_ghg: title: Average price on emissions covered by an ETS, weighted by the share of the country's GHG emissions - unit: "2019 US$ per tonne of carbon dioxide equivalents" - short_unit: "2019 US$/ tCO2e" + unit: 2019 US$ per tonne of carbon dioxide equivalents + short_unit: 2019 US$/ tCO2e display: numDecimalPlaces: 2 price_with_tax_or_ets_weighted_by_share_of_co2: title: Average price on emissions covered by a carbon tax or an ETS, weighted by the share of the country's CO2 emissions - unit: "2019 US$ per tonne of carbon dioxide equivalents" - short_unit: "2019 US$/ tCO2e" + unit: 2019 US$ per tonne of carbon dioxide equivalents + short_unit: 2019 US$/ tCO2e display: numDecimalPlaces: 2 price_with_tax_or_ets_weighted_by_share_of_ghg: title: Average price on emissions covered by a carbon tax or an ETS, weighted by the share of the country's GHG emissions - unit: "2019 US$ per tonne of carbon dioxide equivalents" - short_unit: "2019 US$/ tCO2e" + unit: 2019 US$ per tonne of carbon dioxide equivalents + short_unit: 2019 US$/ tCO2e display: numDecimalPlaces: 2 price_with_tax_weighted_by_share_of_co2: title: Average price on emissions covered by a carbon tax, weighted by the share of the country's CO2 emissions - unit: "2019 US$ per tonne of carbon dioxide equivalents" - short_unit: "2019 US$/ tCO2e" + unit: 2019 US$ per tonne of carbon dioxide equivalents + short_unit: 2019 US$/ tCO2e display: numDecimalPlaces: 2 price_with_tax_weighted_by_share_of_ghg: title: Average price on emissions covered by a carbon tax, weighted by the share of the country's GHG emissions - unit: "2019 US$ per tonne of carbon dioxide equivalents" - short_unit: "2019 US$/ tCO2e" + unit: 2019 US$ per tonne of carbon dioxide equivalents + short_unit: 2019 US$/ tCO2e display: numDecimalPlaces: 2 diff --git a/etl/steps/archive/garden/shift/2022-07-18/fossil_fuel_production.meta.yml b/etl/steps/archive/garden/shift/2022-07-18/fossil_fuel_production.meta.yml index 63cb862fe54..3adc234eaec 100644 --- a/etl/steps/archive/garden/shift/2022-07-18/fossil_fuel_production.meta.yml +++ b/etl/steps/archive/garden/shift/2022-07-18/fossil_fuel_production.meta.yml @@ -1,34 +1,33 @@ dataset: title: Fossil fuel production (Shift, 2022) description: | - Fossil fuel production, produced by Our World in Data based on data from The Shift Dataportal. + Fossil fuel production, produced by Our World in Data based on data from [The Shift Dataportal](https://www.theshiftdataportal.org/energy). sources: - - - name: Our World in Data based on The Shift Dataportal (2022) - published_by: The Shift Dataportal - date_accessed: 2022-07-18 - url: https://www.theshiftdataportal.org/energy + - name: Our World in Data based on The Shift Dataportal (2022) + published_by: The Shift Dataportal + date_accessed: 2022-07-18 + url: https://www.theshiftdataportal.org/energy tables: fossil_fuel_production: variables: coal: - title: "Coal production" - short_unit: "TWh" - unit: "terawatt-hours" + title: Coal production + short_unit: TWh + unit: terawatt-hours description: display: numDecimalPlaces: 0 gas: - title: "Gas production" - short_unit: "TWh" - unit: "terawatt-hours" + title: Gas production + short_unit: TWh + unit: terawatt-hours description: display: numDecimalPlaces: 0 oil: - title: "Oil production" - short_unit: "TWh" - unit: "terawatt-hours" + title: Oil production + short_unit: TWh + unit: terawatt-hours description: display: numDecimalPlaces: 0 diff --git a/etl/steps/data/garden/agriculture/2023-06-12/uk_long_term_yields.meta.yml b/etl/steps/data/garden/agriculture/2023-06-12/uk_long_term_yields.meta.yml index 56957b32875..54e5166d6bd 100644 --- a/etl/steps/data/garden/agriculture/2023-06-12/uk_long_term_yields.meta.yml +++ b/etl/steps/data/garden/agriculture/2023-06-12/uk_long_term_yields.meta.yml @@ -5,7 +5,7 @@ dataset: • Data from 1270 to 1870 is taken from Table 3.06 of Broadberry et al. (2015). The data in this table is based on the Medieval Accounts Database, the Early Modern Probate Inventories Database and the Modern Farm Accounts Database. Seed sown per acre from the Medieval and Modern Databases. Pulses for the modern period and all seeds sown for the early modern period are taken from Overton and Campbell (1996), Allen (2005). This comprises crop yield estimates only for England. For this dataset, we have assumed that yields in England are also representative of average UK yields. The data was given as decadal averages, and we have assumed, for each value, the middle year in each decade. - All values of yield in bushels per acre have been converted to tonnes per hectare, using the conversion factors given by the USDA for the different commodities. + All values of yield in bushels per acre have been converted to tonnes per hectare, using the conversion factors given by [the USDA](https://www.ers.usda.gov/webdocs/publications/41880/33132_ah697_002.pdf) for the different commodities. • Data from 1870 to 1960 is taken from Table 4 of Brassley (2000). The data in this table is based on the book "A hundred Years of British food and farming: a statistical survey", by H. F. Marks (ed. D. K. Britton, 1989). The data is provided over 5-year periods. We have assumed, for each value, the middle year in each 5-year set. diff --git a/etl/steps/data/garden/andrew/2019-12-03/co2_mitigation_curves.meta.yml b/etl/steps/data/garden/andrew/2019-12-03/co2_mitigation_curves.meta.yml index 3297de15427..357d28189a8 100644 --- a/etl/steps/data/garden/andrew/2019-12-03/co2_mitigation_curves.meta.yml +++ b/etl/steps/data/garden/andrew/2019-12-03/co2_mitigation_curves.meta.yml @@ -15,7 +15,7 @@ tables: For example, 'Start in 2010' marks the necessary future emissions pathway to have a >66% chance of keeping global average temperatures below 1.5°C warming if global CO2 emissions mitigation had started in 2010, very quickly peaking then falling. - Data is sourced from Robbie Andrew, and available for download here. + Data is sourced from Robbie Andrew, and available for download [here](http://folk.uio.no/roberan/t/global_mitigation_curves.shtml). Historical emissions to 2017 are sourced from CDIAC/Global Carbon Project, projection to 2018 from Global Carbon Project (Le Quéré et al. 2018). @@ -34,7 +34,7 @@ tables: For example, 'Start in 2010' marks the necessary future emissions pathway to have a >66% chance of keeping global average temperatures below 2°C warming if global CO2 emissions mitigation had started in 2010, very quickly peaking then falling. - Data is sourced from Robbie Andrew, and available for download here. + Data is sourced from Robbie Andrew, and available for download [here](http://folk.uio.no/roberan/t/global_mitigation_curves.shtml). Historical emissions to 2017 are sourced from CDIAC/Global Carbon Project, projection to 2018 from Global Carbon Project (Le Quéré et al. 2018). diff --git a/etl/steps/data/garden/artificial_intelligence/2023-06-14/ai_deepfakes.meta.yml b/etl/steps/data/garden/artificial_intelligence/2023-06-14/ai_deepfakes.meta.yml index 7c944b8f961..13110c54988 100644 --- a/etl/steps/data/garden/artificial_intelligence/2023-06-14/ai_deepfakes.meta.yml +++ b/etl/steps/data/garden/artificial_intelligence/2023-06-14/ai_deepfakes.meta.yml @@ -1,12 +1,13 @@ dataset: title: DeepFake detection (AI Index, 2023) description: > - Data from Li et al. (2022) via AI Index report on Celeb-DF, presently one of the most challenging deepfake detection benchmarks. + Data from Li et al. (2022) via AI Index report on Celeb-DF, presently one of the most challenging deepfake detection benchmarks. - The AI Index is an independent initiative at the Stanford University Institute for Human-Centered Artificial Intelligence. - The mission of the AI Index is “to provide unbiased, rigorously vetted, and globally sourced data for policymakers, researchers, executives, journalists, and the general public to develop intuitions about the complex field of AI.” - Their flagship output is the annual AI Index Report, which has been published since 2017. + The AI Index is an independent initiative at the Stanford University Institute for Human-Centered Artificial Intelligence. + The mission of the AI Index is “to provide unbiased, rigorously vetted, and globally sourced data for policymakers, researchers, + executives, journalists, and the general public to develop intuitions about the complex field of AI.” Their flagship output + is the annual AI Index Report, which has been published since 2017. licenses: - name: Public domain url: https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI-Index-Report_2023.pdf @@ -17,33 +18,44 @@ dataset: date_accessed: '2023-06-19' publication_date: '2023-05-19' publication_year: 2023 - published_by: Li et al. (2022) via the AI Index 2023 Annual Report, AI Index Steering Committee, Institute - for Human-Centered AI, Stanford University, Stanford, CA, April 2023 + published_by: Li et al. (2022) via the AI Index 2023 Annual Report, AI Index Steering Committee, Institute for Human-Centered + AI, Stanford University, Stanford, CA, April 2023 tables: ai_deepfakes: variables: area_under_curve_score__auc: title: Area Under Curve Score (AUC) description: > - The Area Under Curve Score (AUC), also known as the AUC-ROC (Receiver Operating Characteristic) score, is a popular evaluation metric used in machine learning and statistics to assess the performance of binary classification models. - - In binary classification, the goal is to predict whether an instance belongs to one class (positive) or another (negative) based on its features. The ROC curve is created by plotting the true positive rate (TPR) against the false positive rate (FPR) at various classification thresholds. The TPR is the ratio of true positives to the total number of actual positives, while the FPR is the ratio of false positives to the total number of actual negatives. - - The AUC is a measure of the overall performance of the classifier across all possible classification thresholds. It represents the probability that a randomly chosen positive instance will be ranked higher than a randomly chosen negative instance according to the classifier's predicted probabilities. The AUC score ranges from 0 to 1, where a score of 1 indicates a perfect classifier, and a score of 0.5 represents a classifier with no discriminatory power (equivalent to random guessing). - - Interpreting the AUC score: - - AUC = 1: Perfect classifier. The model has a clear separation between the positive and negative classes, correctly ranking all instances. - AUC > 0.5: Better than random guessing. The model has some discriminatory power and performs better than a random classifier. - AUC = 0.5: Random classifier. The model performs no better than flipping a coin and has no ability to distinguish between the classes. - AUC < 0.5: Inverted classifier. The model performs worse than random guessing, meaning it is making incorrect predictions. - The AUC score is widely used because it is insensitive to class imbalance and classification thresholds. It provides a single scalar value to compare different classifiers or evaluate the performance of a single classifier. Higher AUC scores generally indicate better classifier performance in terms of the trade-off between true positives and false positives. - - It's important to note that the AUC score is specific to binary classification problems and cannot be directly applied to multi-class classification tasks without modification. - - unit: 'Area under curve' + The Area Under Curve Score (AUC), also known as the AUC-ROC (Receiver Operating Characteristic) score, is a popular + evaluation metric used in machine learning and statistics to assess the performance of binary classification models. + + In binary classification, the goal is to predict whether an instance belongs to one class (positive) or another + (negative) based on its features. The ROC curve is created by plotting the true positive rate (TPR) against the + false positive rate (FPR) at various classification thresholds. The TPR is the ratio of true positives to the total + number of actual positives, while the FPR is the ratio of false positives to the total number of actual negatives. + + The AUC is a measure of the overall performance of the classifier across all possible classification thresholds. + It represents the probability that a randomly chosen positive instance will be ranked higher than a randomly chosen + negative instance according to the classifier's predicted probabilities. The AUC score ranges from 0 to 1, where + a score of 1 indicates a perfect classifier, and a score of 0.5 represents a classifier with no discriminatory power + (equivalent to random guessing). + + Interpreting the AUC score: + + AUC = 1: Perfect classifier. The model has a clear separation between the positive and negative classes, correctly + ranking all instances. + AUC > 0.5: Better than random guessing. The model has some discriminatory power and performs better than a random + classifier. + AUC = 0.5: Random classifier. The model performs no better than flipping a coin and has no ability to distinguish + between the classes. + AUC < 0.5: Inverted classifier. The model performs worse than random guessing, meaning it is making incorrect predictions. + The AUC score is widely used because it is insensitive to class imbalance and classification thresholds. It provides + a single scalar value to compare different classifiers or evaluate the performance of a single classifier. Higher + AUC scores generally indicate better classifier performance in terms of the trade-off between true positives and + false positives. + + It's important to note that the AUC score is specific to binary classification problems and cannot be directly applied + to multi-class classification tasks without modification. + unit: Area under curve display: numDecimalPlaces: 0 - - - diff --git a/etl/steps/data/garden/cait/2022-08-10/ghg_emissions_by_sector.meta.yml b/etl/steps/data/garden/cait/2022-08-10/ghg_emissions_by_sector.meta.yml index dcfff80376e..1d497d5aaa5 100644 --- a/etl/steps/data/garden/cait/2022-08-10/ghg_emissions_by_sector.meta.yml +++ b/etl/steps/data/garden/cait/2022-08-10/ghg_emissions_by_sector.meta.yml @@ -6,7 +6,7 @@ dataset: description: | Emissions are measured in tonnes of carbon dioxide equivalents (CO₂e), based on 100-year global warming potential factors for non-CO₂ gases. - Emissions are broken down by sector. Further information on sector definitions is available here. + Emissions are broken down by sector. Further information on sector definitions is available [here](https://ourworldindata.org/ghg-emissions-by-sector). sources: - name: Our World in Data based on Climate Analysis Indicators Tool (CAIT). diff --git a/etl/steps/data/garden/covid/latest/cases_and_deaths_who.meta.yml b/etl/steps/data/garden/covid/latest/cases_and_deaths_who.meta.yml index 11da3973d09..e1efa5602e4 100644 --- a/etl/steps/data/garden/covid/latest/cases_and_deaths_who.meta.yml +++ b/etl/steps/data/garden/covid/latest/cases_and_deaths_who.meta.yml @@ -1,27 +1,21 @@ dataset: - title: "COVID-19: Confirmed cases and deaths (WHO)" + title: 'COVID-19: Confirmed cases and deaths (WHO)' description: >- - Raw data on confirmed cases and deaths for all countries is sourced from the - WHO - COVID-19 Dashboard. + Raw data on confirmed cases and deaths for all countries is sourced from the [WHO COVID-19 Dashboard](https://covid19.who.int/data). - Our complete COVID-19 dataset is a collection of the COVID-19 data maintained - by Our World in Data. It - is updated daily and includes data on confirmed cases, deaths, hospitalizations, - and testing. + Our complete COVID-19 dataset is a collection of the COVID-19 data maintained by *Our World in Data*. **It is updated + daily** and includes data on confirmed cases, deaths, hospitalizations, and testing. - We have created a new description of all our data sources. You find it at our - GitHub repository here. - There you can download all of our data. + We have created a new description of all our data sources. You find it at our GitHub repository **[here](https://github.com/owid/covid-19-data/tree/master/public/data/)**. + There you can download all of our data. - The WHO licenses this data under CC BY-NC-SA 3.0 IGO. You can read more here. + The WHO licenses this data under CC BY-NC-SA 3.0 IGO. You can read more [here](https://www.who.int/about/policies/publishing/copyright). - Attribute the data as the "WHO COVID-19 Dashboard. Geneva: World Health Organization, - 2020. Available online: https://covid19.who.int/". + Attribute the data as the "WHO COVID-19 Dashboard. Geneva: World Health Organization, 2020. Available online: https://covid19.who.int/". sources: - name: World Health Organization url: https://covid19.who.int/data diff --git a/etl/steps/data/garden/covid/latest/decoupling_metrics.meta.yml b/etl/steps/data/garden/covid/latest/decoupling_metrics.meta.yml index 24054cf52b3..5ed1d20817c 100644 --- a/etl/steps/data/garden/covid/latest/decoupling_metrics.meta.yml +++ b/etl/steps/data/garden/covid/latest/decoupling_metrics.meta.yml @@ -1,50 +1,36 @@ dataset: - title: "COVID-19: Decoupling of metrics (various sources)" + title: 'COVID-19: Decoupling of metrics (various sources)' description: >- - By comparing the proportion of confirmed cases that result in hospital admissions, - ICU admissions, and deaths, to previous - waves – when the population was not vaccinated – we can learn something about - the protection that vaccination has provided + By comparing the proportion of confirmed cases that result in hospital admissions, ICU admissions, and deaths, to previous + waves – when the population was not vaccinated – we can learn something about the protection that vaccination has provided against severe outcomes. - This chart shows one way to do this. It visualizes the main COVID metrics relative - to the peak of the last wave. The - peak of the last wave happened before the population was widely vaccinated. - In this representation of the data, if confirmed - cases increase but hospitalizations and deaths increase to a lesser extent, - it will mean that the many reported cases + This chart shows one way to do this. It visualizes the main COVID metrics relative to the peak of the last wave. The peak + of the last wave happened before the population was widely vaccinated. In this representation of the data, if confirmed + cases increase but hospitalizations and deaths increase to a lesser extent, it will mean that the many reported cases are leading to fewer severe forms of the disease, and fewer deaths. - Differences between countries and between waves may arise from factors such - as: the number of vaccine doses administered - per person; immunity from previous infections; the variants that are dominant - within the population; the demographics - of the population; and the demographics of people who have been vaccinated. - For example, countries where the elderly - and most vulnerable have been vaccinated at higher rates may have fewer severe - outcomes. + Differences between countries and between waves may arise from factors such as: the number of vaccine doses administered + per person; immunity from previous infections; the variants that are dominant within the population; the demographics + of the population; and the demographics of people who have been vaccinated. For example, countries where the elderly and + most vulnerable have been vaccinated at higher rates may have fewer severe outcomes. Our sources for these charts are: - - Germany: Robert Koch Institute + - Germany: [Robert Koch Institute](https://github.com/robert-koch-institut/) - - Israel: Government - of Israel, automated via dancarmoz - on GitHub + - Israel: [Government of Israel](https://datadashboard.health.gov.il/COVID-19/general), automated via [dancarmoz on GitHub](https://github.com/dancarmoz/israel_moh_covid_dashboard_data/) - - Spain: National Center for Epidemiology + - Spain: [National Center for Epidemiology](https://cnecovid.isciii.es/covid19/) - - United States: US - CDC and Department - of Health & Human Services + - United States: [US CDC](https://covid.cdc.gov/covid-data-tracker/#trends_dailycases) and [Department of Health & Human + Services](https://healthdata.gov/Hospital/COVID-19-Reported-Patient-Impact-and-Hospital-Capa/g62h-syeh) sources: - name: Official data collated by Our World in Data published_by: Official data collated by Our World in Data - tables: decoupling_metrics: variables: diff --git a/etl/steps/data/garden/covid/latest/ecdc.meta.yml b/etl/steps/data/garden/covid/latest/ecdc.meta.yml index 0b87318e90d..4d5ef16850f 100644 --- a/etl/steps/data/garden/covid/latest/ecdc.meta.yml +++ b/etl/steps/data/garden/covid/latest/ecdc.meta.yml @@ -1,23 +1,18 @@ dataset: title: COVID-2019 - ECDC (2020) description: >- - Raw data on confirmed cases and deaths for all countries is sourced from the - European - Centre for Disease Prevention and Control (ECDC). + Raw data on confirmed cases and deaths for all countries is sourced from the [European Centre for Disease Prevention and + Control (ECDC)](https://www.ecdc.europa.eu/en/publications-data/download-todays-data-geographic-distribution-covid-19-cases-worldwide). - Our complete COVID-19 dataset is a collection of the COVID-19 data maintained - by Our World in Data. It - is updated daily and includes data on confirmed cases, deaths, and - testing. + Our complete COVID-19 dataset is a collection of the COVID-19 data maintained by *Our World in Data*. **It is updated + daily** and includes data on confirmed cases, deaths, and testing. - We have created a new description of all our data sources. You find it at our - GitHub repository here. + We have created a new description of all our data sources. You find it at our GitHub repository **[here](https://github.com/owid/covid-19-data/tree/master/public/data/)**. There you can download all of our data. sources: - name: European CDC – Situation Update Worldwide – Last updated {TODAY} - (London time) url: https://www.ecdc.europa.eu/en/publications-data/download-todays-data-geographic-distribution-covid-19-cases-worldwide published_by: European Centre for Disease Prevention and Control (ECDC) tables: @@ -96,7 +91,7 @@ tables: yearIsDay: true zeroDay: '2020-01-21' case_fatality_rate_of_covid_19__pct__only_observations_with__gte_100_cases: - title: Case fatality rate of COVID-19 (%) (Only observations with ≥100 cases) + title: "Case fatality rate of COVID-19 (%) (Only observations with ≥100 cases)" unit: '%' display: entityAnnotationsMap: |- @@ -318,7 +313,7 @@ tables: yearIsDay: true zeroDay: '2020-01-21' days_since_the_total_confirmed_cases_of_covid_19_reached_100__with_population__gte__5m: - title: Days since the total confirmed cases of COVID-19 reached 100 (with population ≥ 5M) + title: "Days since the total confirmed cases of COVID-19 reached 100 (with population ≥ 5M)" unit: '' display: includeInTable: false @@ -375,7 +370,7 @@ tables: yearIsDay: true zeroDay: '2020-01-21' has_population__gte__5m_and_had__gte_100_cases__gte_21_days_ago_and_has_testing_data: - title: Has population ≥ 5M AND had ≥100 cases ≥21 days ago AND has testing data + title: "Has population ≥ 5M AND had ≥100 cases ≥21 days ago AND has testing data" unit: '' display: yearIsDay: true diff --git a/etl/steps/data/garden/covid/latest/hospital_and_icu.meta.yml b/etl/steps/data/garden/covid/latest/hospital_and_icu.meta.yml index 39b3a43715d..3b74c2b0095 100644 --- a/etl/steps/data/garden/covid/latest/hospital_and_icu.meta.yml +++ b/etl/steps/data/garden/covid/latest/hospital_and_icu.meta.yml @@ -1,21 +1,16 @@ dataset: title: COVID-2019 - Hospital & ICU description: >- - Our hospital & ICU data is collected from official sources and collated by Our - World in Data. The complete list of country-by-country - sources is available on - GitHub. + Our hospital & ICU data is collected from official sources and collated by Our World in Data. The complete list of country-by-country + sources is available [on GitHub](https://github.com/owid/covid-19-data/blob/master/public/data/hospitalizations/locations.csv). - Our complete COVID-19 dataset is a collection of the COVID-19 data maintained - by Our World in Data. It - is updated daily and includes data on confirmed cases, deaths, and - testing. + Our complete COVID-19 dataset is a collection of the COVID-19 data maintained by *Our World in Data*. **It is updated + daily** and includes data on confirmed cases, deaths, and testing. - We have created a new description of all our data sources. You find it at our - GitHub repository here. - There you can download all of our data. + We have created a new description of all our data sources. You find it at our GitHub repository **[here](https://github.com/owid/covid-19-data/tree/master/public/data/)**. + There you can download all of our data. sources: - name: Official data collated by Our World in Data – Last updated {TODAY} url: https://github.com/owid/covid-19-data/tree/master/public/data/hospitalizations diff --git a/etl/steps/data/garden/covid/latest/john_hopkins_university.meta.yml b/etl/steps/data/garden/covid/latest/john_hopkins_university.meta.yml index 7c75545a792..793f4fd6464 100644 --- a/etl/steps/data/garden/covid/latest/john_hopkins_university.meta.yml +++ b/etl/steps/data/garden/covid/latest/john_hopkins_university.meta.yml @@ -1,42 +1,33 @@ dataset: title: COVID-19 - Johns Hopkins University description: >- - Raw data on confirmed cases and deaths for all countries is sourced from the - COVID-19 - Data Repository by the Center for Systems Science and Engineering (CSSE) at - Johns Hopkins University. + Raw data on confirmed cases and deaths for all countries is sourced from the [COVID-19 Data Repository by the Center for + Systems Science and Engineering (CSSE) at Johns Hopkins University](https://github.com/CSSEGISandData/COVID-19). - Our complete COVID-19 dataset is a collection of the COVID-19 data maintained - by Our World in Data. It - is updated daily and includes data on confirmed cases, deaths, hospitalizations, + Our complete COVID-19 dataset is a collection of the COVID-19 data maintained by **Our World in Data** + **It is updated daily** and includes data on confirmed cases, deaths, hospitalizations, and testing. - We have created a new description of all our data sources. You find it at our - GitHub repository here. + We have created a new description of all our data sources. You find it at our GitHub repository **here](https://github.com/owid/covid-19-data/tree/master/public/data** There you can download all of our data. - This data set is licensed under the Creative Commons Attribution 4.0 International - (CC BY 4.0) by Johns Hopkins University + This data set is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) by Johns Hopkins University on behalf of its Center for Systems Science in Engineering. - Attribute the data as the "COVID-19 Data Repository by the Center for Systems - Science and Engineering (CSSE) at Johns + Attribute the data as the "COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University" or "JHU CSSE COVID-19 Data" for short, and the URL: https://github.com/CSSEGISandData/COVID-19. - For publications that use the data, please cite the following publication: "Dong - E, Du H, Gardner L. An interactive - web-based dashboard to track COVID-19 in real-time. Lancet Inf Dis. 20(5):533-534. - DOI: 10.1016/S1473-3099(20)30120-1" + For publications that use the data, please cite the following publication: "Dong E, Du H, Gardner L. An interactive web-based + dashboard to track COVID-19 in real-time. Lancet Inf Dis. 20(5):533-534. DOI: 10.1016/S1473-3099(20)30120-1" sources: - name: Johns Hopkins University CSSE COVID-19 Data url: https://github.com/CSSEGISandData/COVID-19 - published_by: COVID-19 Data Repository by the Center for Systems Science and Engineering - (CSSE) at Johns Hopkins University + published_by: COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University tables: john_hopkins_university: variables: @@ -107,7 +98,7 @@ tables: yearIsDay: true zeroDay: '2020-01-21' case_fatality_rate_of_covid_19__pct__only_observations_with__gte_100_cases: - title: Case fatality rate of COVID-19 (%) (Only observations with ≥100 cases) + title: "Case fatality rate of COVID-19 (%) (Only observations with ≥100 cases)" unit: '%' display: entityAnnotationsMap: '' diff --git a/etl/steps/data/garden/covid/latest/sequencing.meta.yml b/etl/steps/data/garden/covid/latest/sequencing.meta.yml index a1b74c1f4cb..1bd6f545436 100644 --- a/etl/steps/data/garden/covid/latest/sequencing.meta.yml +++ b/etl/steps/data/garden/covid/latest/sequencing.meta.yml @@ -1,33 +1,27 @@ dataset: title: COVID-19 - Sequencing description: >- - Enabled by data from + Enabled by data from [![](https://www.gisaid.org/fileadmin/gisaid/img/schild.png)](https://gisaid.org) - Our data on SARS-CoV-2 sequencing and variants is sourced from GISAID, - a global science - initiative that provides open-access to genomic data of SARS-CoV-2. We recognize - the work of the authors and laboratories - responsible for producing this data and sharing it via the GISAID initiative. + Our data on SARS-CoV-2 sequencing and variants is sourced from [GISAID](https://gisaid.org), a global science initiative + that provides open-access to genomic data of SARS-CoV-2. We recognize the work of the authors and laboratories responsible + for producing this data and sharing it via the GISAID initiative. - Khare, S., et al (2021) GISAID’s Role in Pandemic Response. China CDC Weekly, - 3(49): 1049-1051. doi: 10.46234/ccdcw2021.255 PMCID: - 8668406 + Khare, S., et al (2021) GISAID’s Role in Pandemic Response. China CDC Weekly, 3(49): 1049-1051. doi: 10.46234/ccdcw2021.255 + PMCID: 8668406 - Elbe, S. and Buckland-Merrett, G. (2017) Data, disease and diplomacy: GISAID’s - innovative contribution to global health. - Global Challenges, 1:33-46. doi:10.1002/gch2.1018 PMCID: 31565258 + Elbe, S. and Buckland-Merrett, G. (2017) Data, disease and diplomacy: GISAID’s innovative contribution to global health. + Global Challenges, 1:33-46. doi:10.1002/gch2.1018 PMCID: 31565258 - Shu, Y. and McCauley, J. (2017) GISAID: from vision to reality. EuroSurveillance, - 22(13) doi:10.2807/1560-7917.ES.2017.22.13.30494 + Shu, Y. and McCauley, J. (2017) GISAID: from vision to reality. EuroSurveillance, 22(13) doi:10.2807/1560-7917.ES.2017.22.13.30494 PMCID: PMC5388101 - We download aggregate-level data via CoVariants.org. + We download aggregate-level data via [CoVariants.org](https://covariants.org). sources: - name: GISAID, via CoVariants.org – Last updated {TODAY} url: https://www.gisaid.org/ diff --git a/etl/steps/data/garden/covid/latest/sweden.meta.yml b/etl/steps/data/garden/covid/latest/sweden.meta.yml index 265480ae046..1a74e644d8e 100644 --- a/etl/steps/data/garden/covid/latest/sweden.meta.yml +++ b/etl/steps/data/garden/covid/latest/sweden.meta.yml @@ -1,14 +1,11 @@ dataset: title: COVID-19 - Swedish Public Health Agency description: >- - This data on confirmed COVID-19 deaths is imported directly from the dataset - published by the Swedish Public Health - Agency (Folkhälsomyndigheten). + This data on confirmed COVID-19 deaths is imported directly from the dataset published by the Swedish Public Health Agency + (Folkhälsomyndigheten). - More information on this dataset and the reporting method is available in our - dedicated blog post. + More information on this dataset and the reporting method is available in [our dedicated blog post](https://ourworldindata.org/covid-sweden-death-reporting). sources: - name: Swedish Public Health Agency – Last updated {TODAY} url: https://www.folkhalsomyndigheten.se/smittskydd-beredskap/utbrott/aktuella-utbrott/covid-19/statistik-och-analyser/bekraftade-fall-i-sverige/ diff --git a/etl/steps/data/garden/covid/latest/variants.meta.yml b/etl/steps/data/garden/covid/latest/variants.meta.yml index 7b2aa00bc37..02bdae5299a 100644 --- a/etl/steps/data/garden/covid/latest/variants.meta.yml +++ b/etl/steps/data/garden/covid/latest/variants.meta.yml @@ -5,33 +5,27 @@ default_display: &default_display dataset: title: COVID-19 - Variants description: >- - Enabled by data from + Enabled by data from [![](https://www.gisaid.org/fileadmin/gisaid/img/schild.png)](https://gisaid.org) - Our data on SARS-CoV-2 sequencing and variants is sourced from GISAID, - a global science - initiative that provides open-access to genomic data of SARS-CoV-2. We recognize - the work of the authors and laboratories - responsible for producing this data and sharing it via the GISAID initiative. + Our data on SARS-CoV-2 sequencing and variants is sourced from [GISAID](https://gisaid.org), a global science initiative + that provides open-access to genomic data of SARS-CoV-2. We recognize the work of the authors and laboratories responsible + for producing this data and sharing it via the GISAID initiative. - Khare, S., et al (2021) GISAID’s Role in Pandemic Response. China CDC Weekly, - 3(49): 1049-1051. doi: 10.46234/ccdcw2021.255 PMCID: - 8668406 + Khare, S., et al (2021) GISAID’s Role in Pandemic Response. China CDC Weekly, 3(49): 1049-1051. doi: 10.46234/ccdcw2021.255 + PMCID: 8668406 - Elbe, S. and Buckland-Merrett, G. (2017) Data, disease and diplomacy: GISAID’s - innovative contribution to global health. - Global Challenges, 1:33-46. doi:10.1002/gch2.1018 PMCID: 31565258 + Elbe, S. and Buckland-Merrett, G. (2017) Data, disease and diplomacy: GISAID’s innovative contribution to global health. + Global Challenges, 1:33-46. doi:10.1002/gch2.1018 PMCID: 31565258 - Shu, Y. and McCauley, J. (2017) GISAID: from vision to reality. EuroSurveillance, - 22(13) doi:10.2807/1560-7917.ES.2017.22.13.30494 + Shu, Y. and McCauley, J. (2017) GISAID: from vision to reality. EuroSurveillance, 22(13) doi:10.2807/1560-7917.ES.2017.22.13.30494 PMCID: PMC5388101 - We download aggregate-level data via CoVariants.org. + We download aggregate-level data via [CoVariants.org](https://covariants.org). sources: - name: GISAID, via CoVariants.org – Last updated {TODAY} url: https://www.gisaid.org/ diff --git a/etl/steps/data/garden/demography/2022-12-08/population/meta.yml b/etl/steps/data/garden/demography/2022-12-08/population/meta.yml index 60a80e0adcb..8d6ea8b51f2 100644 --- a/etl/steps/data/garden/demography/2022-12-08/population/meta.yml +++ b/etl/steps/data/garden/demography/2022-12-08/population/meta.yml @@ -12,37 +12,30 @@ dataset: - Gapminder (Systema Globalis): Covers the period 1555-2008. It complements the dataset with former countries and other data points not present in the other sources. For a more detailed description, please refer to the field "source" in table "population". - - version: "2022-12-08" + version: '2022-12-08' sources: &population-sources - - name: Gapminder (2019) - published_by: Gapminder (v6) - url: https://docs.google.com/spreadsheets/d/14_suWY8fCPEXV0MH7ZQMZ-KndzMVsSsA5HdR-7WqAC0/edit#gid=501532268 - date_accessed: October 8, 2021 - - name: UN (2022) - published_by: UN, World Population Prospects (2022) - url: https://population.un.org/wpp/Download/Standard/Population/ - date_accessed: September 10, 2022 - - name: HYDE (2017) - published_by: HYDE (v3.2) - url: https://dataportaal.pbl.nl/downloads/HYDE/ - date_accessed: October 8, 2021 - # the following source contains population for former countries - # after researching where this comes from, conclusion is that - # it comes from Gapminder v3 https://www.gapminder.org/data/documentation/gd003/ - # and is downloadable via button labeled with text: - # "» Download Excel-file with data, including interpolations & detailed meta-data (xlsx)" - - name: Gapminder (Systema Globalis) - published_by: Gapminder (Systema Globalis) - url: https://github.com/open-numbers/ddf--gapminder--systema_globalis - date_accessed: December 12, 2022 + - name: Gapminder (2019) + published_by: Gapminder (v6) + url: https://docs.google.com/spreadsheets/d/14_suWY8fCPEXV0MH7ZQMZ-KndzMVsSsA5HdR-7WqAC0/edit#gid=501532268 + date_accessed: October 8, 2021 + - name: UN (2022) + published_by: UN, World Population Prospects (2022) + url: https://population.un.org/wpp/Download/Standard/Population/ + date_accessed: September 10, 2022 + - name: HYDE (2017) + published_by: HYDE (v3.2) + url: https://dataportaal.pbl.nl/downloads/HYDE/ + date_accessed: October 8, 2021 + - name: Gapminder (Systema Globalis) + published_by: Gapminder (Systema Globalis) + url: https://github.com/open-numbers/ddf--gapminder--systema_globalis + date_accessed: December 12, 2022 tables: population: title: Population (various sources) description: | Our World in Data builds and maintains a long-run dataset on population by country, region, and for the world, based on three key sources: HYDE, Gapminder, and the UN World Population Prospects. - You can find more information on these sources and how our time series is constructed on this page: What sources do we rely on for population estimates? - + You can find more information on these sources and how our time series is constructed on this page: [What sources do we rely on for population estimates?](https://ourworldindata.org/population-sources) variables: population: title: Population @@ -67,8 +60,8 @@ tables: * 1800-1949: Historical estimates by Gapminder. Includes some datapoints from HYDE (v3.2) and Gapminder (Systema Globalis). * 1950-2021: Population records by the United Nations - Population Division (2022). Includes some datapoints from HYDE (v3.2), Gapminder (Systema Globalis) and Gapminder (v6). * 2022-2100: Projections based on Medium variant by the United Nations - Population Division (2022). - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: name: Share of world population includeInTable: true @@ -77,4 +70,4 @@ tables: title: Source description: | Name of the source for a specific data point. The name includes a short name for the source and a link. - unit: "" + unit: '' diff --git a/etl/steps/data/garden/demography/2023-02-03/life_expectancy.meta.yml b/etl/steps/data/garden/demography/2023-02-03/life_expectancy.meta.yml index aaf3a8fcf32..cd736a211cf 100644 --- a/etl/steps/data/garden/demography/2023-02-03/life_expectancy.meta.yml +++ b/etl/steps/data/garden/demography/2023-02-03/life_expectancy.meta.yml @@ -55,257 +55,173 @@ dataset: For continents, we use UN's definitions for values after 1950 and Riley (2005) definitions for values prior to 1950. Note that Riley reports "Americas", while the UN reports "Northern America" and "Latin America and the Caribbean" separately. - SOURCES + **SOURCES** - World Population Prospects - UN (2022) + **World Population Prospects - UN (2022)** World Population Prospects 2022 is the 27th edition of the official estimates and projections of the global population that have been published by the United Nations since 1951. The estimates are based on all available sources of data on population size and levels of fertility, mortality and international migration for 237 countries or areas. More details at https://population.un.org/wpp/Publications/. - Life Tables - Human Mortality Database (2022-11-04) + **Life Tables - Human Mortality Database (2022-11-04)** To facilitate rapid downloads, the database has been organized into zipped data files. Two series of files are intended for different purposes and for different users. For users who want to obtain all available data for an individual country or for all countries, the zipped data files labeled "By country" are recommended. The file organization follows internal practices and is not particularly user-friendly, but all publicly-available HMD data are included in this set.For users who only want information of a given kind for all countries, the files "By statistic" are recommended. In this case the file organization is simpler, but only certain parts of the database (i.e., items labeled "Complete Data Series" on country pages) are available in this format. More details can be found at https://www.mortality.org/Data/ExplanatoryNotes. - Life Expectancy at Birth (Total) - Zijdeman et al. (2015) + **Life Expectancy at Birth (Total) - Zijdeman et al. (2015)** This dataset provides Period Life Expectancy at birth per country and year. The overall aim of the dataset is to cover the entire world for the period 1500-2000. The current version (version 2) was build as part of the OECD "How was life" project. The dataset has nearly global coverage for the post 1950 period, while pre 1950 the coverage decreases the more historic the time period. Depending on sources, the data are annual estimates, 5 yearly or decadel estimates The sources used are: - - UN World Population Project. - - http://www.mortality.org. - - http://www.gapminder.org. - - http://stats.oecd.org. - - Montevideo-Oxford Latin America Economic History Database. - - http://www.ons.gov.uk/ons/datasets-and-tables/index.html. - - http://www.abs.gov.au/ausstats/abs@.nsf/web+pages/statistics?opendocument#from-banner=LN. + - [UN World Population Project](http://esa.un.org/wpp/). + - [Human Mortality Database](http://www.mortality.org). + - [Gapminder](http://www.gapminder.org). + - [OECD](http://stats.oecd.org). + - [Montevideo-Oxford Latin America Economic History Database](http://www.lac.ox.ac.uk/moxlad-database). + - [ONS](http://www.ons.gov.uk/ons/datasets-and-tables/index.html). + - [Australian Bureau of Statistics](http://www.abs.gov.au/ausstats/abs@.nsf/web+pages/statistics?opendocument#from-banner=LN). - Kannisto, V., Nieminen, M. & Turpeinen, O. (1999). Finnish Life Tables since 1751, Demographic Research, 1(1), DOI: 10.4054/DemRes.1999.1.1 Link to paper can be found at https://clio-infra.eu/docs/Total_life_expectancy.docx. - Estimates of Regional and Global Life Expectancy, 1800-2001 - Riley (2005) + **Estimates of Regional and Global Life Expectancy, 1800-2001 - Riley (2005)** Historians and demographers have gone to considerable trouble to reconstruct life expectancy in the past in individual countries. This overview collects information from a large body of that work and links estimates for historical populations to those provided by the United Nations, the World Bank, and other sources for 1950-2001. The result is a picture of regional and global life expectancy at birth for selected years from 1800 to 2001. The bibliography of more than 700 sources is published separately on the web. - version: "2022-11-30" + version: '2022-11-30' licenses: - - *un_license - - *hmd_license - - *zijdeman_license - - *riley_license + - *un_license + - *hmd_license + - *zijdeman_license + - *riley_license sources: - - *un_source - - *hmd_source - - *zijdeman_source - - *riley_source + - *un_source + - *hmd_source + - *zijdeman_source + - *riley_source tables: historical: title: Life Expectancy (various sources) - Historical variables: life_expectancy_0_hist: title: Life expectancy at birth (historical) - description: - "The average number of years that a newborn could expect to live, - if he or she were to pass through life exposed to the sex- and age-specific - death rates prevailing at the time of his or her birth, for a specific year, - in a given country, territory, or geographic area. - - - Definition from the WHO. - - " + description: "The average number of years that a newborn could expect to live, if he or she were to pass through life + exposed to the sex- and age-specific death rates prevailing at the time of his or her birth, for a specific year, + in a given country, territory, or geographic area.\n\nDefinition from the WHO.\n" unit: years short_unit: years sources: - - *un_source - - *zijdeman_source - - *riley_source + - *un_source + - *zijdeman_source + - *riley_source life_expectancy_15_hist: title: Life expectancy at 15 (historical) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 15 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 15 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source life_expectancy_65_hist: title: Life expectancy at 65 (historical) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 65 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 65 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source life_expectancy_80_hist: title: Life expectancy at 80 (historical) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 80 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 80 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source life_expectancy: title: Life Expectancy (various sources) variables: life_expectancy_0: title: Life expectancy at birth - description: - "The average number of years that a newborn could expect to live, - if he or she were to pass through life exposed to the sex- and age-specific - death rates prevailing at the time of his or her birth, for a specific year, - in a given country, territory, or geographic area. - - - Definition from the WHO. - - " + description: "The average number of years that a newborn could expect to live, if he or she were to pass through life + exposed to the sex- and age-specific death rates prevailing at the time of his or her birth, for a specific year, + in a given country, territory, or geographic area.\n\nDefinition from the WHO.\n" unit: years short_unit: years sources: - - *un_source - - *zijdeman_source - - *riley_source + - *un_source + - *zijdeman_source + - *riley_source life_expectancy_15: title: Life expectancy at 15 - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 15 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 15 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source life_expectancy_65: title: Life expectancy at 65 - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 65 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 65 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source life_expectancy_80: title: Life expectancy at 80 - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 80 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 80 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source projection: title: Life Expectancy (various sources) - Projection variables: life_expectancy_0_proj: title: Life expectancy at birth (projection) - description: - "The average number of years that a newborn could expect to live, - if he or she were to pass through life exposed to the sex- and age-specific - death rates prevailing at the time of his or her birth, for a specific year, - in a given country, territory, or geographic area. - - - Definition from the WHO. - - " + description: "The average number of years that a newborn could expect to live, if he or she were to pass through life + exposed to the sex- and age-specific death rates prevailing at the time of his or her birth, for a specific year, + in a given country, territory, or geographic area.\n\nDefinition from the WHO.\n" unit: years short_unit: years sources: - - *un_source + - *un_source life_expectancy_15_proj: title: Life expectancy at 15 (projection) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 15 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 15 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source + - *un_source life_expectancy_65_proj: title: Life expectancy at 65 (projection) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 65 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 65 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source - - *hmd_source + - *un_source + - *hmd_source life_expectancy_80_proj: title: Life expectancy at 80 (projection) - description: - "The average number of remaining years of life expected by a - hypothetical cohort of individuals who already reached age 80 and would - be subject during the remainder of their lives to the mortality rates of - a given period. It is expressed as years. - - - Definition from the UN. - - " + description: "The average number of remaining years of life expected by a hypothetical cohort of individuals who already + reached age 80 and would be subject during the remainder of their lives to the mortality rates of a given period. + It is expressed as years.\n\nDefinition from the UN.\n" unit: years short_unit: years sources: - - *un_source + - *un_source diff --git a/etl/steps/data/garden/demography/2023-03-31/population/meta.yml b/etl/steps/data/garden/demography/2023-03-31/population/meta.yml index 38b3a2cdd76..565d9764627 100644 --- a/etl/steps/data/garden/demography/2023-03-31/population/meta.yml +++ b/etl/steps/data/garden/demography/2023-03-31/population/meta.yml @@ -6,69 +6,71 @@ dataset: • UN WPP (2022): Covers the period 1950-2100. Future projections are based on the Medium variant. - • Gapminder (v7): Mostly covers the period 1800-1949. In addition, it complements the dataset with population data for the - "Vatican" until 2100 (it is missing in UN WPP's estimates). + • Gapminder (v7): Mostly covers the period 1800-1949. In addition, it complements the dataset with population data for + the "Vatican" until 2100 (it is missing in UN WPP's estimates). - • HYDE (v3.2): Mostly covers the period 10,000 BCE - 1799. In addition, it complements the dataset with population for some countries - outside of this year period. E.g. it provides data for "Svalbard and Jan Mayen" (until 2017) and "Netherlands Antilles" (until 2010). + • HYDE (v3.2): Mostly covers the period 10,000 BCE - 1799. In addition, it complements the dataset with population for + some countries outside of this year period. E.g. it provides data for "Svalbard and Jan Mayen" (until 2017) and "Netherlands + Antilles" (until 2010). - • Gapminder (v7): Mostly covers the period 1800-1949. In addition, it complements the dataset with population data for the "Vatican" until 2100 (it is missing in UN WPP's estimates). + • Gapminder (v7): Mostly covers the period 1800-1949. In addition, it complements the dataset with population data for + the "Vatican" until 2100 (it is missing in UN WPP's estimates). • HYDE (v3.2): Mostly covers the period 10,000 BCE - 1799. In addition, it complements the dataset with population for - some countries outside of this year period. E.g. it provides data for "Svalbard and Jan Mayen" (until 2017) and "Netherlands Antilles" (until 2010). + some countries outside of this year period. E.g. it provides data for "Svalbard and Jan Mayen" (until 2017) and "Netherlands + Antilles" (until 2010). - • Gapminder (Systema Globalis): Covers the period 1555-2008. It complements the dataset with former countries and other data points not present in the other sources. + • Gapminder (Systema Globalis): Covers the period 1555-2008. It complements the dataset with former countries and other + data points not present in the other sources. sources: &population-sources - - name: Gapminder (2022) - published_by: Gapminder (v7) - url: https://www.gapminder.org/data/documentation/gd003/ - date_accessed: 2023-03-31 - - name: UN (2022) - published_by: United Nations, World Population Prospects (2022) - url: https://population.un.org/wpp/Download/Standard/Population/ - date_accessed: 2022-09-10 - - name: HYDE (2017) - published_by: HYDE (v3.2) - url: https://dataportaal.pbl.nl/downloads/HYDE/ - date_accessed: 2021-10-08 - # the following source contains population for former countries - # after researching where this comes from, conclusion is that - # it comes from Gapminder v3 https://www.gapminder.org/data/documentation/gd003/ - # and is downloadable via button labeled with text: - # "» Download Excel-file with data, including interpolations & detailed meta-data (xlsx)" - - name: Gapminder (Systema Globalis) - published_by: Gapminder (Systema Globalis) - url: https://github.com/open-numbers/ddf--gapminder--systema_globalis - date_accessed: 2022-12-12 + - name: Gapminder (2022) + published_by: Gapminder (v7) + url: https://www.gapminder.org/data/documentation/gd003/ + date_accessed: 2023-03-31 + - name: UN (2022) + published_by: United Nations, World Population Prospects (2022) + url: https://population.un.org/wpp/Download/Standard/Population/ + date_accessed: 2022-09-10 + - name: HYDE (2017) + published_by: HYDE (v3.2) + url: https://dataportaal.pbl.nl/downloads/HYDE/ + date_accessed: 2021-10-08 + - name: Gapminder (Systema Globalis) + published_by: Gapminder (Systema Globalis) + url: https://github.com/open-numbers/ddf--gapminder--systema_globalis + date_accessed: 2022-12-12 licenses: - - name: Creative Commons BY 4.0 - url: https://docs.google.com/document/d/1-RmthhS2EPMK_HIpnPctcXpB0n7ADSWnXa5Hb3PxNq4/edit?usp=sharing - - name: CC BY 3.0 IGO - url: http://creativecommons.org/licenses/by/3.0/igo/ - - name: CC BY 3.0 - url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt - - name: Creative Commons BY 4.0 - url: https://creativecommons.org/licenses/by/4.0/ + - name: Creative Commons BY 4.0 + url: https://docs.google.com/document/d/1-RmthhS2EPMK_HIpnPctcXpB0n7ADSWnXa5Hb3PxNq4/edit?usp=sharing + - name: CC BY 3.0 IGO + url: http://creativecommons.org/licenses/by/3.0/igo/ + - name: CC BY 3.0 + url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt + - name: Creative Commons BY 4.0 + url: https://creativecommons.org/licenses/by/4.0/ tables: population: title: Population (various sources) description: >- - Our World in Data builds and maintains a long-run dataset on population by country, region, and for the world, based on three key sources: HYDE, Gapminder, and the UN World Population Prospects. - - You can find more information on these sources and how our time series is constructed on this page: What sources do we rely on for population estimates? + Our World in Data builds and maintains a long-run dataset on population by country, region, and for the world, based + on three key sources: HYDE, Gapminder, and the UN World Population Prospects. + You can find more information on these sources and how our time series is constructed on this page: [What sources do we rely on for population estimates?](https://ourworldindata.org/population-sources) variables: population: title: Population description: >- - Population by country, available from 10,000 BCE to 2100 based on Gapminder data, HYDE, and UN Population Division (2022) estimates. + Population by country, available from 10,000 BCE to 2100 based on Gapminder data, HYDE, and UN Population Division + (2022) estimates. • 10,000 BCE - 1799: Historical estimates by HYDE (v3.2). Includes some datapoints from Gapminder (Systema Globalis). - • 1800-1949: Historical estimates by Gapminder. Includes some datapoints from HYDE (v3.2) and Gapminder (Systema Globalis). + • 1800-1949: Historical estimates by Gapminder. Includes some datapoints from HYDE (v3.2) and Gapminder (Systema + Globalis). - • 1950-2021: Population records by the UN World Population Prospects (2022 revision). Includes some datapoints from HYDE (v3.2), Gapminder (Systema Globalis) and Gapminder (v7). + • 1950-2021: Population records by the UN World Population Prospects (2022 revision). Includes some datapoints from + HYDE (v3.2), Gapminder (Systema Globalis) and Gapminder (v7). • 2022-2100: Projections based on Medium variant by the UN World Population Prospects (2022 revision). unit: persons @@ -80,18 +82,21 @@ tables: world_pop_share: title: Share of world population description: >- - Share of the world's population by country, available from 10,000 BCE to 2100 based on Gapminder data, HYDE, and UN Population Division (2022) estimates. + Share of the world's population by country, available from 10,000 BCE to 2100 based on Gapminder data, HYDE, and + UN Population Division (2022) estimates. • 10,000 BCE - 1799: Historical estimates by HYDE (v3.2). Includes some datapoints Gapminder (Systema Globalis). - • 1800-1949: Historical estimates by Gapminder. Includes some datapoints from HYDE (v3.2) and Gapminder (Systema Globalis). + • 1800-1949: Historical estimates by Gapminder. Includes some datapoints from HYDE (v3.2) and Gapminder (Systema + Globalis). - • 1950-2021: Population records by the UN World Population Prospects (2022 revision). Includes some datapoints from HYDE (v3.2), Gapminder (Systema Globalis) and Gapminder (v7). + • 1950-2021: Population records by the UN World Population Prospects (2022 revision). Includes some datapoints from + HYDE (v3.2), Gapminder (Systema Globalis) and Gapminder (v7). • 2022-2100: Projections based on Medium variant by the UN World Population Prospects (2022 revision). - unit: "%" - short_unit: "%" + unit: '%' + short_unit: '%' display: name: Share of world population includeInTable: true @@ -100,4 +105,4 @@ tables: title: Source description: | Name of the source for a specific data point. The name includes a short name for the source and a link. - unit: "" + unit: '' diff --git a/etl/steps/data/garden/ember/2022-08-01/global_electricity_review.meta.yml b/etl/steps/data/garden/ember/2022-08-01/global_electricity_review.meta.yml index f3e2823c3aa..84113c3e653 100644 --- a/etl/steps/data/garden/ember/2022-08-01/global_electricity_review.meta.yml +++ b/etl/steps/data/garden/ember/2022-08-01/global_electricity_review.meta.yml @@ -4,20 +4,19 @@ dataset: title: Global Electricity Review (Ember, 2022) short_name: global_electricity_review description: | - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: + * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on Ember's Global Electricity Review (2022). - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - + - name: Our World in Data based on Ember's Global Electricity Review (2022). + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ tables: capacity: variables: @@ -133,38 +132,38 @@ tables: variables: clean__pct: title: Clean (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Clean fossil__pct: title: Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil gas_and_other_fossil__pct: title: Gas and Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas and Other Fossil hydro__bioenergy_and_other_renewables__pct: title: Hydro, Bioenergy and Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro, Bioenergy and Other Renewables renewables__pct: title: Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables wind_and_solar__pct: title: Wind and Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind and Solar clean__twh: @@ -205,56 +204,56 @@ tables: name: Wind and Solar bioenergy__pct: title: Bioenergy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy coal__pct: title: Coal (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal gas__pct: title: Gas (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro__pct: title: Hydro (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydro nuclear__pct: title: Nuclear (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear other_fossil__pct: title: Other Fossil (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Fossil other_renewables__pct: title: Other Renewables (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other Renewables solar__pct: title: Solar (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar wind__pct: title: Wind (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind bioenergy__twh: diff --git a/etl/steps/data/garden/emdat/2022-11-24/natural_disasters.meta.yml b/etl/steps/data/garden/emdat/2022-11-24/natural_disasters.meta.yml index 3c5e287fdba..2a62358c499 100644 --- a/etl/steps/data/garden/emdat/2022-11-24/natural_disasters.meta.yml +++ b/etl/steps/data/garden/emdat/2022-11-24/natural_disasters.meta.yml @@ -1,78 +1,76 @@ all_sources: - - emdat: &source-emdat - name: EM-DAT, CRED / UCLouvain, Brussels, Belgium - url: https://emdat.be/ - date_accessed: '2022-11-27' - publication_date: '2022-11-24' - publication_year: 2022 - description: &description-emdat | - EM-DAT data includes all categories classified as "natural disasters" (distinguished from technological disasters, such as oil spills and industrial accidents). This includes those from drought, earthquakes, extreme temperatures, extreme weather, floods, fogs, glacial lake outbursts, landslide, dry mass movements, volcanic activity, and wildfires. +- emdat: &source-emdat + name: EM-DAT, CRED / UCLouvain, Brussels, Belgium + url: https://emdat.be/ + date_accessed: '2022-11-27' + publication_date: '2022-11-24' + publication_year: 2022 + description: &description-emdat | + EM-DAT data includes all categories classified as "natural disasters" (distinguished from technological disasters, such as oil spills and industrial accidents). This includes those from drought, earthquakes, extreme temperatures, extreme weather, floods, fogs, glacial lake outbursts, landslide, dry mass movements, volcanic activity, and wildfires. - Disaster-related deaths from EM-DAT have been normalized by Our World in Data to global population size based on different sources. This provides data in terms of cases per 100,000 people. + Disaster-related deaths from EM-DAT have been normalized by Our World in Data to global population size based on [different sources](https://ourworldindata.org/population-sources). This provides data in terms of cases per 100,000 people. - Our World in Data has also calculated economic damage metrics adjusted for gross domestic product (GDP), using GDP data from the World Bank's World Development Indicators. + Our World in Data has also calculated economic damage metrics adjusted for gross domestic product (GDP), using GDP data from [the World Bank's World Development Indicators](http://data.worldbank.org/data-catalog/world-development-indicators). - Latest update: 2022-12-06. - This dataset is updated regularly. On Our World in Data, given that we only show yearly (or decadal) data, we will update this dataset on a yearly basis. At the link above you can directly access the source page and see the latest available data. + Latest update: 2022-12-06. + This dataset is updated regularly. On Our World in Data, given that we only show yearly (or decadal) data, we will update this dataset on a yearly basis. At the link above you can directly access the source page and see the latest available data. - EM-DAT defines the following variables as: + EM-DAT defines the following variables as: - + Affected: People requiring immediate assistance during a period of emergency, i.e. requiring basic survival needs such as food, water, shelter, sanitation and immediate medical assistance. + + Affected: People requiring immediate assistance during a period of emergency, i.e. requiring basic survival needs such as food, water, shelter, sanitation and immediate medical assistance. - + Injured: People suffering from physical injuries, trauma or an illness requiring immediate medical assistance as a direct result of a disaster. + + Injured: People suffering from physical injuries, trauma or an illness requiring immediate medical assistance as a direct result of a disaster. - + Homeless: Number of people whose house is destroyed or heavily damaged and therefore need shelter after an event. + + Homeless: Number of people whose house is destroyed or heavily damaged and therefore need shelter after an event. - + Total affected: In EM-DAT, it is the sum of the injured, affected and left homeless after a disaster. + + Total affected: In EM-DAT, it is the sum of the injured, affected and left homeless after a disaster. - + Estimated economic damage: The amount of damage to property, crops, and livestock. In EM-DAT estimated damage are given in US$ ('000). For each disaster, the registered figure corresponds to the damage value at the moment of the event, i.e. the figures are shown true to the year of the event. + + Estimated economic damage: The amount of damage to property, crops, and livestock. In EM-DAT estimated damage are given in US$ ('000). For each disaster, the registered figure corresponds to the damage value at the moment of the event, i.e. the figures are shown true to the year of the event. - + Total deaths: In EM-DAT, it is the sum of deaths and missing. + + Total deaths: In EM-DAT, it is the sum of deaths and missing. - EM-DAT defines the following types of disasters as: + EM-DAT defines the following types of disasters as: - + Drought: An extended period of unusually low precipitation that produces a shortage of water for people, animals and plants. Drought is different from most other hazards in that it develops slowly, sometimes even over years, and its onset is generally difficult to detect. Drought is not solely a physical phenomenon because its impacts can be exacerbated by human activities and water supply demands. Drought is therefore often defined both conceptually and operationally. Operational definitions of drought, meaning the degree of precipitation reduction that constitutes a drought, vary by locality, climate and environmental sector. + + Drought: An extended period of unusually low precipitation that produces a shortage of water for people, animals and plants. Drought is different from most other hazards in that it develops slowly, sometimes even over years, and its onset is generally difficult to detect. Drought is not solely a physical phenomenon because its impacts can be exacerbated by human activities and water supply demands. Drought is therefore often defined both conceptually and operationally. Operational definitions of drought, meaning the degree of precipitation reduction that constitutes a drought, vary by locality, climate and environmental sector. - + Earthquake: Sudden movement of a block of the Earth's crust along a geological fault and associated ground shaking. + + Earthquake: Sudden movement of a block of the Earth's crust along a geological fault and associated ground shaking. - + Extreme temperature: Extreme temperature. + + Extreme temperature: Extreme temperature. - + Flood: A general term for the overflow of water from a stream channel onto normally dry land in the floodplain (riverine flooding), higher-than-normal levels along the coast and in lakes or reservoirs (coastal flooding) as well as ponding of water at or near the point where the rain fell (flash floods). + + Flood: A general term for the overflow of water from a stream channel onto normally dry land in the floodplain (riverine flooding), higher-than-normal levels along the coast and in lakes or reservoirs (coastal flooding) as well as ponding of water at or near the point where the rain fell (flash floods). - + Fog: Water droplets that are suspended in the air near the Earth's surface. Fog is simply a cloud that is in contact with the ground. + + Fog: Water droplets that are suspended in the air near the Earth's surface. Fog is simply a cloud that is in contact with the ground. - + Glacial lake outburst: A flood that occurs when water dammed by a glacier or moraine is suddenly released. Glacial lakes can be at the front of the glacier (marginal lake) or below the ice sheet (sub-glacial lake). + + Glacial lake outburst: A flood that occurs when water dammed by a glacier or moraine is suddenly released. Glacial lakes can be at the front of the glacier (marginal lake) or below the ice sheet (sub-glacial lake). - + Landslide: Any kind of moderate to rapid soil movement incl. lahar, mudslide, debris flow. A landslide is the movement of soil or rock controlled by gravity and the speed of the movement usually ranges between slow and rapid, but not very slow. It can be superficial or deep, but the materials have to make up a mass that is a portion of the slope or the slope itself. The movement has to be downward and outward with a free face. + + Landslide: Any kind of moderate to rapid soil movement incl. lahar, mudslide, debris flow. A landslide is the movement of soil or rock controlled by gravity and the speed of the movement usually ranges between slow and rapid, but not very slow. It can be superficial or deep, but the materials have to make up a mass that is a portion of the slope or the slope itself. The movement has to be downward and outward with a free face. - + Mass movement: Any type of downslope movement of earth materials. + + Mass movement: Any type of downslope movement of earth materials. - + Extreme weather: Storm. + + Extreme weather: Storm. - + Volcanic activity: A type of volcanic event near an opening/vent in the Earth's surface including volcanic eruptions of lava, ash, hot vapour, gas, and pyroclastic material. + + Volcanic activity: A type of volcanic event near an opening/vent in the Earth's surface including volcanic eruptions of lava, ash, hot vapour, gas, and pyroclastic material. - + Wildfire: Any uncontrolled and non-prescribed combustion or burning of plants in a natural setting such as a forest, grassland, brush land or tundra, which consumes the natural fuels and spreads based on environmental conditions (e.g., wind, topography). Wildfires can be triggered by lightning or human actions. + + Wildfire: Any uncontrolled and non-prescribed combustion or burning of plants in a natural setting such as a forest, grassland, brush land or tundra, which consumes the natural fuels and spreads based on environmental conditions (e.g., wind, topography). Wildfires can be triggered by lightning or human actions. +- wdi: &source-wdi + name: World Development Indicators - World Bank + url: https://datacatalog.worldbank.org/search/dataset/0037712/World-Development-Indicators + date_accessed: '2022-05-26' + publication_year: 2022 + description: &description-wdi | + The World Development Indicators (WDI) is the primary World Bank collection of development indicators, compiled from officially-recognized international sources. It presents the most current and accurate global development data available, and includes national, regional and global estimates. +- population: &source-population + name: Population (Gapminder, HYDE & UN) + description: &description-population | + Population by country, available from 10,000 BCE to 2100, is based on Gapminder data, HYDE, and UN Population Division (2022) estimates. - - wdi: &source-wdi - name: World Development Indicators - World Bank - url: https://datacatalog.worldbank.org/search/dataset/0037712/World-Development-Indicators - date_accessed: '2022-05-26' - publication_year: 2022 - description: &description-wdi | - The World Development Indicators (WDI) is the primary World Bank collection of development indicators, compiled from officially-recognized international sources. It presents the most current and accurate global development data available, and includes national, regional and global estimates. - - population: &source-population - name: Population (Gapminder, HYDE & UN) - description: &description-population | - Population by country, available from 10,000 BCE to 2100, is based on Gapminder data, HYDE, and UN Population Division (2022) estimates. + + 10,000 BCE - 1799: Historical estimates by [HYDE (v3.2)](https://dataportaal.pbl.nl/downloads/HYDE/). - + 10,000 BCE - 1799: Historical estimates by HYDE (v3.2). + + 1800-1949: Historical estimates by [Gapminder (v6)](https://www.gapminder.org/data/documentation/gd003/). - + 1800-1949: Historical estimates by Gapminder (v6). - - + 1950-2021: Population records by the United Nations - Population Division (2022). - - + 2022-2100: Projections based on Medium variant by the United Nations - Population Division (2022). + + 1950-2021: Population records by [the United Nations - Population Division (2022)](https://population.un.org/wpp/Download/Standard/Population/). + + 2022-2100: Projections based on Medium variant by [the United Nations - Population Division (2022)](https://population.un.org/wpp/Download/Standard/Population/). dataset: namespace: emdat short_name: natural_disasters diff --git a/etl/steps/data/garden/emissions/2023-07-10/owid_co2.meta.yml b/etl/steps/data/garden/emissions/2023-07-10/owid_co2.meta.yml index ee1d1cfd50c..5d894bf3eb1 100644 --- a/etl/steps/data/garden/emissions/2023-07-10/owid_co2.meta.yml +++ b/etl/steps/data/garden/emissions/2023-07-10/owid_co2.meta.yml @@ -3,7 +3,7 @@ dataset: description: | OWID CO2 dataset. - This dataset will be loaded by the co2-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the co2-data repository](https://github.com/owid/co2-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' original metadata. diff --git a/etl/steps/data/garden/energy/2022-08-03/electricity_mix.meta.yml b/etl/steps/data/garden/energy/2022-08-03/electricity_mix.meta.yml index a73dec8731f..dadb931b65c 100644 --- a/etl/steps/data/garden/energy/2022-08-03/electricity_mix.meta.yml +++ b/etl/steps/data/garden/energy/2022-08-03/electricity_mix.meta.yml @@ -5,9 +5,9 @@ dataset: short_name: electricity_mix description: | Data is compiled by Our World in Data based on three main sources: - – BP Statistical Review of World Energy. - – Ember Global Electricity Review (2022). - – Ember European Electricity Review (2022). + – [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + – [Ember Global Electricity Review (2022)](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + – [Ember European Electricity Review (2022)](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: – Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -18,16 +18,16 @@ dataset: – IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. – WRI: Annual global capacity data for Other Fossil where other sources are not available. – European carbon intensities rely on data from the European Environment Agency (EEA). - – A complete list of data sources for each individual country in Ember's Global Electricity Review can be found here. - – A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + – A complete list of data sources for each individual country in Ember's Global Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/03/GER22-Methodology.pdf). + – A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on BP as the primary source of electricity consumption data for two reasons. BP provides primary energy (not just electricity) consumption data, and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990). However, BP does not provide data for all countries. So, where data from BP is available for a given country and year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. Our World in Data has converted absolute electricity production by source to the share in the mix by dividing each by total electricity production. - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html#accordion_Regional%20definitions), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -53,33 +53,29 @@ dataset: * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Our World in Data based on Ember's Global Electricity Review (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Our World in Data based on Ember's European Electricity Review (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Our World in Data based on Ember's Global Electricity Review (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Our World in Data based on Ember's European Electricity Review (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: electricity_mix: variables: @@ -91,14 +87,14 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: title: Carbon intensity of electricity (gCO2/kWh) - short_unit: gCO₂ - unit: grams of CO₂ equivalent per kilowatt-hour + short_unit: "gCO₂" + unit: "grams of CO₂ equivalent per kilowatt-hour" display: name: Carbon intensity of electricity per kilowatt-hour coal_generation__twh: @@ -109,8 +105,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -121,8 +117,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -133,8 +129,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -145,8 +141,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -157,14 +153,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -175,8 +171,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -187,8 +183,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -199,8 +195,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -211,8 +207,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -333,8 +329,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -346,8 +342,8 @@ tables: name: Solar solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar total_demand__twh: @@ -358,8 +354,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -388,7 +384,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/data/garden/energy/2022-08-05/owid_energy.meta.yml b/etl/steps/data/garden/energy/2022-08-05/owid_energy.meta.yml index d9ca64de82f..b8a24d32d73 100644 --- a/etl/steps/data/garden/energy/2022-08-05/owid_energy.meta.yml +++ b/etl/steps/data/garden/energy/2022-08-05/owid_energy.meta.yml @@ -6,7 +6,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/data/garden/energy/2022-09-22/uk_historical_electricity.meta.yml b/etl/steps/data/garden/energy/2022-09-22/uk_historical_electricity.meta.yml index 271155c022e..4220084d283 100644 --- a/etl/steps/data/garden/energy/2022-09-22/uk_historical_electricity.meta.yml +++ b/etl/steps/data/garden/energy/2022-09-22/uk_historical_electricity.meta.yml @@ -4,33 +4,28 @@ dataset: title: UK historical electricity short_name: uk_historical_electricity description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). - All other data is sourced from the BP's Statistical Review of World Energy and Ember Global Electricity Review. Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. + All other data is sourced from the [BP's Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [Ember Global Electricity Review](https://ember-climate.org/insights/research/global-electricity-review-2022/). Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. sources: - - - name: Digest of UK Energy Statistics - published_by: UK's Department for Business, Energy & Industrial Strategy - date_accessed: 2022-09-21 - url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data - - - name: BP Statistical Review of World Energy - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Ember's Global Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Ember's European Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Digest of UK Energy Statistics + published_by: UK's Department for Business, Energy & Industrial Strategy + date_accessed: 2022-09-21 + url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data + - name: BP Statistical Review of World Energy + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Ember's Global Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Ember's European Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: uk_historical_electricity: variables: diff --git a/etl/steps/data/garden/energy/2022-12-12/electricity_mix.meta.yml b/etl/steps/data/garden/energy/2022-12-12/electricity_mix.meta.yml index f07b1cdf169..6ae0f8fbbc7 100644 --- a/etl/steps/data/garden/energy/2022-12-12/electricity_mix.meta.yml +++ b/etl/steps/data/garden/energy/2022-12-12/electricity_mix.meta.yml @@ -5,9 +5,9 @@ dataset: short_name: electricity_mix description: | Data is compiled by Our World in Data based on three main sources: - - BP Statistical Review of World Energy. - - Ember Global Electricity Review (2022). - - Ember European Electricity Review (2022). + - [BP Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html). + - [Ember Global Electricity Review (2022)](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + - [Ember European Electricity Review (2022)](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: - Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -18,16 +18,16 @@ dataset: - IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. - WRI: Annual global capacity data for Other Fossil where other sources are not available. - European carbon intensities rely on data from the European Environment Agency (EEA). - - A complete list of data sources for each individual country in Ember's Global Electricity Review can be found here. - - A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + - A complete list of data sources for each individual country in Ember's Global Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/03/GER22-Methodology.pdf). + - A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on Ember as the primary source of electricity consumption data. While BP provides primary energy (not just electricity) consumption data and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990), BP does not provide data for all countries or for all sources of electricity (for example, only Ember provides data on electricity from bioenergy). So, where data from Ember is available for a given country and year, we rely on it as the primary source. We then supplement this with data from BP where data from Ember is not available. Our World in Data has converted absolute electricity production by source to the share in the mix by dividing each by total electricity production. - BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with our region definitions). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. + BP's region definitions sometimes differ from Our World in Data's definitions. For example, BP's North America includes only Canada, Mexico and United States, whereas Our World in Data's North America includes countries in Central America (see a map with [our region definitions](https://ourworldindata.org/world-region-map-definitions)). For this reason, we include in the dataset regions like "North America (BP)" to refer to BP's original data using their definition of the region, as well as "North America", which is data aggregated by Our World in Data using our definition. These aggregates are constructed by adding up (when possible) the contributions from the countries in the region. - BP's region definitions, denoted with "(BP)", are: + [BP's region definitions](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy/using-the-review/definitions-and-explanatory-notes.html), denoted with "(BP)", are: * "Asia Pacific (BP)": Brunei, Cambodia, China (Mainland), China Hong Kong SAR (Special Administrative Region), China Macau SAR (Special Administrative Region), Indonesia, Japan, Laos, Malaysia, Mongolia, North Korea, Philippines, Singapore, South Asia (Afghanistan, Bangladesh, India, Myanmar, Nepal, Pakistan and Sri Lanka), South Korea, Taiwan, Thailand, Vietnam, Australia, New Zealand, Papua New Guinea and Oceania. * "Australasia (BP)": Australia, New Zealand. * "CIS (BP)" - Commonwealth of Independent States: Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Moldova, Russian Federation, Tajikistan, Turkmenistan, Uzbekistan. @@ -53,33 +53,29 @@ dataset: * "North America" - All North American countries + "Other Caribbean (BP)" + "Other North America (BP)". * "Oceania" - All Oceanian countries. * "South America" - All South American countries + "Other South America (BP)". - Where the individual countries in each region are defined in this map. Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions in this map. + Where the individual countries in each region are defined [in this map](https://ourworldindata.org/world-region-map-definitions). Additional BP regions are ignored, since they belong to other regions already included (e.g. the data for "Other Western Africa (BP)" is included in "Other Africa (BP)"). Finally, income groups are constructed following the definitions [in this map](https://ourworldindata.org/grapher/world-banks-income-groups). - Ember's region definitions, denoted with "(Ember)", are: + [Ember's region definitions](https://ember-climate.org/countries-and-regions/), denoted with "(Ember)", are: * "G20 (Ember)" - Group of Twenty: Argentina, Australia, Brazil, Canada, China, France, Germany, India, Indonesia, Italy, Japan, Mexico, Russia, Saudi Arabia, South Africa, South Korea, Turkey, United Kingdom, United States and the 27 members of the European Union. * "G7 (Ember)" - Group of Seven: Canada, France, Germany, Italy, Japan, United Kingdom and United States. * "Latin America and Caribbean (Ember)": Antigua and Barbuda, Argentina, Bahamas, Barbados, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Grenada, Guatemala, Guyana, Haiti, Honduras, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Peru, Saint Kitts and Nevis, Saint Lucia, Saint Vincent and the Grenadines, Suriname, Trinidad and Tobago, Uruguay, Venezuela, Aruba, British Virgin Islands, Cayman Islands, Falkland Islands, French Guiana, Guadeloupe, Martinique, Montserrat, Puerto Rico, Turks and Caicos Islands and United States Virgin Islands. * "Middle East (Ember)": Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Lebanon, Oman, Palestine, Qatar, Saudi Arabia, Syria, United Arab Emirates and Yemen. * "OECD (Ember)" - Organization For Economic Co-operation and Development: Austria, Belgium, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Netherlands, Norway, Poland, Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey, United Kingdom, Australia, Canada, Chile, Colombia, Israel, Japan, Mexico, New Zealand, South Korea, and United States. sources: - - - name: Our World in Data based on BP Statistical Review of World Energy (2022) - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Our World in Data based on Ember's Global Electricity Review (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Our World in Data based on Ember's European Electricity Review (2022) - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Our World in Data based on BP Statistical Review of World Energy (2022) + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Our World in Data based on Ember's Global Electricity Review (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Our World in Data based on Ember's European Electricity Review (2022) + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: electricity_mix: variables: @@ -91,8 +87,8 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: @@ -109,8 +105,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -121,8 +117,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -133,8 +129,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -145,8 +141,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -157,14 +153,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -175,8 +171,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -187,8 +183,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -199,8 +195,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -211,8 +207,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -333,8 +329,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -346,8 +342,8 @@ tables: name: Solar solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar total_demand__twh: @@ -358,8 +354,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -388,7 +384,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/data/garden/energy/2022-12-12/owid_energy.meta.yml b/etl/steps/data/garden/energy/2022-12-12/owid_energy.meta.yml index f52e2076000..a84a897820c 100644 --- a/etl/steps/data/garden/energy/2022-12-12/owid_energy.meta.yml +++ b/etl/steps/data/garden/energy/2022-12-12/owid_energy.meta.yml @@ -6,7 +6,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/data/garden/energy/2022-12-12/uk_historical_electricity.meta.yml b/etl/steps/data/garden/energy/2022-12-12/uk_historical_electricity.meta.yml index abf95853857..066f70c48cb 100644 --- a/etl/steps/data/garden/energy/2022-12-12/uk_historical_electricity.meta.yml +++ b/etl/steps/data/garden/energy/2022-12-12/uk_historical_electricity.meta.yml @@ -4,33 +4,28 @@ dataset: title: UK historical electricity (DUKES, 2022) short_name: uk_historical_electricity description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). - All other data is sourced from the BP's Statistical Review of World Energy and Ember Global Electricity Review. Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. + All other data is sourced from the [BP's Statistical Review of World Energy](https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html) and [Ember Global Electricity Review](https://ember-climate.org/insights/research/global-electricity-review-2022/). Where data from BP is available for a given year, we rely on it as the primary source. We then supplement this with data from Ember where data from BP is not available. sources: - - - name: Digest of UK Energy Statistics - published_by: UK's Department for Business, Energy & Industrial Strategy - date_accessed: 2022-09-21 - url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data - - - name: BP Statistical Review of World Energy - published_by: BP Statistical Review of World Energy - date_accessed: 2022-07-08 - url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html - - - name: Ember's Global Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ - - - name: Ember's European Electricity Review - published_by: Ember - publication_year: 2022 - date_accessed: 2022-08-01 - url: https://ember-climate.org/insights/research/european-electricity-review-2022/ - + - name: Digest of UK Energy Statistics + published_by: UK's Department for Business, Energy & Industrial Strategy + date_accessed: 2022-09-21 + url: https://www.gov.uk/government/statistical-data-sets/historical-electricity-data + - name: BP Statistical Review of World Energy + published_by: BP Statistical Review of World Energy + date_accessed: 2022-07-08 + url: https://www.bp.com/en/global/corporate/energy-economics/statistical-review-of-world-energy.html + - name: Ember's Global Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/data-catalogue/yearly-electricity-data/ + - name: Ember's European Electricity Review + published_by: Ember + publication_year: 2022 + date_accessed: 2022-08-01 + url: https://ember-climate.org/insights/research/european-electricity-review-2022/ tables: uk_historical_electricity: variables: diff --git a/etl/steps/data/garden/energy/2023-07-10/electricity_mix.meta.yml b/etl/steps/data/garden/energy/2023-07-10/electricity_mix.meta.yml index fa04c0e663b..771ef29a370 100644 --- a/etl/steps/data/garden/energy/2023-07-10/electricity_mix.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/electricity_mix.meta.yml @@ -2,9 +2,9 @@ dataset: title: Electricity mix (EI & Ember, 2023) description: | Data is compiled by Our World in Data based on three main sources: - - The Energy Institute (EI) Statistical Review of World Energy. - - Ember Yearly Electricity Data. - - Ember European Electricity Review. + - [The Energy Institute (EI) Statistical Review of World Energy](https://www.energyinst.org/statistical-review). + - [Ember Yearly Electricity Data](https://ember-climate.org/data-catalogue/yearly-electricity-data/). + - [Ember European Electricity Review](https://ember-climate.org/insights/research/european-electricity-review-2022/). Ember compile their global dataset from various sources including: - Eurostat: Annual European generation and import data, and monthly data in some cases where better sources are not available. @@ -15,11 +15,10 @@ dataset: - IRENA: Annual global capacity data for all non-fossil fuel types, and for Other Fossil where available. - WRI: Annual global capacity data for Other Fossil where other sources are not available. - European carbon intensities rely on data from the European Environment Agency (EEA). - - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found here. - - A complete list of data sources for each individual country in Ember's European Electricity Review can be found here. + - A complete list of data sources for each individual country in Ember's Yearly Electricity Data can be found [here](https://ember-climate.org/app/uploads/2022/07/Ember-Electricity-Data-Methodology.pdf). + - A complete list of data sources for each individual country in Ember's European Electricity Review can be found [here](https://ember-climate.org/app/uploads/2022/02/EER-Methodology.pdf). We rely on Ember as the primary source of electricity consumption data. While EI provides primary energy (not just electricity) consumption data and it provides a longer time-series (dating back to 1965) than Ember (which only dates back to 1990), EI does not provide data for all countries or for all sources of electricity (for example, only Ember provides data on electricity from bioenergy). So, where data from Ember is available for a given country and year, we rely on it as the primary source. We then supplement this with data from EI where data from Ember is not available. - tables: electricity_mix: variables: @@ -31,8 +30,8 @@ tables: name: Bioenergy bioenergy_share_of_electricity__pct: title: Bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Bioenergy co2_intensity__gco2_kwh: @@ -49,8 +48,8 @@ tables: name: Coal coal_share_of_electricity__pct: title: Coal (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Coal fossil_generation__twh: @@ -61,8 +60,8 @@ tables: name: Fossil fuels fossil_share_of_electricity__pct: title: Fossil fuels (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Fossil fuels gas_generation__twh: @@ -73,8 +72,8 @@ tables: name: Gas gas_share_of_electricity__pct: title: Gas (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Gas hydro_generation__twh: @@ -85,8 +84,8 @@ tables: name: Hydropower hydro_share_of_electricity__pct: title: Hydro (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Hydropower low_carbon_generation__twh: @@ -97,14 +96,14 @@ tables: name: Low-carbon electricity low_carbon_share_of_electricity__pct: title: Low-carbon electricity (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Share of electricity from low-carbon sources net_imports_share_of_demand__pct: title: Net electricity imports as a share of demand (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Net electricity imports as a share of demand nuclear_generation__twh: @@ -115,8 +114,8 @@ tables: name: Nuclear nuclear_share_of_electricity__pct: title: Nuclear (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Nuclear oil_generation__twh: @@ -127,8 +126,8 @@ tables: name: Oil oil_share_of_electricity__pct: title: Oil (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Oil other_renewables_excluding_bioenergy_generation__twh: @@ -139,8 +138,8 @@ tables: name: Other renewables, excluding bioenergy other_renewables_excluding_bioenergy_share_of_electricity__pct: title: Other renewables excluding bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, excluding bioenergy other_renewables_including_bioenergy_generation__twh: @@ -151,8 +150,8 @@ tables: name: Other renewables, including bioenergy other_renewables_including_bioenergy_share_of_electricity__pct: title: Other renewables including bioenergy (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Other renewables, including bioenergy per_capita_bioenergy_generation__kwh: @@ -280,8 +279,8 @@ tables: name: Renewables renewable_share_of_electricity__pct: title: Renewables (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Renewables numDecimalPlaces: 2 @@ -299,14 +298,14 @@ tables: name: Solar and wind solar_share_of_electricity__pct: title: Solar (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar solar_and_wind_share_of_electricity__pct: title: Solar and wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Solar and wind total_demand__twh: @@ -317,8 +316,8 @@ tables: name: Electricity demand total_electricity_share_of_primary_energy__pct: title: Electricity as share of primary energy (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Electricity as share of primary energy total_emissions__mtco2: @@ -347,7 +346,7 @@ tables: name: Wind wind_share_of_electricity__pct: title: Wind (% electricity) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Wind diff --git a/etl/steps/data/garden/energy/2023-07-10/energy_mix.meta.yml b/etl/steps/data/garden/energy/2023-07-10/energy_mix.meta.yml index 9aaa423cf00..0224bb616ed 100644 --- a/etl/steps/data/garden/energy/2023-07-10/energy_mix.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/energy_mix.meta.yml @@ -1,7 +1,7 @@ dataset: title: Energy mix (Energy Institute, 2023) description: | - Raw data on energy consumption is sourced from the Energy Institute Statistical Review of World Energy. + Raw data on energy consumption is sourced from [the Energy Institute Statistical Review of World Energy](https://www.energyinst.org/statistical-review). Primary energy in exajoules (EJ) has been converted to TWh by Our World in Data based on a conversion factor of 1,000,000 / 3,600 (~277.778). @@ -9,11 +9,11 @@ dataset: Also, for non-fossil based electricity, there are two ways to define primary energy: * One is "direct primary energy", which corresponds to electricity generation (in TWh). * The other is "input-equivalent primary energy" (also called "primary energy using the substitution method"). - This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in the Statistical Review methodology document. For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. + This is the amount of fuel that would be required by thermal power stations to generate the reported electricity, as explained in [the Statistical Review methodology document](https://www.energyinst.org/__data/assets/pdf_file/0003/1055541/Methodology.pdf). For example, if a country's nuclear power generated 100 TWh of electricity, and assuming that the efficiency of a standard thermal power plant is 38%, the input equivalent primary energy for this country would be 100 TWh / 0.38 = 263 TWh = 0.95 EJ. This input-equivalent primary energy takes account of the inefficiencies in fossil fuel production and provides a better approximation of each source's share of "final energy" consumption. Additional metrics have been calculated by Our World in Data: - Annual change in energy consumption by source: this is calculated as the difference from the previous year. - % of total primary energy: calculated as each source's share of primary energy (direct energy and primary energy using the substitution method) from all sources. - Per capita energy by source: calculated as primary energy consumption by source, divided by population. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). diff --git a/etl/steps/data/garden/energy/2023-07-10/fossil_fuel_production.meta.yml b/etl/steps/data/garden/energy/2023-07-10/fossil_fuel_production.meta.yml index a0a1cb0c2d8..4ddf41f4508 100644 --- a/etl/steps/data/garden/energy/2023-07-10/fossil_fuel_production.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/fossil_fuel_production.meta.yml @@ -1,7 +1,7 @@ dataset: title: Fossil fuel production (EI & Shift, 2023) description: | - This dataset on fossil fuel production is generated by combining the latest data from the Energy Institute Statistical Review of World Energy and The Shift Dataportal. + This dataset on fossil fuel production is generated by combining the latest data from [the Energy Institute Statistical Review of World Energy](https://www.energyinst.org/statistical-review) and [The Shift Dataportal](https://www.theshiftdataportal.org/energy). The Energy Institute provides fossil fuel production data from 1965 onwards (and crude prices from 1861 onwards). The Shift Dataportal provides long-term data from 1900, but only extends to 2016. @@ -9,86 +9,85 @@ dataset: We have converted primary production in exajoules to terawatt-hours using the conversion factor: 1,000,000 / 3,600 ~ 278. - Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. - + Production per capita has been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). tables: fossil_fuel_production: variables: annual_change_in_coal_production__pct: - title: "Annual change in coal production (%)" - short_unit: "%" - unit: "%" + title: Annual change in coal production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_coal_production__twh: - title: "Annual change in coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in coal production" + name: Annual change in coal production annual_change_in_gas_production__pct: - title: "Annual change in gas production (%)" - short_unit: "%" - unit: "%" + title: Annual change in gas production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_gas_production__twh: - title: "Annual change in gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in gas production" + name: Annual change in gas production annual_change_in_oil_production__pct: - title: "Annual change in oil production (%)" - short_unit: "%" - unit: "%" + title: Annual change in oil production (%) + short_unit: '%' + unit: '%' display: - name: "Annual change in oil production" + name: Annual change in oil production annual_change_in_oil_production__twh: - title: "Annual change in oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Annual change in oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Annual change in oil production" + name: Annual change in oil production coal_production__twh: - title: "Coal production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Coal production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Coal production" + name: Coal production numDecimalPlaces: 0 coal_production_per_capita__kwh: - title: "Coal production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Coal production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Coal production per capita" + name: Coal production per capita numDecimalPlaces: 0 gas_production__twh: - title: "Gas production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Gas production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Gas production" + name: Gas production numDecimalPlaces: 0 gas_production_per_capita__kwh: - title: "Gas production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Gas production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Gas production per capita" + name: Gas production per capita numDecimalPlaces: 0 oil_production__twh: - title: "Oil production (TWh)" - short_unit: "TWh" - unit: "terawatt-hours" + title: Oil production (TWh) + short_unit: TWh + unit: terawatt-hours display: - name: "Oil production" + name: Oil production numDecimalPlaces: 0 oil_production_per_capita__kwh: - title: "Oil production per capita (kWh)" - short_unit: "kWh" - unit: "kilowatt-hours" + title: Oil production per capita (kWh) + short_unit: kWh + unit: kilowatt-hours display: - name: "Oil production per capita" + name: Oil production per capita numDecimalPlaces: 0 diff --git a/etl/steps/data/garden/energy/2023-07-10/owid_energy.meta.yml b/etl/steps/data/garden/energy/2023-07-10/owid_energy.meta.yml index 4ec4e2531c0..d41f5cfd76c 100644 --- a/etl/steps/data/garden/energy/2023-07-10/owid_energy.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/owid_energy.meta.yml @@ -3,7 +3,7 @@ dataset: description: | OWID Energy dataset. - This dataset will be loaded by the energy-data repository, to create a csv file of the dataset that can be downloaded in one click. + This dataset will be loaded by [the energy-data repository](https://github.com/owid/energy-data), to create a csv file of the dataset that can be downloaded in one click. # Dataset sources will be created in the step by combining all component datasets' sources. # Also, table metadata will be built from the tables' metadata and the content of owid_energy_variable_mapping.csv. diff --git a/etl/steps/data/garden/energy/2023-07-10/photovoltaic_cost_and_capacity.meta.yml b/etl/steps/data/garden/energy/2023-07-10/photovoltaic_cost_and_capacity.meta.yml index 953e91cdde3..4b63e0f1f5b 100644 --- a/etl/steps/data/garden/energy/2023-07-10/photovoltaic_cost_and_capacity.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/photovoltaic_cost_and_capacity.meta.yml @@ -7,21 +7,20 @@ dataset: Photovoltaic cost data between 2004 and 2009 has been taken from Farmer & Lafond (2016). - According to Farmer & Lafond (2016), the data are mostly taken from the Santa-Fe Performance Curve DataBase, accessible at pcdb.santafe.edu. The database has been constructed from personal communications and from Colpier and Cornland (2002), Goldemberg et al. (2004), Lieberman (1984), Lipman and Sperling (1999), Zhao (1999), McDonald and Schrattenholzer (2001), Neij et al. (2003), Moore (2006), Nemet (2006), Schilling and Esmundo (2009). The data on photovoltaic prices has been collected from public releases of Strategies Unlimited, Navigant and SPV Market Research. The data on nuclear energy is from Koomey and Hultman (2007) and Cooper (2009). The DNA sequencing data is from Wetterstrand (2015) (cost per human-size genome), and for each year the last available month (September for 2001-2002 and October afterwards) was taken and corrected for inflation using the US GDP deflator. + According to Farmer & Lafond (2016), the data are mostly taken from the [Santa-Fe Performance Curve DataBase](https://pcdb.santafe.edu/). The database has been constructed from personal communications and from [Colpier and Cornland (2002)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0095), [Goldemberg et al. (2004)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0130), [Lieberman (1984)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0180), [Lipman and Sperling (1999)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0190), [Zhao (1999)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0310), [McDonald and Schrattenholzer (2001)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0205), [Neij et al. (2003)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0235), [Moore (2006)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0215), [Nemet (2006)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0240), [Schilling and Esmundo (2009)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0265). The data on photovoltaic prices has been collected from public releases of Strategies Unlimited, Navigant and SPV Market Research. The data on nuclear energy is from [Koomey and Hultman (2007)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0165) and [Cooper (2009)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0100). The DNA sequencing data is from [Wetterstrand (2015)](https://www.sciencedirect.com/science/article/pii/S0048733315001699#bib0290) (cost per human-size genome), and for each year the last available month (September for 2001-2002 and October afterwards) was taken and corrected for inflation using the US GDP deflator. Prices from Farmer & Lafond (2016) have been converted to 2021 US$ using the US GDP deflator: https://www.multpl.com/gdp-deflator/table/by-year Photovoltaic capacity data between 2004 and 2021 has been taken from IRENA. Photovoltaic cost data between 2010 and 2021 has been taken from IRENA. - tables: photovoltaic_cost_and_capacity: variables: cost: title: Solar photovoltaic module price - short_unit: '$/W' - unit: '2021 US$ per Watt' + short_unit: $/W + unit: 2021 US$ per Watt description: | Global average price of solar photovoltaic modules. @@ -34,8 +33,8 @@ tables: title: Solar photovoltaic cumulative capacity description: | Global cumulative capacity of solar photovoltaics. - short_unit: 'MW' - unit: 'megawatts' + short_unit: MW + unit: megawatts cumulative_capacity_source: title: Data source for cumulative capacity data unit: '' diff --git a/etl/steps/data/garden/energy/2023-07-10/primary_energy_consumption.meta.yml b/etl/steps/data/garden/energy/2023-07-10/primary_energy_consumption.meta.yml index 3634d9b5e35..99ae06e4109 100644 --- a/etl/steps/data/garden/energy/2023-07-10/primary_energy_consumption.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/primary_energy_consumption.meta.yml @@ -2,22 +2,21 @@ dataset: title: Primary energy consumption (EI & EIA, 2023) description: | Primary energy consumption data was compiled by Our World in Data based on two key data sources: - 1. Energy Institute (EI) Statistical Review of World Energy. - 2. International energy data from the U.S. Energy Information Administration (EIA). + 1. [Energy Institute (EI) Statistical Review of World Energy](https://www.energyinst.org/statistical-review). + 2. [International energy data from the U.S. Energy Information Administration (EIA)](https://www.eia.gov/international/data/world/total-energy/more-total-energy-data). EI provides the longest and most up-to-date time-series of primary energy. However, it does not provide data for all countries. We have therefore supplemented this dataset with energy data from the EIA. Where EI provides data for a given country, this data is adopted; for countries where this data is missing, we rely on EIA energy figures. - Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on different sources. - - To calculate energy per unit of GDP, we use total real GDP figures from the Maddison Project Database, version 2020. + Per capita figures have been calculated using a population dataset that is built and maintained by Our World in Data, based on [different sources](https://ourworldindata.org/population-sources). + To calculate energy per unit of GDP, we use total real GDP figures from [the Maddison Project Database, version 2020](https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020). tables: primary_energy_consumption: variables: annual_change_in_primary_energy_consumption__pct: title: Annual change in primary energy consumption (%) - short_unit: "%" - unit: "%" + short_unit: '%' + unit: '%' display: name: Annual change in primary energy consumption annual_change_in_primary_energy_consumption__twh: @@ -30,7 +29,9 @@ tables: title: GDP short_unit: $ unit: 2011 int-$ - description: Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. + description: >- + Gross domestic product measured in international-$ using 2011 prices to adjust for price changes over + time (inflation) and price differences between countries. Calculated by multiplying GDP per capita with population. display: numDecimalPlaces: 0 population: diff --git a/etl/steps/data/garden/energy/2023-07-10/uk_historical_electricity.meta.yml b/etl/steps/data/garden/energy/2023-07-10/uk_historical_electricity.meta.yml index 515249c7019..d5922e00800 100644 --- a/etl/steps/data/garden/energy/2023-07-10/uk_historical_electricity.meta.yml +++ b/etl/steps/data/garden/energy/2023-07-10/uk_historical_electricity.meta.yml @@ -1,10 +1,9 @@ dataset: title: UK historical electricity (DUKES, 2023c) description: | - All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy. - - All other data is sourced from the the Energy Institute (EI) Statistical Review of World Energy and Ember's Yearly Electricity Data. Where data from Ember is available for a given year, we rely on it as the primary source. We then supplement this with data from EI where data from Ember is not available. + All data prior to 1985 (and prior to 1965 in the case of renewables), is sourced from [the Digest of UK Energy Statistics (DUKES), published by the UK's Department for Business, Energy & Industrial Strategy](https://www.gov.uk/government/statistics/electricity-chapter-5-digest-of-united-kingdom-energy-statistics-dukes). + All other data is sourced from the [the Energy Institute (EI) Statistical Review of World Energy](https://www.energyinst.org/statistical-review) and [Ember's Yearly Electricity Data](https://ember-climate.org/data-catalogue/yearly-electricity-data/). Where data from Ember is available for a given year, we rely on it as the primary source. We then supplement this with data from EI where data from Ember is not available. tables: uk_historical_electricity: variables: diff --git a/etl/steps/data/garden/eth/2023-03-15/ethnic_power_relations.meta.yml b/etl/steps/data/garden/eth/2023-03-15/ethnic_power_relations.meta.yml index 51176b6b57c..e1eaa51406a 100644 --- a/etl/steps/data/garden/eth/2023-03-15/ethnic_power_relations.meta.yml +++ b/etl/steps/data/garden/eth/2023-03-15/ethnic_power_relations.meta.yml @@ -15,53 +15,44 @@ all_sources: description: The ACD2EPR 2021 dataset links ACD (Armed Conflict Database) 20.1 conflicts to Ethnic Power Relations-Core 2021 groups. definitions: - - ethnic_group: - description: &description_ethnic_group | - The Ethnic Power Relations dataset defines ethnicity as any subjectively experienced sense of commonality based on the belief in common ancestry and shared culture. Given this definition, an ethnic group (i.e. a group of individuals sharing a common ethnicity) is included in the EPR Core dataset if it is politically relevant at least once in the sample period. An ethnic group is classified as politically relevant if at least one political organization claims to represent it in national politics or if its members are subjected to state-led political discrimination. - - group_relevance: &description_group_relevance | - An ethnic group is deemed relevant in a given group-year if at least one political organization claims to represent it in national politics or if its members are subjected to state-led political discrimination. - - egip: - description: &description_egip | - An ethnic group in power (EGIP) is a politically relevant ethnic group which has access to power, in one of these options: -