Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔨 archive datasets (lucas) #3551

Merged
merged 4 commits into from
Nov 18, 2024
Merged

🔨 archive datasets (lucas) #3551

merged 4 commits into from
Nov 18, 2024

Conversation

lucasrodes
Copy link
Member

@lucasrodes lucasrodes commented Nov 18, 2024

ref: https://github.com/owid/owid-issues/issues/1740

Archive datasets no longer in use:

  • fasttrack/2023-06-19/world_population_comparison
  • countries/2023-10-01/gleditsch
  • fasttrack/latest/democracy_lexical_index

@owidbot
Copy link
Contributor

owidbot commented Nov 18, 2024

Quick links (staging server):

Site Admin Wizard Docs

Login: ssh owid@staging-site-archive-datasets-lucas

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences
= Dataset garden/harvard/2024-07-22/global_military_spending_dataset
  = Table global_military_spending_dataset
= Dataset garden/war/2023-09-21/prio_v31
  = Table prio_v31_country
  = Table prio_v31
    ~ Column number_deaths_ongoing_conflicts_battle_high_per_capita (changed metadata, changed data)
-       -     attribution: Population based on various sources (2023)
        ?                                                          ^
+       +     attribution: Population based on various sources (2024)
        ?                                                          ^
-       -     date_accessed: '2023-03-31'
        ?                        ^  ^ ^
+       +     date_accessed: '2024-07-11'
        ?                        ^  ^ ^
-       -     date_published: '2023-03-31'
        ?                         ^  ^ -
+       +     date_published: '2024-07-15'
        ?                         ^  ^  +
+       +       url: https://creativecommons.org/licenses/by/4.0/
-       -   - name: CC BY 3.0
-       -     url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt
-       -   - name: CC BY 3.0 IGO
-       -     url: http://creativecommons.org/licenses/by/3.0/igo/

        ~ Changed values: 1345 / 2268 (59.30%)
           year             region                      conflict_type  number_deaths_ongoing_conflicts_battle_high_per_capita -  number_deaths_ongoing_conflicts_battle_high_per_capita +
           1966    Americas (PRIO)                         intrastate                                                  0.104670                                                  0.103403
           1970              World                      extrasystemic                                                  0.318808                                                  0.318850
           2003      Europe (PRIO)                                all                                                  0.336163                                                  0.334853
           2004      Africa (PRIO)     intrastate (internationalized)                                                  0.060902                                                  0.060024
           2007 Middle East (PRIO) intrastate (non-internationalized)                                                  0.373903                                                  0.371507
    ~ Column number_deaths_ongoing_conflicts_battle_low_per_capita (changed metadata, changed data)
-       -     attribution: Population based on various sources (2023)
        ?                                                          ^
+       +     attribution: Population based on various sources (2024)
        ?                                                          ^
-       -     date_accessed: '2023-03-31'
        ?                        ^  ^ ^
+       +     date_accessed: '2024-07-11'
        ?                        ^  ^ ^
-       -     date_published: '2023-03-31'
        ?                         ^  ^ -
+       +     date_published: '2024-07-15'
        ?                         ^  ^  +
+       +       url: https://creativecommons.org/licenses/by/4.0/
-       -   - name: CC BY 3.0
-       -     url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt
-       -   - name: CC BY 3.0 IGO
-       -     url: http://creativecommons.org/licenses/by/3.0/igo/

        ~ Changed values: 1342 / 2268 (59.17%)
           year                  region                      conflict_type  number_deaths_ongoing_conflicts_battle_low_per_capita -  number_deaths_ongoing_conflicts_battle_low_per_capita +
           1961         Americas (PRIO)     intrastate (internationalized)                                                 0.066430                                                 0.065826
           1971      Middle East (PRIO)                                all                                                 0.017774                                                 0.017863
           1972                   World intrastate (non-internationalized)                                                 0.155191                                                 0.155186
           1988 Asia and Oceania (PRIO)                         interstate                                                 0.003055                                                 0.003058
           2008      Middle East (PRIO)     intrastate (internationalized)                                                 0.575151                                                 0.572485
    ~ Column number_deaths_ongoing_conflicts_battle_per_capita (changed metadata, changed data)
-       -     attribution: Population based on various sources (2023)
        ?                                                          ^
+       +     attribution: Population based on various sources (2024)
        ?                                                          ^
-       -     date_accessed: '2023-03-31'
        ?                        ^  ^ ^
+       +     date_accessed: '2024-07-11'
        ?                        ^  ^ ^
-       -     date_published: '2023-03-31'
        ?                         ^  ^ -
+       +     date_published: '2024-07-15'
        ?                         ^  ^  +
+       +       url: https://creativecommons.org/licenses/by/4.0/
-       -   - name: CC BY 3.0
-       -     url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt
-       -   - name: CC BY 3.0 IGO
-       -     url: http://creativecommons.org/licenses/by/3.0/igo/

        ~ Changed values: 1345 / 2268 (59.30%)
           year             region                      conflict_type  number_deaths_ongoing_conflicts_battle_per_capita -  number_deaths_ongoing_conflicts_battle_per_capita +
           1966    Americas (PRIO)                         intrastate                                             0.085619                                             0.084583
           1970              World                      extrasystemic                                             0.217261                                             0.217289
           2003      Europe (PRIO)                                all                                             0.268930                                             0.267883
           2004      Africa (PRIO)     intrastate (internationalized)                                             0.060539                                             0.059666
           2007 Middle East (PRIO) intrastate (non-internationalized)                                             0.344317                                             0.342111
= Dataset garden/war/2024-08-26/ucdp_prio
  = Table ucdp_prio


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-11-18 11:44:04 UTC
Execution time: 15.17 seconds

@lucasrodes lucasrodes changed the title 🔨 archive datasets 🔨 archive datasets (lucas) Nov 18, 2024
@lucasrodes lucasrodes marked this pull request as ready for review November 18, 2024 11:47
@lucasrodes lucasrodes merged commit 0d4b4c1 into master Nov 18, 2024
11 checks passed
@lucasrodes lucasrodes deleted the archive-datasets-lucas branch November 18, 2024 11:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants