You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on May 28, 2024. It is now read-only.
Metadata is in #7 but if it's going to be in a separate file, then that needs to be considered here too.
The nested or faceted style of storage is really cool ("/guoda/data/gbif-idigbio.parquet/source=gbif") and intuitive to use. However coding mistakes like the example just there (it doesn't have the date on the end so it loads two copies of GBIF) can be exponentially disastrous as we add more sources and versions of data sets. Since we're including targeting intermediate programmers with this platform, do we want a safer syntax?
The text was updated successfully, but these errors were encountered:
A possible compromise: The archive version of data storage uses Jorrit's pattern and the latest is a copy of the latest at a fixed file name in the existing data folder - HDFS does not support symlinks so we'll have to have copes somewhere.
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Metadata is in #7 but if it's going to be in a separate file, then that needs to be considered here too.
The nested or faceted style of storage is really cool ("/guoda/data/gbif-idigbio.parquet/source=gbif") and intuitive to use. However coding mistakes like the example just there (it doesn't have the date on the end so it loads two copies of GBIF) can be exponentially disastrous as we add more sources and versions of data sets. Since we're including targeting intermediate programmers with this platform, do we want a safer syntax?
The text was updated successfully, but these errors were encountered: