Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend the client to include DataCatalog API & Wings API #1

Open
varunratnakar opened this issue Apr 25, 2019 · 1 comment
Open

Extend the client to include DataCatalog API & Wings API #1

varunratnakar opened this issue Apr 25, 2019 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@varunratnakar
Copy link

Create a wrapper around mint_client to return pointers to the DataCatalog and Wings APIs

@varunratnakar varunratnakar added the enhancement New feature or request label Apr 25, 2019
@mosoriob mosoriob self-assigned this May 2, 2019
@brandomr
Copy link

brandomr commented Jun 6, 2019

I believe that integration with the Data Catalog would be extremely useful.

Currently, to search for a model based on its associated datasets (using Data Catalog search functionality) you must:

  1. Find datasets in DCAT that match your query of interest (temporal, geospatial, standard variable) and grab the dataset IDs
  2. Find all model configurations from MCAT
  3. Subset model configurations to only those that have input/output datasets matching the dataset IDs found in Extend the client to include DataCatalog API & Wings API #1
  4. Find all model versions from MCAT
  5. Subset model versions to only those that have configurations found in Inconsistencies in notebook #3
  6. Find all models from MCAT
  7. Subset models to only those that have versions found in Enhance CRUD Operations #5

This process assumes that dataset IDs are consistent between DCAT and the Model Catalog. This can be done through middleware between these two systems, but should be managed by one or the other (either DCAT or the Model Catalog).

This process should be streamlined so that search for models (based on associated input files or output files, as queried through DCAT) can be executed via this API client. cc @dgarijo @jgawrilo @dnfeldman

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants