Genomic Workflow Output manifest CLI incorporation

[gsantia]

A lot of work was done in the Study Creator to allow analysts to ingest genomic workflow output data into the Dataservice (details here). The plan was to allow the user to upload a GWO manifest and then hit an 'ingest' button which would run through the process. This has not been implemented because the complicated nature of this process is too much for a single button push (we need monitoring and error handling etc).

This turned out to be a task of adding new functionality to the ingest library and then stapling it to the Study Creator API. Instead of letting this functionality languish, it'd be nice to add it to the ingest library CLI. This would allow for a more fine-tuned approach than just pushing a button, but wouldn't require the same heavy time investment to create a user-friendly frontend environment.

Here's my current idea for steps:

• Talk to end users (analysts) about how they'd want this new functionality to look and work, and what options would be useful
• Take this information and create an RFC and allow for everyone to think about it and comment
• Implement the desired functionality
• Have users test it out and perform basic QA
• Make any required fixes/add new desired features
• Release

[znatty22]

cc @fiendish @chris-s-friedman @youngnm @nicolevasilevsky @Christina-J-Diaz

[fiendish]

After step 2 is done this needs to be converted into more concrete actions.

[gsantia]

After step 2 is done this needs to be converted into more concrete actions.

yeah, absolutely. any thoughts?