Send some metrics to QA Dockstore

[unito-bot]

┆Issue is synchronized with this Jira Story
┆Issue Number: TOIL-1670

[unito-bot]

➤ Adam Novak commented:

The most basic version of this is to submit a workflow run to Dockstore immediately on successful completion.

This can turn into a submit at the start and an update at the end.

[adamnovak]

This is a more specific version of #5070.

[adamnovak]

We want this to be coupled with local journaling of workflow status and a time-based rate limit on submission. The journal wouldn't need an opt-in but transmission would.

[adamnovak]

Blocking prompt plus a bunch of user detection for TTY/interactive session. tkinter if it works, current TTY if it doesn't, continue without metrics if no TTY.

Also a log message saying when metrics are or are not going to dockstore and noting how to change it

Send: name of WF, how long it took, core hours/memory/cpu, Toil version

[adamnovak]

Don't spend any time on a login flow.

[unito-bot]

➤ Adam Novak commented:

We could try and ship some Toil config info like job store, caching on/off, batch system. Which URL types are read from ever.

Benedict talked about collecting minimal info like maybe just Toil version and workflow stats.

Lon wants to ship the whole config.

[adamnovak]

This relates to #4241

[unito-bot]

➤ Adam Novak commented:

Dockstore can apparently back-map from Github URLs to TRS IDs and does so for Terra, so we could send in every URL and let Dockstore decide if it is registered.

[unito-bot]

➤ Adam Novak commented:

Actually the back-mapping is in https://github.com/dockstore/dockstore-support/blob/bf345fd1aeb613e913e98165fe8c4c969261c05b/metricsaggregator/src/main/java/io/dockstore/metricsaggregator/client/cli/TerraMetricsSubmitter.java#L392 ( https://github.com/dockstore/dockstore-support/blob/bf345fd1aeb613e913e98165fe8c4c969261c05b/metricsaggregator/src/main/java/io/dockstore/metricsaggregator/client/cli/TerraMetricsSubmitter.java#L392|smart-link ) and so either Dockstore would need to actually run it or Toil would need to run it before submitting.