-
Notifications
You must be signed in to change notification settings - Fork 240
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CWL job chaining tests #3696
Open
douglowe
wants to merge
15
commits into
DataBiosphere:master
Choose a base branch
from
douglowe:jobstack
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
CWL job chaining tests #3696
Commits on Jul 2, 2021
-
Prototype testing CWL job chaining for TOIL.
The md_list_reduced*cwl workflows are added. md_list_reduced_2nests.cwl will chain 2 jobs, while for md_list_reduced.cwl (currently) no jobs are chained. The test uses the stats logfiles (so toilcwl must be run with --stats and --logDebug), pulling out the lists of CWL jobs which are run in each TOIL task.
Configuration menu - View commit details
-
Copy full SHA for fd60bbf - Browse repository at this point
Copy the full SHA fd60bbfView commit details -
Configuration menu - View commit details
-
Copy full SHA for c8ec908 - Browse repository at this point
Copy the full SHA c8ec908View commit details
Commits on Jul 4, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 72df69d - Browse repository at this point
Copy the full SHA 72df69dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9da049e - Browse repository at this point
Copy the full SHA 9da049eView commit details
Commits on Jul 17, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 84c435d - Browse repository at this point
Copy the full SHA 84c435dView commit details
Commits on Jul 22, 2021
-
Pickle toilState to pass to workers for jobchaining work.
The parent thread now pickle's toilState, passing it to the worker thread, where it is unpickled again. A test for completed predecessors for jobs with multiple predecessors has been added to the worker, so that some basic job chaining can be performed for jobs whose remaining predecessor completes within that task. This change does result in the parent thread not correctly noting jobs which had multiple predecessors have now been completed correctly. So some of the checks at the end of the internal job routine have had to be switched off for the moment.
Configuration menu - View commit details
-
Copy full SHA for a6599b2 - Browse repository at this point
Copy the full SHA a6599b2View commit details -
Configuration menu - View commit details
-
Copy full SHA for e3daece - Browse repository at this point
Copy the full SHA e3daeceView commit details
Commits on Jul 26, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a4ac602 - Browse repository at this point
Copy the full SHA a4ac602View commit details
Commits on Aug 25, 2021
-
Configuration menu - View commit details
-
Copy full SHA for c932df0 - Browse repository at this point
Copy the full SHA c932df0View commit details -
Configuration menu - View commit details
-
Copy full SHA for fd59405 - Browse repository at this point
Copy the full SHA fd59405View commit details
Commits on Sep 21, 2021
-
Configuration menu - View commit details
-
Copy full SHA for cec60b2 - Browse repository at this point
Copy the full SHA cec60b2View commit details
Commits on Sep 26, 2021
-
Configuration menu - View commit details
-
Copy full SHA for ac5bbf5 - Browse repository at this point
Copy the full SHA ac5bbf5View commit details
Commits on Nov 17, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a71f863 - Browse repository at this point
Copy the full SHA a71f863View commit details
Commits on Nov 30, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 1e51d8c - Browse repository at this point
Copy the full SHA 1e51d8cView commit details
Commits on Jan 31, 2022
-
Configuration menu - View commit details
-
Copy full SHA for ea6e4b1 - Browse repository at this point
Copy the full SHA ea6e4b1View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.