Add no_fail option to integrity for nextflow to not die #371
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add a
--no_fail
argument to thecheck_integrity.py
script. The default behaviour is still to fail when an integrity fails (most notably for the genome loader).This PR changes the default manifest integrity Nextflow module to use that
--no_fail
option so as to not kill the whole pipeline when an integrity check fails. Instead,integrity.out
files are created in each folder and only kept if there have been errors. .Impacted pipelines: prepare_genome, additional_seq_prepare, dump_files
PS: We should think about writing a final report (sent by email or printed to screen/file) to show what went wrong at the end of a pipeline.