Add an option to run tasks so they raise an error during the run

Add an option to run tasks so they raise an error during the run #3219