You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using Ensemble.batch to run a custom user-provided function, it's possible that the function will throw an exception causing the batch operation to stop before delivering a final result.
One way in which this can be particularly annoying is only some data yields an exception. For instance, a user can run batch on a very large dataset but have exceptions that generated only by a few unusual lightcurves cause the whole operation to fail.
To alleviate the pain of this we could have wrap the user's function in another function which performs some basic exception handling, and then we can have some threshold for how many exceptions would trigger a batch failure.
There is some uncertainty in:
When handling the exception how can we infer what default values to provide for that light curve? Can we infer this from the meta and should we use None, NaNs, Inf, etc.
Would printing out the exceptions provide too much noise for the user, especially if there is an excessively long stack trace? Would it be best to write the errors out to a file and print a warning that this has occurred?
The text was updated successfully, but these errors were encountered:
When using
Ensemble.batch
to run a custom user-provided function, it's possible that the function will throw an exception causing the batch operation to stop before delivering a final result.One way in which this can be particularly annoying is only some data yields an exception. For instance, a user can run
batch
on a very large dataset but have exceptions that generated only by a few unusual lightcurves cause the whole operation to fail.To alleviate the pain of this we could have wrap the user's function in another function which performs some basic exception handling, and then we can have some threshold for how many exceptions would trigger a batch failure.
There is some uncertainty in:
None
, NaNs, Inf, etc.The text was updated successfully, but these errors were encountered: