Adaptive batch sizing

[vsuthichai]

Tune the batch size adaptively such that the user does not need to specify it. The batch size becomes important when the caller desires the optimizer to finish within some maximum duration. Too large a batch size will delay duration checks while processing occurs on the cluster. Too small a batch size will cause frequent return trips back to the driver which incur some constant time overhead.