-
Notifications
You must be signed in to change notification settings - Fork 14
IterativeReduce
jpatanooga edited this page Oct 8, 2012
·
2 revisions
- A simple abstraction in the same concept as MapReduce but for parallel iterative algorithms
- similar in nature to the AllReduce primitive or some of Spark's concepts
- Involves writing a ComputableMaster and ComputableWorker
- Work is done in the worker and then aggregated every so often in the master
- does the work in parallel on batches of data
- Aggregates partial results from workers, computes a bit, and then returns an aggregation to the workers