New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce PushBarrier on worker-side #1089

Open

hjp615 opened this issue Apr 4, 2017 · 0 comments

Labels

SyncSGD

Contributor

hjp615 commented Apr 4, 2017

We should introduce PushBarrier and related components(SyncWorkerMsgHandler, SyncWorkerMsgSender) on worker-side to implement SyncSGD.

PushBarrier is a worker-side component which communicates with BatchManager.
PushBarrier's role is the following:

Before ModelAccessor push data to the server, it should ask PushBarrier whether it is ok to push or not (If the worker is fast worker, PushBarrier will permit the ModelAccessor's push operation. If not, PushBarrier will not permit the push operation).
PushBarrier asks to the driver whether it is ok to permit ModelAccessor's push operation through SyncWorkerMsgHandler and SyncWorkerMsgSender.

hjp615 added the SyncSGD label

hjp615 mentioned this issue

[CAY-1089, 1127, 1130] Introduce worker-side components of SyncSGD without backup worker #1131

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment