You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Clustering in particular is a stateful operation, which currently relies on serializing/deserializing modelWE objects from the Ray object store.
Ideally, there isn't much overhead associated with this, but I think it becomes noticeable on systems without shared memory between workers.
Instead of doing the parallelism via Ray processes, we can initialize a set of Actors to do work. Actors are stateful, so we can just initialize them with the current model state (with unnecessary stuff stripped out).
The text was updated successfully, but these errors were encountered:
Clustering in particular is a stateful operation, which currently relies on serializing/deserializing modelWE objects from the Ray object store.
Ideally, there isn't much overhead associated with this, but I think it becomes noticeable on systems without shared memory between workers.
Instead of doing the parallelism via Ray processes, we can initialize a set of Actors to do work. Actors are stateful, so we can just initialize them with the current model state (with unnecessary stuff stripped out).
The text was updated successfully, but these errors were encountered: