You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Oct 19, 2024. It is now read-only.
This can be a starting point to learn runtime_emitter.
Background
In Pipeshard Parallel, the final compilation step is to interpret the solution into a configuration containing all information about computation, communication, parameter, output and debug information. Now the instruction_lists and executable_configs are indexed by MeshHostWorker, which means we have to give the emitter a physical mesh group(see here). The final target is to run all steps in the compilation(except for profiling) without using GPU resources.
replace the mesh_group by sliced_virtual_meshes and move the two lines out of the function. Maybe we can create a VirtualMeshGroup to provide interfaces. Some operations will be skipped;
add skipped operations from last step in PipeshardMeshDriverExecutable.__init__.
The text was updated successfully, but these errors were encountered:
This can be a starting point to learn
runtime_emitter
.Background
In Pipeshard Parallel, the final compilation step is to interpret the solution into a configuration containing all information about computation, communication, parameter, output and debug information. Now the
instruction_lists
andexecutable_configs
are indexed byMeshHostWorker
, which means we have to give the emitter a physical mesh group(see here). The final target is to run all steps in the compilation(except for profiling) without using GPU resources.TODO
SymbolicReshardingTask.put_tasks
inPipeshardMeshDriverExecutable.__init__
. The same applies for theSymbolicBroadcastReshardingTask
;mesh_group
bysliced_virtual_meshes
and move the two lines out of the function. Maybe we can create aVirtualMeshGroup
to provide interfaces. Some operations will be skipped;PipeshardMeshDriverExecutable.__init__
.The text was updated successfully, but these errors were encountered: