Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mesh #962

Draft
wants to merge 24 commits into
base: main
Choose a base branch
from
Draft

Mesh #962

wants to merge 24 commits into from

Conversation

fschlimb
Copy link
Contributor

@fschlimb fschlimb commented Nov 15, 2024 •
edited
Loading

Using mesh dialect from upstream, replacing dist

  • implemented ShardingInterface for ndarray ops
  • moving dist-coalesce pass to CoalesceShardOps pass as a ndarray transform
  • removing dist dialect, transforms and conversions
  • reducing scope of ndarray to operations which are not covered by tensor or linalg
  • removed NDArrayType and DistEnvAttr

@fschlimb fschlimb marked this pull request as draft November 15, 2024 14:56
@fschlimb
fixing distruntime tests
84626f9
@fschlimb
fixing ndarray tests
4396b53
@fschlimb
new env syntax
631a8e3
@fschlimb
fixing AddGpuRegions
53d715c
@fschlimb
fixing DropRegions
78c37b9
@fschlimb
fixing runner tests
f9341fc
@fschlimb
removing ndarray.create; fixing NDArrayToLinalg and tests
6e8f8a6
@fschlimb
adding LinspaceShardingInterface; minor refactoring
a6cce35
@fschlimb
adding test/Dialect/NDArray/Extensions/mesh-spmdization.mlir
02f0e54
@fschlimb
adding spmdization test for subview and insert_slice
677ac45
@fschlimb
adding shardinginterfaces to CopyOp, DeleteOp and CastElemTypeOp
0f459cf
@fschlimb
removing ImmutableInsertSliceOp and ExtractSlice from ndarray
3365b9a
@fschlimb
removing region transforms; might need to enable one-shot-bufferize
65b37e1
@fschlimb
insertSlice 0d into nd works. Some refactoring;
ea582cb
@fschlimb
copy constant tensors if inplace semantics needed. skipping coalescin…
1b0686d 
…g if incomplete/no sharding info
@fschlimb
handle block arguments without sharding
bf4ba36
@fschlimb
moving bufferization of insertslice and subview from ndarraytolinalg …
f474abb 
…to bufferizableinterface; add shardinginterface to reshape (incomplete)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@fschlimb