Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Einsum is not added to the supported list for autocast #8405

Open
avizon-aws opened this issue Nov 21, 2024 · 3 comments
Open

Einsum is not added to the supported list for autocast #8405

avizon-aws opened this issue Nov 21, 2024 · 3 comments
Assignees

Comments

@avizon-aws
Copy link
Collaborator

We noticed that einsum is not added to the supported ops list for low precision policy in autocast, is there a reason for that? Does this op have some issues in the support?

@miladm
Copy link
Collaborator

miladm commented Nov 21, 2024

cc @tengyifei to help with this issue

@aws-nm9
Copy link
Contributor

aws-nm9 commented Nov 21, 2024

In order to support einsum, would it require more extensive changes or just a change to torch_xla/csrc/autocast_mode.cpp that adds KERNEL_XLA(einsum, lower_precision_fp)?

@aws-nm9
Copy link
Contributor

aws-nm9 commented Nov 27, 2024

PR created for einsum support in autocast: #8420. An extension of the same is #8421.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants