Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit core count at any time to N, by guaranteeing core exclusivity #16280

Open
ttmtrajkovic opened this issue Dec 23, 2024 · 1 comment
Open
Assignees

Comments

@ttmtrajkovic
Copy link
Contributor

Implement method to guarantee that within a every pair of cores only 1 can work at the same time.
This should help with heavily DM bound workload like convolutions and LM head, while still keeping effective AICLK at 1GHz.

This requires modifications in data movement APIs to free up one NOC command buffer so TRISCs can issue NOC transactions over L1.

@davorchap
Copy link
Collaborator

We will do this just for Matmuls and Convs?

Other OPs could still use all the cmd buffers in DM kernels.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants