New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] Proxy chan hang at cudaMemcpyAsync #394

Open

FC-Li opened this issue Nov 27, 2024 · 1 comment

FC-Li commented Nov 27, 2024 •

edited

Loading

I implemented alltoall using proxy chan. Proxy chan will hang at cudaMemcpyAsync while another kernel' launch is also being blocked.

cudaMemcpyAsync:

the kernel launch being blocked:

The stream is not the default stream.

Author

FC-Li commented Nov 28, 2024

I solved the problem by export CUDA_MODULE_LOADING=EAGER, but I actually don't know why.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment