New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问一下，这里的attention2d,是什么类型的attention机制呢？ #1

Open

shuyuandeqipa opened this issue Aug 30, 2020 · 2 comments

shuyuandeqipa commented Aug 30, 2020

No description provided.

Owner

kaijieshi7 commented Aug 31, 2020

我是按照《Dynamic Convolution: Attention over Convolution Kernels》这篇文章实现的。文章中图示了他的attention，就是简单的加权求和。

Asthestarsfalll commented Aug 1, 2021

使用了SE block外加一个Softmax来生成注意力，属于通道注意力吧，不过是对卷积核的通道

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment