Fused-MBConv layer in efficientnet

[abeyang00]

Thanks for the great work.

I have a question regarding fused-mbconv layer.

Say there is no SE, the layer goes
[conv->bn->swish->conv->bn] + shortcut

why is there no activation after adding shorcut like ResBlock??
Shouldn't there be activation to send to next layer?

Thank you in advance

[rwightman]

@abeyang00 MBConv (or 'Inverted Residual') blocks have linear outputs w/ expansion inverted from ResNet residual blocks. Fused-MBConv is just a different variation so is the same with respect to having linear output