extract features without classification layer

[mathshangw]

I need the features that exist before the classification layer for the focal transformer . I tried this approach but got the wrong features...

class Identity(nn.Module):
    def __init__(self):
        super().__init__()

    def forward(self, x):
        return x

model.head = Identity()

is there any other way i can use it , please ?