You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First of all thank you for your awesome work. I wonder how do you do conditioning dropout? If you pass torch.zeros_like(...) like you do on inference how can this be utilized when training? Passing the torch.zeros_like(...) into Unet instead of garment encoder input doesn't allow gradients to flow, as far as I understand. And if you pass torch.zeros_like as an input to garment encoder, why do you inference the model in a different way, creating torch.zeros_like directly in the attention processor instead of creating it before using ref_unet and passing it through it. Thank you for the answer!
The text was updated successfully, but these errors were encountered:
max-fofanov
changed the title
Conditioning dropout
How is conditioning dropout done in training?
Jan 5, 2025
First of all thank you for your awesome work. I wonder how do you do conditioning dropout? If you pass torch.zeros_like(...) like you do on inference how can this be utilized when training? Passing the torch.zeros_like(...) into Unet instead of garment encoder input doesn't allow gradients to flow, as far as I understand. And if you pass torch.zeros_like as an input to garment encoder, why do you inference the model in a different way, creating torch.zeros_like directly in the attention processor instead of creating it before using ref_unet and passing it through it. Thank you for the answer!
The text was updated successfully, but these errors were encountered: