Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How is conditioning dropout done in training? #106

Open
max-fofanov opened this issue Jan 5, 2025 · 1 comment
Open

How is conditioning dropout done in training? #106

max-fofanov opened this issue Jan 5, 2025 · 1 comment

Comments

@max-fofanov
Copy link

First of all thank you for your awesome work. I wonder how do you do conditioning dropout? If you pass torch.zeros_like(...) like you do on inference how can this be utilized when training? Passing the torch.zeros_like(...) into Unet instead of garment encoder input doesn't allow gradients to flow, as far as I understand. And if you pass torch.zeros_like as an input to garment encoder, why do you inference the model in a different way, creating torch.zeros_like directly in the attention processor instead of creating it before using ref_unet and passing it through it. Thank you for the answer!

@max-fofanov max-fofanov changed the title Conditioning dropout How is conditioning dropout done in training? Jan 5, 2025
@max-fofanov
Copy link
Author

@ShineChen1024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant