Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rationale for the negative embedding initialization #21

Open
isamu-isozaki opened this issue Dec 22, 2022 · 0 comments
Open

Rationale for the negative embedding initialization #21

isamu-isozaki opened this issue Dec 22, 2022 · 0 comments

Comments

@isamu-isozaki
Copy link

Hi! I am working on a pr for this for diffusers by huggingface and I wondered if anyone has some idea on why the 1e-3 noise is getting added to the negative initial embeddings. Also, am I correct in thinking that the negative initial token should be chosen differently from the positive initial token?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant