Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What did you used for training target / tutor signal? #3

Open
nat-chan opened this issue Oct 5, 2022 · 1 comment
Open

What did you used for training target / tutor signal? #3

nat-chan opened this issue Oct 5, 2022 · 1 comment

Comments

@nat-chan
Copy link

nat-chan commented Oct 5, 2022

Dear authors,

Recently we planned to used your model to evaluate the illust generation performance in our paper.
But, I could not found what did you used for target in the training process.

Danbooru2020 tag["score"] or tag["favorite"]?

I am looking forward to your responce.

BEST regards,

@grexzen
Copy link

grexzen commented Oct 20, 2022

This model was trained using images from 3 sources that were scored by people, so the model uses image path and rating for retraining.

For just evaluating your gens, you can just embed all images, then run them through the inference py and get the score.

But not sure how that would evaluate your paper, unless it is about making gens look better pre or post process. Otherwise, it can only tell you how much the people that graded the original model this runs on would like them or not from 1-10.

Keep in mind this was trained on gens and no gens, so it does a poor job on gens only, since it over scores them down.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants