Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No find code evaluation for model(FID score) #23

Open
LuongTuanAnh163002 opened this issue Oct 30, 2024 · 2 comments
Open

No find code evaluation for model(FID score) #23

LuongTuanAnh163002 opened this issue Oct 30, 2024 · 2 comments

Comments

@LuongTuanAnh163002
Copy link

Hello author, I am not able to find the code to confirm the evaluation metric you stated in the paper(FID: 15.73) with your checkpoint. I have tried the FID evaluation codes available online but the results are not the same as in your paper(my FID is 39.15). Can you provide me the code and instructions with your checkpoint to get the exact results as you stated in the paper? Thank you so much!

@dailenson
Copy link
Owner

Hello~ We use the public FID evaluation code available at https://github.com/omni-us/research-GANwriting

@LuongTuanAnh163002
Copy link
Author

LuongTuanAnh163002 commented Oct 31, 2024

Thank you so much, I used FID evaluation of https://github.com/omni-us/research-GANwriting also read through the code and found that the code is no different from the FID calculation codes that I tried before (pytorch_fid) and the result is still incorrect (FID: 40). The result I evaluated on the test set of IAM and the correct result in the paper should be FID: 15.73

I read the code and referred to the code (test.py file) and wrote an infer.py file myself to generate fake images on the IAM test set and compare it with the real image. However, the generated image I see has a large white space behind. Is that a problem?
Example:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants