Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some Questions about Reproducing Experimental Results #14

Open
junjie1003 opened this issue Jun 26, 2023 · 1 comment
Open

Some Questions about Reproducing Experimental Results #14

junjie1003 opened this issue Jun 26, 2023 · 1 comment

Comments

@junjie1003
Copy link

I have faithfully followed the README instructions to reproduce the experiment, selecting the target attribute as "StraightHair". However, the baseline and final training results are as follows:
image
image
This is the improvement over baseline:
01
When comparing them to the results mentioned in the paper, I notice a significant difference in terms of both metrics and improvement levels:
image
image
How can I address this issue?

@junjie1003
Copy link
Author

I have followed the README instructions throughout the entire process, without making any changes to the parameters. The command I used for running the experiment is as follows:

    python generate_images.py --experiment orig
    
    python main.py --experiment baseline --attribute 20
    python get_scores.py --attribute 20
    
    python main.py --experiment baseline --attribute 32
    python get_scores.py --attribute 32
    
    python linear.py --attribute 32
    python generate_images.py --experiment pair --attribute 32
    python get_scores.py --attribute 32 --out_file data/fake_images/Straight_Hair_scores.pkl
    python main.py --experiment model --attribute 32
    ```
I don't understand where the problem lies. Could it be due to differences in the experimental environment?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant