New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

No learning rate decay? #37

Open

jakezhaojb opened this issue May 10, 2018 · 1 comment

jakezhaojb commented May 10, 2018

Hi,

I saw you commented out the adjust_learning_rate function. Does this mean lr decay isn't essential to the performance of VQA training?

Cheers,
Jake

Owner

Cadene commented May 10, 2018 •

edited

Loading

@jakezhaojb I think it can help, especially more complex learning decay strategies, but it is not essential.

Please let me know if you notice an improvement :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment