Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change timing loss function to something depending on the evaluation time #31

Open
jacopok opened this issue May 30, 2022 · 1 comment
Labels

Comments

@jacopok
Copy link
Owner

jacopok commented May 30, 2022

The current loss function in HyperparameterOptimization.objective doesn't make a lot of sense.

The validation error part is fine, but the other cost is currently in the form $CN + T$, where $C$ is some constant, $N$ is the number of training points used, while $T$ is the time required to train the network.

This should be replaced by some nonlinear function $f$ of the time $t$ required to evaluate the network. This could simply be evaluated by the number of connections....

@jacopok jacopok added the enhancement New feature or request label May 30, 2022
@jacopok
Copy link
Owner Author

jacopok commented May 30, 2022

It would also be good to explore network complexity "sequentially" somehow, starting with smaller nets and going up as needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant