Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve memory usage with skopt - limit model queue #11

Open
PostmanSpat opened this issue Dec 11, 2024 · 0 comments
Open

Improve memory usage with skopt - limit model queue #11

PostmanSpat opened this issue Dec 11, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@PostmanSpat
Copy link

PostmanSpat commented Dec 11, 2024

Is your feature request related to a problem? Please describe.

When using skopt optimize, memory usage continues to grow with each iteration. This is because skopt keeps all model history by default. For very long optimization tasks this typically results in an out of memory error and crashes the process (and usually takes a few other running applications with it).

scikit-optimize/scikit-optimize#349

Describe the solution you'd like.

Skopt now has an option to limit the model history that is retained in memory. When calling forest_minimize, the model_queue_size should be set to 1, or at least should be a parameter that can be adjusted and default to 1.

scikit-optimize/scikit-optimize@b2c6279
scikit-optimize/scikit-optimize@520b91b

Describe alternatives you've considered

No response

Additional context

No response

@PostmanSpat PostmanSpat added the enhancement New feature or request label Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants