You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I implemented this in another software and figured it would be useful here as well.
Have an Energy Saver Mode (checkbox) When selected, it would unload the model if no activity (inference via GUI or API) within a certain number of minutes.
If an activity is received, it will try and load the last model that was loaded.
Should be pretty simple
Add a checkbox.
Start a timer once the model is full loaded.
Once the limit is hit unload the model.
While the timer is on, reset it back to 0 when inference is activated.
If inference is activated and model is not loaded, try and load the last model loaded if Energy Save Mode is on.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I implemented this in another software and figured it would be useful here as well.
Have an Energy Saver Mode (checkbox) When selected, it would unload the model if no activity (inference via GUI or API) within a certain number of minutes.
If an activity is received, it will try and load the last model that was loaded.
Should be pretty simple
Add a checkbox.
Start a timer once the model is full loaded.
Once the limit is hit unload the model.
While the timer is on, reset it back to 0 when inference is activated.
If inference is activated and model is not loaded, try and load the last model loaded if Energy Save Mode is on.
Beta Was this translation helpful? Give feedback.
All reactions