You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
pip install vak[expt-tracking] should add this optional dependency and then allow experiment tracking
we should include at a bare minimum the path to metadata json files from datasets so that one can programatically relate metadata to experiments / runs
I don't want to invest a lot right now in supporting every feature of mlflow but it's clear to me we need some sort of experiment tracking (as @achabotl wisely pointed out many moons ago).
Prefer going with mlflow for now since it's the one I'm most familiar with and I would rather just adopt something that's widely used in industry, although sth more lightweight and application-agnostic like sacred or sumatra might be worth thinking about
The text was updated successfully, but these errors were encountered:
edit: looking at this again and related issues, questions in the Discussions, etc., my impression is that integration is not perfect and it's probably less painful in the long run to keep them separated if possible
edit edit: basically I need to implement the bad version of this and see if it can even work
pip install vak[expt-tracking]
should add this optional dependency and then allow experiment trackingI don't want to invest a lot right now in supporting every feature of mlflow but it's clear to me we need some sort of experiment tracking (as @achabotl wisely pointed out many moons ago).
Prefer going with mlflow for now since it's the one I'm most familiar with and I would rather just adopt something that's widely used in industry, although sth more lightweight and application-agnostic like sacred or sumatra might be worth thinking about
The text was updated successfully, but these errors were encountered: