You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As we decided to analyze a variety of performance metrics in addition to the plain accuracy, we need to re-evaluate all 16-node breaking-IID experiments from their respective model checkpoints to obtain the local and global confusion matrices.
Relevant scripts are:
Actual Python script to run: ./scripts/examples/evaluate_from_checkpoint_breaking_iid.py
SLURM utility function to obtain correct checkpoint paths for each parameter combination, starting from given base path: find_checkpoint_dir_and_uuid in ./specialcouscous/utils/slurm.py
Additional metrics for breaking-IID series
As we decided to analyze a variety of performance metrics in addition to the plain accuracy, we need to re-evaluate all 16-node breaking-IID experiments from their respective model checkpoints to obtain the local and global confusion matrices.
Relevant scripts are:
./scripts/examples/evaluate_from_checkpoint_breaking_iid.py
find_checkpoint_dir_and_uuid
in./specialcouscous/utils/slurm.py
./scripts/experiments/generate_parallel_evaluation_from_breaking_iid_ckpt_job_scripts.py
${BASEDIR}/results/
(BASEDIR
corresponds to our workspace)The text was updated successfully, but these errors were encountered: