Safely end training even if trackers weren't initialized #3297

Job	Run time
run-tests (latest, test_prod)	3m 51s
run-tests (latest, test_core)	5m 17s
run-tests (latest, test_cli)	5m 53s
run-tests (latest, test_big_modeling)	5m 12s
run-tests (latest, test_deepspeed)	6m 12s
run-tests (latest, test_fsdp)	5m 16s
run-tests (latest, test_example_differences)	5m 38s
run-tests (latest, test_checkpoint_step)	8m 34s
run-tests (latest, test_checkpoint_epoch)	8m 24s
run-tests (latest, test_rest)	11m 5s
run-tests (minimum, test_prod)	3m 58s
run-tests (minimum, test_core)	5m 46s
run-tests (minimum, test_cli)	6m 7s
run-tests (minimum, test_big_modeling)	5m 27s
run-tests (minimum, test_deepspeed)	5m 10s
run-tests (minimum, test_fsdp)	5m 6s
run-tests (minimum, test_example_differences)	5m 17s
run-tests (minimum, test_checkpoint_step)	7m 59s
run-tests (minimum, test_checkpoint_epoch)	7m 3s
run-tests (minimum, test_rest)	16m 48s
	2h 14m 3s

Provide feedback