Possible to create checkpoints / images during the training?

[quasiblob]

It feels a bit restrictive to not be able to see the training progress.

Also, like with Automatic1111's Textual Inversion training, it would be nice to be able to save checkpoints after x amount of steps.

[vivi-gomez]

I am not sure but there is an option "Save every N epochs".
Although in webgui1111 it is much more clear to save even when canceling

[Eagle07-Sudo]

Me too. I can't start tensorboard.
when I open powershell or anaconda prompt and go to the kohya_ss folder and then write:
tensorboard.exe --logdir "paste log folder path"
I got ValueError: Duplicate plugins for name projector

[Woisek]

@Eagle07-Sudo
This "issue" is almost solved, Tensorboard use will be integrated into the GUI.

[runner22k]

@Woisek Is it! how do you know?

[Woisek]

I switched to the dev branch like @bmaltais suggested here and tried it out. It works like a charm, besides some QOL I'm missing.

[runner22k]

@Woisek That's great. need to check