Add Option for Pyramid Noise to SDXL train script

[nbardy]

This changes the offset_nose arg to be a noise_type arg.

Currently allows 3 options between:

• Standard white noise
• Pyramid Noise
• Offset Noise

@sayakpaul
@patrickvonplaten

[sayakpaul]

Thank you for your PR! But we're currently holding off a bit from merging new changes into our official training examples to keep them minimal.

I welcome you to add a note in the corresponding READMEs of the examples:

• Brief commentary
• Pseudo code with source
• Results expected

[nbardy]

Will close this then.

Definitely feeling some of the pain of trying to fork this script given how complicated it has gotten.

Would be nice to have a train_sdxl_simple.py in the repo that is barebones and way less lines of code.

@sayakpaul Not sure what you mean by adding to the readme? Adding chunks of code to the readme? Don't quiet understand the goal/purpose of that.

[sayakpaul]

Thanks for understanding!

@sayakpaul Not sure what you mean by adding to the readme? Adding chunks of code to the readme? Don't quiet understand the goal/purpose of that.

I mean adding a brief section about it and supplementing that with pseudocode if necessary.

Would be nice to have a train_sdxl_simple.py in the repo that is barebones and way less lines of code.

SDXL itself has some extra components that need working around. If we want to follow the guidelines as laid out here, this is the reasonable version we could come up with. If you have improvement idea, let's maybe discuss in an issue.

Cc: @patrickvonplaten