An Idea: workflow combining SDXL lcm and turbo gives very good result in 20 steps

[frankyifei]

I did some tests recently. In those test, I am using Concept Sliders to improve the image, including fix_hands.pt, repair_slider.pt and stylegan_latent1. And LCM&TurboMix LoRA which gives you both LCM and Turbo, depending on the sampler.

My findings:
1.LCM is good at composition and gives almost good human anatomy compared to SDXL turbo, but the results from LCM always seem too blurry to me.
2.SDXL turbo lora can finish in 8 steps but it is prone to wrong human anatomy or other obvious errors I can't fix easily.
3.You don't need negative prompt, sliders lora are enough to help with hands and the image quality. I would rather double the speed by setting cfg at 1.
4. Refine the LCM result with Turbo 8 steps give me great result. You can also upscale with SDXL Turbo after LCM, which give me 2x size result in short time. On windows with 3060, roughly 1 minutes. without upscale only 20 seconds.

Recommandation:
I hope this can be integrated in fooocus. I currently using comfyui for this workflow only because of the convenience.

I combine these two in comfyUI and it gives good result in 20 steps. LCM 12-15 steps and SDXL turbo 8 steps. But for upscale, Fooocus is much better than other solution. Currently you have to manually change settings, but the results are fantastic.

This is same seed, Speed Mode 30 steps, LCM 15 steps and Turbo 8 steps, Turbo clearly has some issue with extra limbs.

Upscale using Turbo from LCM result(8 steps):

here are some results from LCM to Turbo(LCM 15steps + Turbo 8 steps upscale):

Same seed Turbo to Turbo upscale, it seems over sutured and face is uglier?

[fairman1]

Hi, I know the developer of fooocus, this process looks great, do you have the workflow of comfyui to share?

[frankyifei]

Here are two comfyui workflows I recently worked on. Try them and see which one you like.

[vumichien]

Can you share the workflow of comfyui? It looks so good @frankyifei

[frankyifei]

there is nothing fancy, just lcm 15 steps for a low quality picture, then upscale to 2x size with sdxl turbo, 8 steps. I can even do this in fooocus but there are some disadvantages because sdxl will mess up some details, especially keen caps. I guess we are all waiting for sdxl tile control net now. My newer workflow is lcm 15 steps, upscale with sd ultimate upscaler to 2x size using sdxl turbo. then do a low denoise(0.2) pass with sdxl turbo to fix the seams from upscaler.

[vumichien]

All of the steps you can do by fooocus or you need to use some other tool like Automatic1111 or comfyui. These tools are quite complicated to get start :D

[frankyifei]

just download the image and drop it to comfyui