ComfyUI-LTXTricks

A set of nodes that provide additional controls for the LTX Video model

Installation

There are no additional packages required. The ComfyUI examples page can get you started if you haven't already used LTX.

Examples

Example workflows can be found in the example_workflows directory.

RF-Inversion

This is an implementation of RF-Inversion and an example workflow can be found here.

ltx_rf_inversion.mp4

RF-Edit

This is an implementation of RF-Solver-Edit and an example workflow can be found here.

ltx_rf_edit.mp4

FlowEdit

This is an implementation of FlowEdit and an example workflow can be found here.

Image and Video to Video (I+V2V)

This is a method to perform Video to Video while using a reference image.

Use this example workflow for getting started. Results may vary.

ltx_rf_edit_iv2v.mp4

Enhance

A portion of Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling (STG) has been implemented. Planning to add the "Restart" feature when time allows.

Use this example workflow to see how it works.

Left is without STG, and right is with STG.

ltx_stg_example.mp4

Interpolation and Frame Setting

A set of nodes have been included to set specific latents to frames instead of just the first latent. An example workflow can be found here.

ltx_interpolation.mp4

Acknowledgements

RF-Inversion

@article{rout2024rfinversion,
  title={Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations},
  author={Litu Rout and Yujia Chen and Nataniel Ruiz and Constantine Caramanis and Sanjay Shakkottai and Wen-Sheng Chu},
  journal={arXiv preprint arXiv:2410.10792},
  year={2024}
}

RF-Solver-Edit

@article{wang2024taming,
  title={Taming Rectified Flow for Inversion and Editing},
  author={Wang, Jiangshan and Pu, Junfu and Qi, Zhongang and Guo, Jiayi and Ma, Yue and Huang, Nisha and Chen, Yuxin and Li, Xiu and Shan, Ying},
  journal={arXiv preprint arXiv:2411.04746},
  year={2024}
}

FlowEdit

@article{kulikov2024flowedit,
	title = {FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models},
	author = {Kulikov, Vladimir and Kleiner, Matan and Huberman-Spiegelglas, Inbar and Michaeli, Tomer},
	journal = {arXiv preprint arXiv:2412.08629},
	year = {2024}
	}