Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Cogvideo i2v support. #296

Open
foreverpiano opened this issue Oct 7, 2024 · 1 comment
Open

Add Cogvideo i2v support. #296

foreverpiano opened this issue Oct 7, 2024 · 1 comment

Comments

@foreverpiano
Copy link

🔥🔥 News: 2024/9/25: CogVideoX web demo is available on Replicate. Try the text-to-video model CogVideoX-5B here Replicate and image-to-video model CogVideoX-5B-I2V here Replicate.

@xibosun
Copy link
Collaborator

xibosun commented Oct 11, 2024

CogVideoX-5B-I2V uses the same transformer model as CogVideoX-5B. They only vary on the structure of the input latent: CogVideoX-5B uses the video latent solely, whereas CogVideoX-5B-I2V combines the video latent and the image latent to pass to the transformer. We plan to add CogVideoX-5B-I2V to xDiT. It would also be wonderful if you could help us on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants