Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestion: generative outpainting in MVdepan / video stabilization #71

Open
Johnreidsilver opened this issue Apr 15, 2024 · 0 comments

Comments

@Johnreidsilver
Copy link

With recent advances in generative image outpainting would it be possible to have the corners "filled" in alpha channel instead of black?

Of course if everything was handled inside vapoursynth it would be even better. There are many open source outpainting options on github:
https://github.com/Udit9654/Outpainting-Images-and-Videos-using-GANs
https://github.com/basilevh/image-outpainting
https://github.com/nanjingxiaobawang/SieNet-Image-extrapolation
https://github.com/lkwq007/stablediffusion-infinity/
https://github.com/taabata/LCM_Inpaint_Outpaint_Comfy

I think the biggest possible drawback vs current mirroring/blurring method is that consistency/movement between frames might not be great, as usually is the case in generative video models thus far.

Models trained on each video (or at least a couple of neighboring frames) would perform much better, but it would be incredibly slow and complex

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant