Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can code created 10 months ago that is 3X faster gone unnoticed. #7

Open
aifartist opened this issue Sep 18, 2023 · 0 comments
Open

Comments

@aifartist
Copy link

aifartist commented Sep 18, 2023

I specialize in SD performance. I have a 4090 on a i9-13900K system running Ubuntu 22.04. Some of the optimizations I've discovered have been incorporated into pytorch and diffusers.

I saw your recent Sep 12 InstaFlow announcentment. A github without code???
It refers to another github repro with was created 10 months ago! How can this do txt2img 3X faster than regular SD and not been noticed for 10 months?

Sorry for posting this as an "issue" but this github repro has no "discussion" section.
I evaluate and consult on SD performance. I have gotten over 90+ it/s with TensorRT and have tested torch.compile() and AOT. I can average under .4 seconds per image with standard A1111 generations with batching and advanced tuning.

While I am concerned that your code is so old, so I'm not sure if I am wasting my time, I have just cloned your RectifiedFlow. Hmmm, I see the README has what is supposed to be a "High-Resolution Generation" EXAMPLE yet nowhere does the word "prompt" occur and I have also checked main.py. So I'm not sure how to even try this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant