Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How use other flux base model ? #34

Open
douenergy opened this issue Sep 7, 2024 · 1 comment
Open

How use other flux base model ? #34

douenergy opened this issue Sep 7, 2024 · 1 comment
Labels
invalid This doesn't seem right

Comments

@douenergy
Copy link

I tried using mflux LoRA on my M3 MacBook, and everything worked smoothly. It's an impressive piece of work !!!👍
It's so satisfying to see the MacBook's GPU working at full capacity in asitop.

But can i use mflux to run flux base model like https://huggingface.co/Shakker-Labs/AWPortrait-FL ?

i dowload the all the AWPortrait-FL files in

.
├── text_encoder
│   └── model.safetensors
├── text_encoder_2
│   ├── model-00001-of-00002.safetensors
│   └── model-00002-of-00002.safetensors
├── tokenizer
│   ├── merges.txt
│   ├── special_tokens_map.json
│   ├── tokenizer_config.json
│   └── vocab.json
├── tokenizer_2
│   ├── special_tokens_map.json
│   ├── spiece.model
│   ├── tokenizer.json
│   └── tokenizer_config.json
├── transformer
│   ├── diffusion_pytorch_model-00001-of-00003.safetensors
│   ├── diffusion_pytorch_model-00002-of-00003.safetensors
│   └── diffusion_pytorch_model-00003-of-00003.safetensors
└── vae
    └── diffusion_pytorch_model.safetensors

and i try

python main.py \
   --prompt " long prompt " \
   --model dev \
   --path "<Path-to-AWPortrait-FL-dir>" \
    --steps 2 \
   --seed 42 \
   -q 8
mlx/utils.py", line 182, in tree_unflatten  int(tree[0][0].split(".", maxsplit=1)[0])
IndexError: list index out of range
@filipstrand
Copy link
Owner

@douenergy Thank you very much! Haha yes, it is indeed satisfying, you rarely hear the fans on modern MacBooks these days unless under heavy workloads like these :)

Regarding the issue, I will have to look into this in more detail. From the structure it looks to be compatible, but something is obviously not matching.

Generally, if it works with Diffusers, the idea is that it should work with MFLUX, so this is a good example to learn from.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

2 participants