Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues with flash_attn #39

Open
ohjasd098 opened this issue Oct 27, 2024 · 1 comment
Open

Issues with flash_attn #39

ohjasd098 opened this issue Oct 27, 2024 · 1 comment

Comments

@ohjasd098
Copy link

ohjasd098 commented Oct 27, 2024

ImportError: This modeling file requires the following packages that were not found in your environment: flash_attn. Run pip install flash_attn
(emu3) @CHINAMI-JARNGAD:/mnt/d/Research/Emu3$ pip install flash_attn
Requirement already satisfied: flash_attn in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (2.5.7)
Requirement already satisfied: torch in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (2.3.0)
Requirement already satisfied: einops in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (0.8.0)
Requirement already satisfied: packaging in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (24.1)
Requirement already satisfied: ninja in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (1.11.1.1)
Requirement already satisfied: filelock in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (3.16.1)
Requirement already satisfied: typing-extensions>=4.8.0 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (4.12.2)
Requirement already satisfied: sympy in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (1.13.3)
Requirement already satisfied: networkx in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (3.4.2)
Requirement already satisfied: jinja2 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (3.1.4)
Requirement already satisfied: fsspec in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (2024.10.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from jinja2->torch->flash_attn) (2.1.5)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from sympy->torch->flash_attn) (1.3.0)
(emu3) @CHINAMI-JARNGAD:/mnt/d/Research/Emu3$

@ryanzhangfan
Copy link
Collaborator

Maybe you can try this to see if it works?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants