Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added pip install ninja to accelerate installation of flash-attn #1461

Merged
merged 2 commits into from
Apr 2, 2024

Conversation

melvinebenezer
Copy link
Contributor

Description

In the Quickstart section, it is required to install flash-attn
Without ninja , installing flash-attn takes more than 2hrs on 64cores

Motivation and Context

The Quickstart section is expected to get started quickly. however the installation of flash-attn takes a long time
fixes #1460

How has this been tested?

Only README.md has changed

Screenshots (if appropriate)

Screenshot 2024-03-30 at 11 46 47 AM

Types of changes

NA

Social Handles (Optional)

twitter: @jamesmel24
discord: jamesmel

README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
@NanoCode012 NanoCode012 merged commit cae608f into axolotl-ai-cloud:main Apr 2, 2024
1 check passed
djsaunde pushed a commit that referenced this pull request Dec 17, 2024
* Added pip install ninja to accelerate installation of flash-attn

* doc: cleanup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Added installation of ninja to Quickstart
3 participants