Skip to content
Smoketest

Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits. #3642

Sign in to view logs

Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits.

Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits. #3642

Triggered via pull request July 19, 2024 21:40
@ShashankMosaicMLShashankMosaicML
synchronize #1374
ShashankMosaicML:soft_cap_attn
Status Success
Total duration 3m 20s
Artifacts –

smoketest.yaml

on: pull_request
Matrix: smoketest
Fit to window
Zoom out
Zoom in

Annotations

2 warnings
smoketest (3.9)
The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/checkout@v3, actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
smoketest (3.10)
The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/checkout@v3, actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/