Code

Allow flash attention up to 3#1377

Code

Merged

dakinggg merged 2 commits intomainmosaicml/llm-foundry:mainfrom dakinggg-patch-5mosaicml/llm-foundry:dakinggg-patch-5Copy head branch name to clipboardJul 20, 2024

+1-1

Commits

Commits on Jul 19, 2024

• Allow flash attention up to 3

  dakinggg

  authored
  7840be5

  Copy full SHA for 7840be5

Commits on Jul 20, 2024

• Merge branch 'main' into dakinggg-patch-5

  dakinggg

  authored
  c4795d0

  Copy full SHA for c4795d0