Code

add transformer engine fp8 attention#803

Code

Draft

cli99 wants to merge 1 commit intomosaicml:mainmosaicml/llm-foundry:mainfrom cli99:te-attn-supportcli99/llm-foundry:te-attn-supportCopy head branch name to clipboard

+54-18

Commits

Commits on Dec 13, 2023

• add te fp8 attention

  cli99

  committed
  05b4ddd