Code

transformers 4.47.1#2187

Code

Merged

winglian merged 10 commits intomainaxolotl-ai-cloud/axolotl:mainfrom transformers_4_47_1axolotl-ai-cloud/axolotl:transformers_4_47_1Copy head branch name to clipboardDec 17, 2024

+36-26

Commits

Commits on Dec 13, 2024

• transformers 4.47.1

  winglian

  committed
  8a4cae3

• drop monkeypatches

  winglian

  committed
  becca9d

• can't remove patches yet

  winglian

  committed
  fa24303

• make flash attention forward ignore the loss kwargs

  winglian

  committed
  ebe6cda

• patch the flash attention in the modeling arch too

  winglian

  committed
  8c940e7

• remove fsdp and deepspeed patches

  winglian

  committed
  c466872

Commits on Dec 16, 2024

• cleanup PR

  winglian

  committed
  5eb77f4

Commits on Dec 17, 2024

• bump accelerate and torchao, also logically reorder/group requirements

  winglian

  committed
  febbd8b

• meant to include torchao

  winglian

  committed
  6a6a7b9

• use official patch release [skip ci]

  winglian

  committed
  96912f5