Code

add ia3 peft support#601

Code

Open

winglian wants to merge 10 commits intomainaxolotl-ai-cloud/axolotl:mainfrom ia3-peftaxolotl-ai-cloud/axolotl:ia3-peftCopy head branch name to clipboard

+365-75

Commits

Commits on Oct 19, 2023

• add ia3 peft support

  winglian

  committed
  2d7cccf

• prepare ia3 for 8bit

  winglian

  committed
  1da328e

• fix load_in_8bit check

  winglian

  committed
  c8e42a0

• ia3 keeps casting to float32, handle it here for now

  winglian

  committed
  998763b

• Update src/axolotl/utils/models.py

  Show description for ba85308
  

  winglian

  and

  NanoCode012

  committed
  ba85308

• consolidate as peft_model_dir

  winglian

  committed
  2033694

• include task type for ia3 config

  winglian

  committed
  d645b19

• update README for IA3 peft

  winglian

  committed
  481ef18

• migrate lora_ to peft_

  winglian

  committed
  0bd89b3

• Add e2e test for ia3 ft

  winglian

  committed
  d0b5342