Skip to content

Commit

Permalink
Fix the wrong adapter in qwen2-moe-qlora example (#1501) [skip ci]
Browse files Browse the repository at this point in the history
It should be `qlora` instead of `lora`
  • Loading branch information
maziyarpanahi authored Apr 9, 2024
1 parent ff01c45 commit 7f17eff
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/qwen/qwen2-moe-qlora.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ sequence_len: 1024 # supports up to 32k
sample_packing: false
pad_to_sequence_len: false

adapter: lora
adapter: qlora
lora_model_dir:
lora_r: 32
lora_alpha: 16
Expand Down

0 comments on commit 7f17eff

Please sign in to comment.