Skip to content

Commit

Permalink
Fix matrix and rename file
Browse files Browse the repository at this point in the history
  • Loading branch information
redbrain authored Mar 17, 2024
1 parent e1b8476 commit bff08d1
Showing 1 changed file with 3 additions and 6 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ jobs:
run_task:
### Few shot tasks
### ----------------------------------------------------------------------------
# - arc_challenge
- arc_challenge
# - hellaswag
# - truthfulqa_mc2
# - winogrande
Expand All @@ -92,13 +92,10 @@ jobs:
# - 2
# - 5
# - 10
# - 25
- 25

include:
# Include mmlu with <= 5 fewshot
# As it does not work with > 5 fewshot
- run_task: arc_challenge
num_fewshot: 25
# Specify each task
- run_task: hellaswag
num_fewshot: 10
- run_task: mmlu
Expand Down

0 comments on commit bff08d1

Please sign in to comment.