Skip to content

Commit

Permalink
fix linting
Browse files Browse the repository at this point in the history
  • Loading branch information
maxisawesome committed Feb 12, 2024
1 parent 3c1e344 commit 7849528
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
6 changes: 3 additions & 3 deletions scripts/eval/yamls/eval_gauntlet_long_context_length.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ eval_gauntlet:
- name: wikiqa_2k
num_fewshot: 0
random_baseline: 0
- name: 4k
- name: 4k
benchmarks:
- name: hotpotqa_beginning_4k
num_fewshot: 0
Expand All @@ -49,7 +49,7 @@ eval_gauntlet:
- name: wikiqa_4k
num_fewshot: 0
random_baseline: 0
- name: 8k
- name: 8k
benchmarks:
- name: hotpotqa_beginning_8k
num_fewshot: 0
Expand Down Expand Up @@ -131,4 +131,4 @@ eval_gauntlet:
random_baseline: 0
- name: kv_pairs_end_64k
num_fewshot: 0
random_baseline: 0
random_baseline: 0
4 changes: 2 additions & 2 deletions scripts/eval/yamls/eval_gauntlet_long_context_section.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ eval_gauntlet:
subtract_random_baseline: true
rescale_accuracy: true
categories:
- name: beginning
- name: beginning
benchmarks:
- name: hotpotqa_beginning_2k
num_fewshot: 0
Expand Down Expand Up @@ -127,4 +127,4 @@ eval_gauntlet:
random_baseline: 0
- name: wikiqa_8k
num_fewshot: 0
random_baseline: 0
random_baseline: 0

0 comments on commit 7849528

Please sign in to comment.