Skip to content

Commit

Permalink
Created a *multi-lingual* P3L test.
Browse files Browse the repository at this point in the history
  • Loading branch information
Alexei V. Ivanov committed Jan 13, 2025
1 parent fbe6511 commit 48514b1
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions benchmarks/P3L_MLING.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@
--context-size=1024
--sample-size=512
)
should result in PPL ~ 8.42927
Running DeepSeek-V2 model
Expand Down

0 comments on commit 48514b1

Please sign in to comment.