Code

Add eval loader to eval script#742

Code

Merged

aspfohl merged 14 commits intomainmosaicml/llm-foundry:mainfrom anna/evalloadermosaicml/llm-foundry:anna/evalloaderCopy head branch name to clipboardNov 30, 2023

+469-165

Commits

Commits on Nov 16, 2023

• Add eval loader to eval script

  aspfohl

  committed
  774c62e

  Copy full SHA for 774c62e

• small input tests

  aspfohl

  committed
  6c7af31

  Copy full SHA for 6c7af31

• Merge branch 'main' into anna/evalloader

  aspfohl

  authored
  0797a6c

  Copy full SHA for 0797a6c

Commits on Nov 27, 2023

• updates

  aspfohl

  committed
  13cbc13

  Copy full SHA for 13cbc13

• fix typing and formatting

  aspfohl

  committed
  204d2f7

  Copy full SHA for 204d2f7

Commits on Nov 28, 2023

• fixes, add tests

  aspfohl

  committed
  5b85218

  Copy full SHA for 5b85218

• Merge branch 'main' into anna/evalloader

  aspfohl

  authored
  1a0a3da

  Copy full SHA for 1a0a3da

• remove circular dependency

  aspfohl

  committed
  972ed96

  Copy full SHA for 972ed96

• tests pass

  aspfohl

  committed
  9840589

  Copy full SHA for 9840589

Commits on Nov 29, 2023

• nits + small fixes

  aspfohl

  committed
  bc1c7c7

  Copy full SHA for bc1c7c7

Commits on Nov 30, 2023

• add metrics at the end, refactor to put icl/gauntlet as helpers

  aspfohl

  committed
  1050def

  Copy full SHA for 1050def

• Merge branch 'main' into anna/evalloader

  aspfohl

  authored
  beefdc3

  Copy full SHA for beefdc3

• NOT

  aspfohl

  committed
  549abb6

  Copy full SHA for 549abb6

• metrics instead of models, add unit tests

  aspfohl

  committed
  084d8b6

  Copy full SHA for 084d8b6