Code

Add split_eval_set command#1609

Code

Closed

jimmyxu-db wants to merge 23 commits intomainmosaicml/llm-foundry:mainfrom jimmy/data-splitmosaicml/llm-foundry:jimmy/data-splitCopy head branch name to clipboard

+531-48

Commits

Commits on Oct 21, 2024

• refactor hf download

  

  mattyding

  authored and

  jimmyxu-db

  committed
  4cdcda0

Commits on Oct 22, 2024

• split_eval_set skeleton

  

  mattyding

  authored and

  jimmyxu-db

  committed
  a1385b4

• splitting script

  

  mattyding

  authored and

  jimmyxu-db

  committed
  87d7a4c

• error handling and testing

  

  mattyding

  authored and

  jimmyxu-db

  committed
  b04651f

• undo autoformat

  

  mattyding

  authored and

  jimmyxu-db

  committed
  cc42fe4

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  0d5ef2b

Commits on Oct 24, 2024

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  aaf8df8

Commits on Oct 25, 2024

• add regex tests

  Show description for 41eeb49
  jimmyxu-db

  committed
  41eeb49

Commits on Oct 28, 2024

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  06ccb06

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  db0e485

• remove hf support

  Show description for 87d0279
  jimmyxu-db

  committed
  87d0279

• fix dataloader test?

  Show description for 81f3b8f
  jimmyxu-db

  committed
  81f3b8f

• lint

  Show description for d14fde5
  jimmyxu-db

  committed
  d14fde5

• lint

  Show description for e7cca17
  jimmyxu-db

  committed
  e7cca17

Commits on Oct 29, 2024

• some comments

  Show description for a4327bb
  jimmyxu-db

  committed
  a4327bb

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  10b3e62

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  988c46c

• comments

  Show description for 39676be
  jimmyxu-db

  committed
  39676be

• Merge remote-tracking branch 'origin/main' into jimmy/data-split

  jimmyxu-db

  committed
  f64c1f4

• make tmpdir

  Show description for a35c6d9
  jimmyxu-db

  committed
  a35c6d9

• default to local

  Show description for 7ec1988
  jimmyxu-db

  committed
  7ec1988

• remove unknown test

  Show description for c97fbb5
  jimmyxu-db

  committed
  c97fbb5

• rename

  Show description for dd0de09
  jimmyxu-db

  committed
  dd0de09