Code

Update_pretrain_benchmarks#543

Code

Merged

vchiley merged 43 commits intomosaicml:mainmosaicml/llm-foundry:mainfrom crinard:run_initialcrinard/llm-foundry:run_initialCopy head branch name to clipboardOct 19, 2023

+504-348

Commits

Commits on Oct 3, 2023

• changed loc to look for yamls

  

  Chris Rinard

  committed
  47044fd

• ex.py submits run ok, needs correct data loading commands

  

  Chris Rinard

  committed
  a668a8d

• modified to work w/ new sdk features

  

  Chris Rinard

  committed
  c7f49dd

• generates some results, off from what Vitaly calculated

  

  Chris Rinard

  committed
  90c6ff8

• update some metrics, scripts

  

  Chris Rinard

  committed
  985460c

• fixed some bugs, currently using this script

  

  Chris Rinard

  committed
  8e3894a

• delete old prints \& ex.py

  

  Chris Rinard

  committed
  2bd2c63

• add compile settings

  

  Chris Rinard

  committed
  3f1da72

• added some scripts

  

  Chris Rinard

  committed
  431051c

• printing compile config deleted

  

  Chris Rinard

  committed
  beb8dee

• update benchmarks

  

  Chris Rinard

  committed
  bafaff1

• modify script

  

  Chris Rinard

  committed
  f4e30a0

• update ARGS to run locally

  

  Chris Rinard

  committed
  1ead315

• add local script

  

  Chris Rinard

  committed
  6c4f685

• fix submit_benchmarks LOCAL

  

  Chris Rinard

  committed
  7f3339c

• update

  

  Chris Rinard

  committed
  bfd7b12

• reee

  

  Chris Rinard

  committed
  6974395

• ;|

  

  Chris Rinard

  committed
  55ddafb

• ;|

  

  Chris Rinard

  committed
  201360b

• :|

  

  Chris Rinard

  committed
  cd3e5fe

• :|

  

  Chris Rinard

  committed
  463f7e6

• wip

  

  Chris Rinard

  committed
  2d5038f

• merge xformers

  

  Chris Rinard

  committed
  568e61d

• revert the attention commit

  

  Chris Rinard

  committed
  803e671

• undo attn on this branch

  

  Chris Rinard

  committed
  0ddf16b

• cleanup files

  

  Chris Rinard

  committed
  f2c1300

• remove h100 shell script

  

  Chris Rinard

  committed
  7fc2c35

• remove random things

  

  Chris Rinard

  committed
  36fc5d2

• use dict

  

  Chris Rinard

  committed
  2542a2e

• use mosaicml llmf

  

  Chris Rinard

  committed
  8306238

• updated a100 numbers

  

  Chris Rinard

  committed
  4b482bd

• added back old numbers that I didn't reproduce

  

  Chris Rinard

  committed
  722c6c4

Commits on Oct 10, 2023

• Update submit_benchmarks.py -- enable fp8 deps iff h100 and fp8

  crinard

  authored
  7572242

Commits on Oct 18, 2023

• Added TFLOP column

  

  Chris Rinard

  committed
  061f2c7

• whoops -- fix

  

  Chris Rinard

  committed
  669d1aa

• Correct TFLOP units

  crinard

  authored
  33512df

• Punt H100 350m numbers

  crinard

  authored
  53a3028

• calculate TFLOPS not FLOPS

  

  Chris Rinard

  committed
  0a516dc

• Merge branch 'main' into run_initial

  vchiley

  authored
  a3f2ee5

• lint & pyright

  vchiley

  committed
  a17455f

• Merge branch 'main' into run_initial

  vchiley

  authored
  9e99a42

Commits on Oct 19, 2023

• daniel review v1

  vchiley

  committed
  a7c7567

• rm compile support in profiling

  vchiley

  committed
  83db3f0