Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update_pretrain_benchmarks #543

Merged
merged 43 commits into from
Oct 19, 2023
Merged

Update_pretrain_benchmarks #543

Show file tree
Hide file tree
Changes from 28 commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
47044fd
changed loc to look for yamls
Aug 16, 2023
a668a8d
ex.py submits run ok, needs correct data loading commands
Aug 16, 2023
c7f49dd
modified to work w/ new sdk features
Aug 17, 2023
90c6ff8
generates some results, off from what Vitaly calculated
Aug 17, 2023
985460c
update some metrics, scripts
Aug 18, 2023
8e3894a
fixed some bugs, currently using this script
Aug 22, 2023
2bd2c63
delete old prints \& ex.py
Aug 22, 2023
3f1da72
add compile settings
Aug 22, 2023
431051c
added some scripts
Aug 22, 2023
beb8dee
printing compile config deleted
Aug 22, 2023
bafaff1
update benchmarks
Aug 22, 2023
f4e30a0
modify script
Aug 23, 2023
1ead315
update ARGS to run locally
Aug 23, 2023
6c4f685
add local script
Aug 23, 2023
7f3339c
fix submit_benchmarks LOCAL
Aug 23, 2023
bfd7b12
update
Aug 23, 2023
6974395
reee
Aug 23, 2023
55ddafb
;|
Aug 23, 2023
201360b
;|
Aug 23, 2023
cd3e5fe
:|
Aug 23, 2023
463f7e6
:|
Aug 23, 2023
2d5038f
wip
Aug 29, 2023
568e61d
merge xformers
Sep 1, 2023
803e671
revert the attention commit
Oct 3, 2023
0ddf16b
undo attn on this branch
Oct 3, 2023
f2c1300
cleanup files
Oct 3, 2023
7fc2c35
remove h100 shell script
Oct 3, 2023
36fc5d2
remove random things
Oct 3, 2023
2542a2e
use dict
Oct 3, 2023
8306238
use mosaicml llmf
Oct 3, 2023
4b482bd
updated a100 numbers
Oct 3, 2023
722c6c4
added back old numbers that I didn't reproduce
Oct 3, 2023
7572242
Update submit_benchmarks.py -- enable fp8 deps iff h100 and fp8
crinard Oct 10, 2023
061f2c7
Added TFLOP column
Oct 18, 2023
669d1aa
whoops -- fix
Oct 18, 2023
33512df
Correct TFLOP units
crinard Oct 18, 2023
53a3028
Punt H100 350m numbers
crinard Oct 18, 2023
0a516dc
calculate TFLOPS not FLOPS
Oct 18, 2023
a3f2ee5
Merge branch 'main' into run_initial
vchiley Oct 18, 2023
a17455f
lint & pyright
vchiley Oct 18, 2023
9e99a42
Merge branch 'main' into run_initial
vchiley Oct 18, 2023
a7c7567
daniel review v1
vchiley Oct 19, 2023
83db3f0
rm compile support in profiling
vchiley Oct 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading