(Single-card) Model perf tests #6444
perf-models.yaml
on: workflow_dispatch
build-artifact
/
...
/
build-docker-image
2m 33s
Matrix: build-artifact / build-artifact
Matrix: models-perf / models-perf
Annotations
4 errors, 2 warnings, and 57 notices
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
models-perf / llm_javelin N300 WH B0
Process completed with exit code 1.
|
models-perf / llm_javelin N300 WH B0
Process completed with exit code 2.
|
models-perf / llm_javelin N300 WH B0
The action 'Run performance regressions' has timed out after 70 minutes.
|
build-artifact / build-docker-image / build-docker-image
Unable to find merge base between f0cbccf5c58db19123d01e56351153392e6cd960 and 50796e4f179ed441db96becb59eec17f70a20a7e
|
build-artifact / build-docker-image / build-docker-image
Set 'fetch_additional_submodule_history: true' to fetch additional submodule history for: tt_metal/third_party/tt_llk_blackhole
|
disk-usage-before-startup
Disk usage is 33 %
|
disk-usage-after-startup
Disk usage is 33 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 33 %
|
disk-usage-after-startup
Disk usage is 33 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 33 %
|
disk-usage-after-startup
Disk usage is 33 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 60 %
|
disk-usage-after-startup
Disk usage is 60 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 90 %
|
disk-usage-after-startup
Disk usage is 90 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 33 %
|
disk-usage-after-startup
Disk usage is 33 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 33 %
|
disk-usage-after-startup
Disk usage is 33 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 59 %
|
disk-usage-after-startup
Disk usage is 59 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
attempting-reset-cleanup
Attempting to reset card(s).
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
TTMetal_build_grayskull
|
299 MB |
|
TTMetal_build_wormhole_b0
|
299 MB |
|
perf-report-csv-cnn_javelin-grayskull-bare_metal
|
347 Bytes |
|
perf-report-csv-cnn_javelin-wormhole_b0-bare_metal
|
510 Bytes |
|
perf-report-csv-llm_javelin-grayskull-bare_metal
|
753 Bytes |
|
perf-report-csv-other-grayskull-bare_metal
|
1.13 KB |
|
perf-report-csv-other-wormhole_b0-bare_metal
|
724 Bytes |
|