(Single-card) Model perf tests #6459
perf-models.yaml
on: workflow_dispatch
build-artifact
/
...
/
build-docker-image
19s
Matrix: build-artifact / build-artifact
Matrix: models-perf / models-perf
Annotations
4 errors, 2 warnings, and 43 notices
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
models-perf / llm_javelin N300 WH B0
Process completed with exit code 1.
|
models-perf / llm_javelin N300 WH B0
Process completed with exit code 2.
|
models-perf / llm_javelin N300 WH B0
The action 'Run performance regressions' has timed out after 70 minutes.
|
models-perf / other N300 WH B0
Failed to download action 'https://api.github.com/repos/tenstorrent/tt-metal/tarball/78075c68b6f25399a4c27e5c5082bafc2a350bc1'. Error: Resource temporarily unavailable (codeload.github.com:443)
|
models-perf / other N300 WH B0
Back off 24.358 seconds before retry.
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 34 %
|
disk-usage-after-startup
Disk usage is 34 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 34 %
|
disk-usage-after-startup
Disk usage is 34 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 90 %
|
disk-usage-after-startup
Disk usage is 90 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 34 %
|
disk-usage-after-startup
Disk usage is 34 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 60 %
|
disk-usage-after-startup
Disk usage is 60 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
attempting-reset-cleanup
Attempting to reset card(s).
|
successful-reset-cleanup
tt-smi reset was successful
|
reset-successful-cleanup
tt-smi reset was successful
|
disk-usage-before-startup
Disk usage is 59 %
|
disk-usage-after-startup
Disk usage is 59 %
|
printing-smi-info-startup
Touching and printing out SMI info
|
reset-successful-startup
tt-smi reset was successful
|