Skip to content

(Single-card) Device perf regressions #3604

(Single-card) Device perf regressions

(Single-card) Device perf regressions #3604

Manually triggered November 19, 2024 07:34
Status Failure
Total duration 2h 43m 30s
Artifacts 3

perf-device-models.yaml

on: workflow_dispatch
build-artifact-profiler  /  ...  /  build-docker-image
35s
build-artifact-profiler / build-docker-image / build-docker-image
Matrix: build-artifact-profiler / build-artifact
Matrix: device-perf / device-perf
Fit to window
Zoom out
Zoom in

Annotations

5 errors and 15 notices
device-perf / GS device perf
Process completed with exit code 2.
device-perf / GS device perf
The action 'Run device performance regressions' has timed out after 40 minutes.
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
device-perf / GS device perf
Process completed with exit code 1.
device-perf / N300 WH B0 device perf
Process completed with exit code 1.
disk-usage-before-startup
Disk usage is 94 %
disk-usage-after-startup
Disk usage is 94 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
disk-usage-before-startup
Disk usage is 90 %
disk-usage-after-startup
Disk usage is 90 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull_profiler
306 MB
TTMetal_build_wormhole_b0_profiler
306 MB
device-perf-report-csv-wormhole_b0-bare_metal
1.05 KB