(Single-card) Nightly model and ttnn tests #6075
tt-rkimfast-dispatch-full-regressions-and-models.yaml
on: schedule
build-artifact
/
...
/
build-docker-image
39s
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Matrix: fd-nightly / nightly-wh-unstable-models
Annotations
9 errors, 2 warnings, and 187 notices
|
fd-nightly / [Unstable] Nightly N150 mamba 2
Process completed with exit code 1.
|
|
fd-nightly / Nightly N150 resnet50
Process completed with exit code 1.
|
|
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
|
fd-nightly / [Unstable] Nightly N150 mamba 3
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N150 mamba 3
The action 'Run frequent reg tests scripts' has timed out after 60 minutes.
|
|
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
Process completed with exit code 1.
|
|
fd-nightly / Nightly N300 functional_unet
The self-hosted runner: tt-metal-ci-vm-111 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
|
|
fd-nightly / [Unstable] Nightly N300 mamba 3
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N300 mamba 2
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N150 mamba 3
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
|
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
|
disk-usage-before-startup
Disk usage is 90 %
|
|
disk-usage-after-startup
Disk usage is 90 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 86 %
|
|
disk-usage-after-startup
Disk usage is 86 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 83 %
|
|
disk-usage-after-startup
Disk usage is 83 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 88 %
|
|
disk-usage-after-startup
Disk usage is 88 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 75 %
|
|
disk-usage-after-startup
Disk usage is 75 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 92 %
|
|
disk-usage-after-startup
Disk usage is 92 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 77 %
|
|
disk-usage-after-startup
Disk usage is 77 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 50 %
|
|
disk-usage-after-startup
Disk usage is 50 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
attempting-reset-cleanup
Attempting to reset card(s).
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 56 %
|
|
disk-usage-after-startup
Disk usage is 56 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 88 %
|
|
disk-usage-after-startup
Disk usage is 88 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 88 %
|
|
disk-usage-after-startup
Disk usage is 88 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 85 %
|
|
disk-usage-after-startup
Disk usage is 85 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 80 %
|
|
disk-usage-after-startup
Disk usage is 80 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 71 %
|
|
disk-usage-after-startup
Disk usage is 71 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 78 %
|
|
disk-usage-after-startup
Disk usage is 78 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 70 %
|
|
disk-usage-after-startup
Disk usage is 70 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 76 %
|
|
disk-usage-after-startup
Disk usage is 76 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 83 %
|
|
disk-usage-after-startup
Disk usage is 83 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 55 %
|
|
disk-usage-after-startup
Disk usage is 55 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 71 %
|
|
disk-usage-after-startup
Disk usage is 71 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 81 %
|
|
disk-usage-after-startup
Disk usage is 81 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 89 %
|
|
disk-usage-after-startup
Disk usage is 89 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 95 %
|
|
disk-usage-after-startup
Disk usage is 95 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 76 %
|
|
disk-usage-after-startup
Disk usage is 76 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 91 %
|
|
disk-usage-after-startup
Disk usage is 91 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 55 %
|
|
disk-usage-after-startup
Disk usage is 55 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 66 %
|
|
disk-usage-after-startup
Disk usage is 66 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
TTMetal_build_grayskull
|
299 MB |
|
|
TTMetal_build_wormhole_b0
|
300 MB |
|
|
test_reports_0c2b884d-03b3-47ea-9da8-003c97ce89bd
|
480 Bytes |
|
|
test_reports_0f1ce35d-2f57-4e3c-86b3-fba7c90a86ed
|
627 Bytes |
|
|
test_reports_18ee2826-8dd8-4585-8596-f7ef4b0681c5
|
4.66 KB |
|
|
test_reports_236d7c21-e250-4599-9c27-ac2487567a37
|
5.93 KB |
|
|
test_reports_2c673f7b-be34-4b9b-a489-1cd4d11d9e70
|
653 Bytes |
|
|
test_reports_3a2d7195-1051-4449-ada5-910f40cc8ea1
|
725 Bytes |
|
|
test_reports_4d02f603-cf53-4f48-ba39-7b40c35c0590
|
480 Bytes |
|
|
test_reports_4ea9eeae-4ae8-41e6-8d0b-877534034fed
|
550 Bytes |
|
|
test_reports_54c9d244-d18a-45ea-9e52-51c4856fd0a4
|
5.93 KB |
|
|
test_reports_5a6d040d-a5f9-42c3-8552-794c232007c8
|
432 Bytes |
|
|
test_reports_5a845edd-732a-4ac8-9b02-83f750270498
|
3.5 KB |
|
|
test_reports_65b2ba34-29e7-4256-b6cd-b1748a5dcc51
|
704 Bytes |
|
|
test_reports_6c72734e-e870-4698-bc2d-289f83365a40
|
2.67 KB |
|
|
test_reports_6ef0cd31-5cb8-4814-9201-0327e4b79425
|
483 Bytes |
|
|
test_reports_71dbd74b-7026-400e-8a8d-20084de80fc3
|
609 Bytes |
|
|
test_reports_77d2f6fb-51fa-46ea-8f3b-6a9f6201eca1
|
711 Bytes |
|
|
test_reports_7b841f82-979d-487d-b5c8-2cf123306aff
|
1.36 KB |
|
|
test_reports_869ece78-f2df-4eb8-a953-a49ff1943f7f
|
1.32 KB |
|
|
test_reports_8e81c8fe-594e-4d6b-9efe-f50055ac45c2
|
1.32 KB |
|
|
test_reports_8f13d146-20c5-49aa-84a9-c16d6f9fdf41
|
740 Bytes |
|
|
test_reports_9406282c-0408-43d5-857d-c2f93975f8a8
|
631 Bytes |
|
|
test_reports_991faf3d-c1f5-42c8-a745-0f9259a453b4
|
717 Bytes |
|
|
test_reports_99da8dce-ed62-4c5b-86c8-67318e4b79ca
|
551 Bytes |
|
|
test_reports_acd372aa-045e-4924-bcba-b2686da15780
|
618 Bytes |
|
|
test_reports_ad8995d0-0469-42b6-a7d5-5ff11c849516
|
622 Bytes |
|
|
test_reports_b1b703ae-bbb0-40c5-ae30-73543aa3c91a
|
824 Bytes |
|
|
test_reports_b1fc373f-3ece-4c3e-93d0-ba9a0950434d
|
707 Bytes |
|
|
test_reports_ba48f701-7a92-4c28-ab40-033839cfd37c
|
4.66 KB |
|
|
test_reports_ce10fb8d-147e-449b-9301-47bf0e2abed8
|
432 Bytes |
|
|
test_reports_ceeb5192-fef5-440f-bd85-aa54c98c90ce
|
650 Bytes |
|
|
test_reports_d9e71de4-44af-4eaa-854d-eb977b2c209b
|
6.31 KB |
|
|
test_reports_e25da7f7-58ce-4e18-948d-0cbe3ca3ea37
|
1.13 KB |
|
|
test_reports_f79102a1-6415-483c-ad73-cd56157a8d2f
|
654 Bytes |
|