(Single-card) Nightly model and ttnn tests #6362
shwetankTTfast-dispatch-full-regressions-and-models.yaml
on: workflow_dispatch
build-artifact
/
...
/
build-docker-image
23s
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Matrix: fd-nightly / nightly-wh-unstable-models
Annotations
22 errors, 4 warnings, and 209 notices
|
fd-nightly / Nightly N150 mistral7b_eth
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N150 mamba 3
Process completed with exit code 1.
|
|
fd-nightly / Nightly N150 common_models
Process completed with exit code 1.
|
|
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
Process completed with exit code 1.
|
|
fd-nightly / FD GS ttnn nightly grayskull
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N300 mamba 6
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N150 stable_diffusion
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N300 stable_diffusion
Process completed with exit code 1.
|
|
fd-nightly / FD WH N300 ttnn nightly wormhole_b0
Process completed with exit code 1.
|
|
fd-nightly / FD WH N150 ttnn nightly wormhole_b0
Process completed with exit code 1.
|
|
fd-nightly / Nightly N150 yolov4
The self-hosted runner: tt-metal-ci-vm-69 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
|
|
fd-nightly / Nightly N150 yolov4
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
|
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
|
fd-nightly / Nightly N300 functional_unet
The self-hosted runner: tt-metal-ci-vm-49 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
|
|
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
|
fd-nightly / Nightly N300 functional_unet
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
|
fd-nightly / Nightly N300 yolov4
The self-hosted runner: tt-metal-ci-vm-85 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
|
|
fd-nightly / Nightly N300 yolov4
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
|
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
|
fd-nightly / Nightly N150 functional_unet
The self-hosted runner: tt-metal-ci-vm-20 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
|
|
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
|
fd-nightly / Nightly N150 functional_unet
The action 'Run frequent reg tests scripts' has timed out after 30 minutes.
|
|
build-artifact / build-docker-image / build-docker-image
Unable to find merge base between 4b825dc642cb6eb9a060e54bf8d69288fbee4904 and b8f28551cc3a98ea9fbfc15c05b513c8f2d23e84
|
|
build-artifact / build-docker-image / build-docker-image
Set 'fetch_additional_submodule_history: true' to fetch additional submodule history for: tt_metal/third_party/pybind11
|
|
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
|
fd-nightly / [Unstable] Nightly N300 mamba 6
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
|
|
disk-usage-before-startup
Disk usage is 71 %
|
|
disk-usage-after-startup
Disk usage is 71 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 79 %
|
|
disk-usage-after-startup
Disk usage is 79 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 58 %
|
|
disk-usage-after-startup
Disk usage is 58 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 74 %
|
|
disk-usage-after-startup
Disk usage is 74 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 68 %
|
|
disk-usage-after-startup
Disk usage is 68 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 75 %
|
|
disk-usage-after-startup
Disk usage is 75 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 74 %
|
|
disk-usage-after-startup
Disk usage is 74 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 61 %
|
|
disk-usage-after-startup
Disk usage is 61 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 74 %
|
|
disk-usage-after-startup
Disk usage is 74 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 66 %
|
|
disk-usage-after-startup
Disk usage is 66 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 69 %
|
|
disk-usage-after-startup
Disk usage is 69 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 79 %
|
|
disk-usage-after-startup
Disk usage is 79 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 80 %
|
|
disk-usage-after-startup
Disk usage is 80 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 74 %
|
|
disk-usage-after-startup
Disk usage is 74 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 76 %
|
|
disk-usage-after-startup
Disk usage is 76 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 68 %
|
|
disk-usage-after-startup
Disk usage is 68 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 69 %
|
|
disk-usage-after-startup
Disk usage is 69 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 72 %
|
|
disk-usage-after-startup
Disk usage is 72 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 70 %
|
|
disk-usage-after-startup
Disk usage is 70 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 71 %
|
|
disk-usage-after-startup
Disk usage is 71 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 61 %
|
|
disk-usage-after-startup
Disk usage is 61 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 66 %
|
|
disk-usage-after-startup
Disk usage is 66 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 22 %
|
|
disk-usage-after-startup
Disk usage is 22 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 69 %
|
|
disk-usage-after-startup
Disk usage is 69 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 74 %
|
|
disk-usage-after-startup
Disk usage is 74 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 63 %
|
|
disk-usage-after-startup
Disk usage is 63 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 64 %
|
|
disk-usage-after-startup
Disk usage is 64 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 73 %
|
|
disk-usage-after-startup
Disk usage is 73 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
disk-usage-before-startup
Disk usage is 78 %
|
|
disk-usage-after-startup
Disk usage is 78 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
disk-usage-before-startup
Disk usage is 69 %
|
|
disk-usage-after-startup
Disk usage is 69 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
disk-usage-before-startup
Disk usage is 77 %
|
|
disk-usage-after-startup
Disk usage is 77 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
TTMetal_build_grayskull
|
311 MB |
|
|
TTMetal_build_wormhole_b0
|
312 MB |
|
|
test_reports_0946ab00-53e0-48e7-bde1-404cf1a7d1d3
|
909 Bytes |
|
|
test_reports_0a542e73-d69a-4ad2-9d36-be29807ee4b1
|
629 Bytes |
|
|
test_reports_0abe0a27-fae8-4ca7-b1b8-91c825eba207
|
746 Bytes |
|
|
test_reports_1072b4aa-9216-401d-b953-be87fc3e0f6a
|
5.52 KB |
|
|
test_reports_17412755-31ca-43e8-8796-a90c75b724ef
|
9.51 KB |
|
|
test_reports_271a1370-05a6-49d0-8a05-0445b3d00334
|
1.26 KB |
|
|
test_reports_2f27c9e7-3c23-4d2f-917e-2fb22faaa6f5
|
727 Bytes |
|
|
test_reports_3009326d-9a41-4356-8011-4a6e0a674d6a
|
429 Bytes |
|
|
test_reports_30ea4d68-ebe2-4183-8708-f6a5526d48ed
|
809 Bytes |
|
|
test_reports_3492e1ca-749b-4f05-a0fe-942ef94ec961
|
714 Bytes |
|
|
test_reports_3924c514-fa3d-40ee-a32f-2d7d457039f3
|
721 Bytes |
|
|
test_reports_49a173ca-52a8-4b8e-8292-cb862a7672bf
|
724 Bytes |
|
|
test_reports_4d9be255-abe1-4bef-a3d9-a8788b1d9c82
|
607 Bytes |
|
|
test_reports_5aec77ab-aeca-4fd0-a15f-0fe5457c2609
|
656 Bytes |
|
|
test_reports_5d7f69e4-4cb3-493c-b250-119d5b10978c
|
708 Bytes |
|
|
test_reports_6b0c9655-7582-46e7-b801-96e71eabf00e
|
5.55 KB |
|
|
test_reports_6bcfb6d4-7491-4c14-aeff-3135d605e36b
|
478 Bytes |
|
|
test_reports_721f8340-729f-4551-a6cf-2b5b9bb40322
|
804 Bytes |
|
|
test_reports_736bfac3-dfcb-4dc2-ae7b-67682996ba22
|
9.08 KB |
|
|
test_reports_81a78c33-ab12-4a82-a71b-4c1abc4487e1
|
1.35 KB |
|
|
test_reports_82b5ab3a-1987-4978-a797-9e91994f6e36
|
477 Bytes |
|
|
test_reports_9aeedd39-bb42-4bd1-b658-321014785b59
|
622 Bytes |
|
|
test_reports_a0340dde-9653-436b-a6f8-574f9f9ca085
|
430 Bytes |
|
|
test_reports_ade4c7c9-9fdb-493a-979b-b7f9206123d5
|
611 Bytes |
|
|
test_reports_bbd7eeb6-54b8-46f0-a1dc-76cf92972142
|
737 Bytes |
|
|
test_reports_c7fddf63-c285-4b7c-a9dd-402afc9494eb
|
853 Bytes |
|
|
test_reports_c896b568-f942-4246-b704-5d71f108b3aa
|
619 Bytes |
|
|
test_reports_e47d7d9f-a337-46f7-8d5b-4d42152ec3b4
|
1.31 KB |
|
|
test_reports_f221b0fb-7133-471a-bdff-87e5fb0fcb53
|
9 KB |
|
|
test_reports_f247581c-6a5d-42d5-8ee0-b57796b95647
|
483 Bytes |
|