Skip to content

(Single-card) Nightly model and ttnn tests #6376

(Single-card) Nightly model and ttnn tests

(Single-card) Nightly model and ttnn tests #6376

Triggered via schedule December 11, 2024 04:00
Status Failure
Total duration 1h 36m 43s
Artifacts 36
build-artifact  /  ...  /  build-docker-image
24s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Matrix: fd-nightly / nightly-wh-unstable-models
Fit to window
Zoom out
Zoom in

Annotations

8 errors, 2 warnings, and 144 notices
fd-nightly / Nightly N150 common_models
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N150 stable_diffusion
Process completed with exit code 1.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
Process completed with exit code 1.
fd-nightly / Nightly N300 common_models
Process completed with exit code 1.
fd-nightly / FD GS ttnn nightly grayskull
The action 'Run frequent reg tests scripts' has timed out after 40 minutes.
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
fd-nightly / FD GS ttnn nightly grayskull
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N300 stable_diffusion
Process completed with exit code 1.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
fd-nightly / FD GS ttnn nightly grayskull
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 69 %
disk-usage-after-startup
Disk usage is 69 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 54 %
disk-usage-after-startup
Disk usage is 54 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 79 %
disk-usage-after-startup
Disk usage is 79 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 79 %
disk-usage-after-startup
Disk usage is 79 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 65 %
disk-usage-after-startup
Disk usage is 65 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 68 %
disk-usage-after-startup
Disk usage is 68 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 73 %
disk-usage-after-startup
Disk usage is 73 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 75 %
disk-usage-after-startup
Disk usage is 75 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 75 %
disk-usage-after-startup
Disk usage is 75 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 88 %
disk-usage-after-startup
Disk usage is 88 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 78 %
disk-usage-after-startup
Disk usage is 78 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 58 %
disk-usage-after-startup
Disk usage is 58 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 70 %
disk-usage-after-startup
Disk usage is 70 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 79 %
disk-usage-after-startup
Disk usage is 79 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 36 %
disk-usage-after-startup
Disk usage is 36 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 70 %
disk-usage-after-startup
Disk usage is 70 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 64 %
disk-usage-after-startup
Disk usage is 64 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 76 %
disk-usage-after-startup
Disk usage is 76 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 61 %
disk-usage-after-startup
Disk usage is 61 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 66 %
disk-usage-after-startup
Disk usage is 66 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull
311 MB
TTMetal_build_wormhole_b0
312 MB
test_reports_06a3152a-7714-4a6a-8fbc-bb90cd67686f
720 Bytes
test_reports_13ebff07-39d7-4460-a4c0-3702d5fc6add
5.54 KB
test_reports_152b85f9-5a52-4790-8f63-390b5d98207c
654 Bytes
test_reports_1cda4535-3563-4a4a-97b4-e7d3adc7e6f6
475 Bytes
test_reports_1e24383e-f47a-40cd-8ddc-bda660c96e1f
572 Bytes
test_reports_1e75abf9-6c15-4cd7-941b-4acaaabef393
804 Bytes
test_reports_253655ab-6786-42f8-9118-d37150285c59
624 Bytes
test_reports_274df9f8-e3ee-42a7-acab-c886e55d107d
721 Bytes
test_reports_2d16b4fe-c69f-4f11-bed1-a0519935d77f
707 Bytes
test_reports_2d67d9b8-9047-4205-bbf2-968fb54e1c04
1.27 KB
test_reports_2f2ca349-7af8-4bec-83de-ed6cf86916b2
5.54 KB
test_reports_318c24b0-49e9-441b-a5ba-59ef10befbd4
623 Bytes
test_reports_3cb39750-5a49-481b-8fb3-f8fa9f478c7d
1.27 KB
test_reports_3ff324c5-0004-4992-9efe-a0cff560144a
735 Bytes
test_reports_49b8deb2-8737-43a0-8bf6-824f71ab4e5f
653 Bytes
test_reports_4d2abb61-3011-4260-87ff-df618599b76c
1.36 KB
test_reports_5471bf47-4b4e-454f-9380-2be1dd65d97d
857 Bytes
test_reports_781a0cb4-9e84-4f43-8ed6-f65fc0e6e760
855 Bytes
test_reports_7e619859-e17d-446f-b491-ee10f77e5446
429 Bytes
test_reports_80111c35-7605-4f80-953c-1ab207dc28fc
969 Bytes
test_reports_8ec7a923-a16b-4845-b33a-821d6dc0d57f
429 Bytes
test_reports_91603122-b75b-45c1-bb00-a60db7148b39
611 Bytes
test_reports_9a651690-b617-44b0-9062-ea093d07e25f
606 Bytes
test_reports_9cc02007-c8d4-4b12-a2b8-1ee43c80151b
708 Bytes
test_reports_a1dd577b-8567-4c95-9bb9-5c1257175049
6.4 KB
test_reports_a3245a6c-2e14-44ef-a93d-9ef2175975db
627 Bytes
test_reports_b52a302b-e7ea-4a4b-a383-b2817019b676
719 Bytes
test_reports_c13083be-8fe1-4ebc-8168-e3a74d0c1199
477 Bytes
test_reports_d94b511d-d909-420d-88f1-40653f4cb2c7
805 Bytes
test_reports_dec79c1a-6227-4af8-a5c1-2fc7d40c09b0
1.06 KB
test_reports_e1251e70-23ed-4128-88a4-59a6fc5cfef9
483 Bytes
test_reports_e1d69d9a-e464-4f59-83a4-6745727195e8
635 Bytes
test_reports_f59cb507-afcb-4932-a71d-34f37a6907a5
547 Bytes
test_reports_fc568d55-15de-4ca1-8fd7-01b72043c52a
6.49 KB