Skip to content

(Single-card) Nightly model and ttnn tests #6375

(Single-card) Nightly model and ttnn tests

(Single-card) Nightly model and ttnn tests #6375

Manually triggered December 11, 2024 03:36
Status Failure
Total duration 1h 39m 27s
Artifacts 36
build-artifact  /  ...  /  build-docker-image
31s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Matrix: fd-nightly / nightly-wh-unstable-models
Fit to window
Zoom out
Zoom in

Annotations

6 errors, 6 warnings, and 144 notices
fd-nightly / [Unstable] Nightly N150 mamba 1
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N150 mamba 4
Process completed with exit code 1.
fd-nightly / [Unstable] Nightly N150 stable_diffusion
Process completed with exit code 1.
fd-nightly / FD GS-only models grayskull
The self-hosted runner: tt-metal-ci-vm-56 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
The self-hosted runner: tt-metal-ci-vm-151 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
fd-nightly / [Unstable] Nightly N300 stable_diffusion
Process completed with exit code 1.
build-artifact / build-docker-image / build-docker-image
Unable to find merge base between 4b825dc642cb6eb9a060e54bf8d69288fbee4904 and b8f28551cc3a98ea9fbfc15c05b513c8f2d23e84
build-artifact / build-docker-image / build-docker-image
Set 'fetch_additional_submodule_history: true' to fetch additional submodule history for: tt_metal/third_party/pybind11
build-artifact / build-docker-image / build-docker-image
Unable to find merge base between 7536fbacd75a4ad62047c63c9c54176fae079e06 and 8b5afa5b0f92841f13d49263482bdde6aaeef4ca
build-artifact / build-docker-image / build-docker-image
Set 'fetch_additional_submodule_history: true' to fetch additional submodule history for: tt_metal/third_party/tt_llk_blackhole
build-artifact / build-docker-image / build-docker-image
Unable to find merge base between 0f57d4e9dec602b68671be8891e7af876285f275 and ed02df9eb4bbfb37da1b9d9a8a129f1f6842a6cd
build-artifact / build-docker-image / build-docker-image
Set 'fetch_additional_submodule_history: true' to fetch additional submodule history for: tt_metal/third_party/tt_llk_wormhole_b0
disk-usage-before-startup
Disk usage is 65 %
disk-usage-after-startup
Disk usage is 65 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 86 %
disk-usage-after-startup
Disk usage is 86 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 67 %
disk-usage-after-startup
Disk usage is 67 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 73 %
disk-usage-after-startup
Disk usage is 73 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 75 %
disk-usage-after-startup
Disk usage is 75 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 54 %
disk-usage-after-startup
Disk usage is 54 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 67 %
disk-usage-after-startup
Disk usage is 67 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 80 %
disk-usage-after-startup
Disk usage is 80 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 80 %
disk-usage-after-startup
Disk usage is 80 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 55 %
disk-usage-after-startup
Disk usage is 55 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 58 %
disk-usage-after-startup
Disk usage is 58 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 59 %
disk-usage-after-startup
Disk usage is 59 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 65 %
disk-usage-after-startup
Disk usage is 65 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 64 %
disk-usage-after-startup
Disk usage is 64 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 78 %
disk-usage-after-startup
Disk usage is 78 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 88 %
disk-usage-after-startup
Disk usage is 88 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 79 %
disk-usage-after-startup
Disk usage is 79 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 69 %
disk-usage-after-startup
Disk usage is 69 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 65 %
disk-usage-after-startup
Disk usage is 65 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 79 %
disk-usage-after-startup
Disk usage is 79 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 79 %
disk-usage-after-startup
Disk usage is 79 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 80 %
disk-usage-after-startup
Disk usage is 80 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 75 %
disk-usage-after-startup
Disk usage is 75 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 74 %
disk-usage-after-startup
Disk usage is 74 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 73 %
disk-usage-after-startup
Disk usage is 73 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 75 %
disk-usage-after-startup
Disk usage is 75 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull
311 MB
TTMetal_build_wormhole_b0
312 MB
test_reports_00531554-fb8f-4851-a2a3-e88dc0e9e920
620 Bytes
test_reports_00a73253-4820-445d-b46c-ebba6db50ffa
5.56 KB
test_reports_0422c09d-9345-48ce-a74b-167d9c96e807
1.33 KB
test_reports_061807f6-646a-43a8-b8ca-1a170accfa47
735 Bytes
test_reports_0babec37-7c4a-4fa6-86a9-e8400cbd562a
718 Bytes
test_reports_0dede580-959a-4a4d-8d56-7f5e7e2664d8
836 Bytes
test_reports_1b80ce97-1223-4ebb-b618-0eb2e049fd77
653 Bytes
test_reports_2e09fbb7-19a3-4e71-bd35-8e43bd863a2e
809 Bytes
test_reports_304f3f71-3291-4e51-b325-257b84934d66
6.87 KB
test_reports_312d30a4-6535-479b-a0c7-23efc30661cb
550 Bytes
test_reports_3831e6d5-4fb5-437f-abd4-d24554dcb81f
475 Bytes
test_reports_3f268a7d-85bd-4ccb-8c6b-63b0e5d19d97
480 Bytes
test_reports_56225d5c-f4b0-4c80-818f-0561391afb1d
627 Bytes
test_reports_6230217a-99c0-430b-b59f-c0d14e1e7aa1
1.33 KB
test_reports_64d57b1e-9761-417a-9665-78c8867bfa11
604 Bytes
test_reports_72d7b131-379f-49dd-8c5e-23a85bb015b7
710 Bytes
test_reports_80542e82-7bfb-425c-94b9-b00de8893c88
431 Bytes
test_reports_8a5e4dec-afc7-415e-b102-8931bb619301
5.51 KB
test_reports_95583098-098c-451d-81c7-4936e602c945
737 Bytes
test_reports_a38a2229-fea8-4664-8ae0-fba90af7ce99
653 Bytes
test_reports_b0e69ecb-3c0f-4ddb-a6d0-3278f0151d08
855 Bytes
test_reports_c08f9b37-e2c0-45ea-8a5b-97db9cdf882a
431 Bytes
test_reports_c35ca314-1e68-4206-8e33-e4402876d435
1.07 KB
test_reports_d03fc913-985d-4ac7-bce7-7cd71f17e686
971 Bytes
test_reports_d4aa53c1-e6ca-4a46-9b4b-4c800b4d973d
835 Bytes
test_reports_d5c54580-a2bb-4783-824e-108f7645f48f
614 Bytes
test_reports_de902a66-6f3c-4208-abb3-d8ff0e1ea1ce
624 Bytes
test_reports_df6187c9-ffec-4a81-ba95-3bc022c8f92d
547 Bytes
test_reports_e1fcec3b-4f53-484d-80d1-4e4d814c2fb8
6.43 KB
test_reports_e3990741-a645-473c-bf50-43e1fc103a9e
854 Bytes
test_reports_ec96aecc-4813-4782-829f-2a31050668e1
807 Bytes
test_reports_ecea4cd1-128c-47f0-aac8-176df7bc1060
1.36 KB
test_reports_ee14b872-34b0-42f8-b05c-53346f30ac69
6.39 KB
test_reports_f3f7ce8e-4ebc-4c25-a994-4a9e4b026132
619 Bytes