(Single-card) Nightly model and ttnn tests #6269
tt-rkimfast-dispatch-full-regressions-and-models.yaml
on: schedule
build-artifact
/
...
/
build-docker-image
21s
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Matrix: fd-nightly / nightly-wh-unstable-models
Annotations
7 errors, 1 warning, and 195 notices
|
fd-nightly / Nightly N150 llama3.2-1B
Process completed with exit code 1.
|
|
fd-nightly / [Unstable] Nightly N150 mamba 4
Process completed with exit code 1.
|
|
fd-nightly / Nightly N150 qwen
Process completed with exit code 1.
|
|
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
The self-hosted runner: tt-metal-ci-vm-51 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
|
|
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
The action 'Run frequent reg tests scripts' has timed out after 10 minutes.
|
|
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
|
|
fd-nightly / Nightly N300 llama3.2-1B
Process completed with exit code 1.
|
|
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 53 %
|
|
disk-usage-after-startup
Disk usage is 53 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 80 %
|
|
disk-usage-after-startup
Disk usage is 80 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 65 %
|
|
disk-usage-after-startup
Disk usage is 65 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 84 %
|
|
disk-usage-after-startup
Disk usage is 84 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 69 %
|
|
disk-usage-after-startup
Disk usage is 69 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 82 %
|
|
disk-usage-after-startup
Disk usage is 82 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 65 %
|
|
disk-usage-after-startup
Disk usage is 65 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 45 %
|
|
disk-usage-after-startup
Disk usage is 45 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 65 %
|
|
disk-usage-after-startup
Disk usage is 65 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 85 %
|
|
disk-usage-after-startup
Disk usage is 85 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 61 %
|
|
disk-usage-after-startup
Disk usage is 61 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 86 %
|
|
disk-usage-after-startup
Disk usage is 86 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 62 %
|
|
disk-usage-after-startup
Disk usage is 62 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 63 %
|
|
disk-usage-after-startup
Disk usage is 63 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 64 %
|
|
disk-usage-after-startup
Disk usage is 64 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 85 %
|
|
disk-usage-after-startup
Disk usage is 85 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 66 %
|
|
disk-usage-after-startup
Disk usage is 66 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 64 %
|
|
disk-usage-after-startup
Disk usage is 64 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 73 %
|
|
disk-usage-after-startup
Disk usage is 73 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 73 %
|
|
disk-usage-after-startup
Disk usage is 73 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 87 %
|
|
disk-usage-after-startup
Disk usage is 87 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 68 %
|
|
disk-usage-after-startup
Disk usage is 68 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 64 %
|
|
disk-usage-after-startup
Disk usage is 64 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
attempting-reset-cleanup
Attempting to reset card(s).
|
|
disk-usage-before-startup
Disk usage is 71 %
|
|
disk-usage-after-startup
Disk usage is 71 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 82 %
|
|
disk-usage-after-startup
Disk usage is 82 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 81 %
|
|
disk-usage-after-startup
Disk usage is 81 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 83 %
|
|
disk-usage-after-startup
Disk usage is 83 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 69 %
|
|
disk-usage-after-startup
Disk usage is 69 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
printing-out-smi-info-cleanup
Touching and printing out SMI info
|
|
successful-reset-cleanup
tt-smi reset was successful
|
|
reset-successful-cleanup
tt-smi reset was successful
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
TTMetal_build_grayskull
|
303 MB |
|
|
TTMetal_build_wormhole_b0
|
303 MB |
|
|
test_reports_0f208577-02c9-4c2f-a3fc-2a770f8762ae
|
4.58 KB |
|
|
test_reports_1dd5f64c-3756-4649-a3e2-a7c4ca267763
|
6.75 KB |
|
|
test_reports_23f0a90d-a44d-41b6-ae2d-17616e4e8713
|
549 Bytes |
|
|
test_reports_2728ab20-d04d-4af6-8b68-7ec3d33ebfcc
|
479 Bytes |
|
|
test_reports_2fabbbb9-39f5-4499-b919-4766fceb6a9a
|
626 Bytes |
|
|
test_reports_40e702bc-1e2b-43e5-9fbe-ac577b4b3e4d
|
477 Bytes |
|
|
test_reports_43c6a8c6-4548-46a0-ad3b-d77e97ef9f44
|
628 Bytes |
|
|
test_reports_55e50d4f-1f45-428e-bc58-c5e24b608f5d
|
811 Bytes |
|
|
test_reports_67a13327-adf4-4c89-8793-a65c89c0a8db
|
626 Bytes |
|
|
test_reports_6b69eaf9-d463-4278-94c4-06793e496c82
|
652 Bytes |
|
|
test_reports_6fd3d3bb-4dc0-4b58-a371-76f9f47aa948
|
653 Bytes |
|
|
test_reports_749a4f37-64cd-4ad2-b162-e6a111a6530f
|
712 Bytes |
|
|
test_reports_773dff23-e849-4e81-a07c-26d786b39906
|
607 Bytes |
|
|
test_reports_7bc47dfc-3d28-459e-8a02-e879d25a9d88
|
722 Bytes |
|
|
test_reports_7c016918-0fce-4b51-807b-afba1eacda65
|
4.64 KB |
|
|
test_reports_7d98f6c3-36f6-4ee8-9505-dd91370f604d
|
610 Bytes |
|
|
test_reports_7e454c5c-05bc-4ede-b09a-c553bcd9d205
|
809 Bytes |
|
|
test_reports_825f4290-cc70-48d2-9200-009cfca7f130
|
6.25 KB |
|
|
test_reports_82bde1d0-cb6c-4540-ad68-b1a65eaaa17c
|
963 Bytes |
|
|
test_reports_8cf2e9c9-5226-4815-a851-e531d628e789
|
477 Bytes |
|
|
test_reports_974ae37a-cc42-41c2-b559-ec013f080869
|
1.33 KB |
|
|
test_reports_9e5c4c1e-776c-4ed8-a7ab-b0d733ab5128
|
1.31 KB |
|
|
test_reports_a109a597-df14-43de-a24a-c548431af06d
|
548 Bytes |
|
|
test_reports_a2615b7b-71a7-47f1-897d-553a797cad9c
|
1.09 KB |
|
|
test_reports_b128f8e6-62c4-4b9f-a9e8-9e9c14be14d7
|
1.37 KB |
|
|
test_reports_b3534f77-a431-47d8-8ff8-0425d7a8fa43
|
706 Bytes |
|
|
test_reports_b5d14f9f-eb5b-48ae-bd7b-3683eafce64a
|
484 Bytes |
|
|
test_reports_ce5243ae-6abc-4209-a663-872ad76a21ec
|
832 Bytes |
|
|
test_reports_cf3c5ec9-28cd-410b-b596-f75fe521fb64
|
624 Bytes |
|
|
test_reports_d9760f97-c83a-4462-ab28-ffaae1e6d5d8
|
478 Bytes |
|
|
test_reports_da55f480-31c8-42fe-8eb3-11325b0facb6
|
735 Bytes |
|
|
test_reports_e854e3b2-3c81-431b-b873-1bbb6ec1189d
|
6.23 KB |
|
|
test_reports_efa30c35-b43c-4f64-900a-a804cd7584b7
|
856 Bytes |
|
|
test_reports_f3a00911-c2ec-4017-9257-bd7436786afe
|
862 Bytes |
|
|
test_reports_f8320869-abd9-4bb5-a285-b3e31c16bbc5
|
3.01 KB |
|