(TG/TGG) Choose your pipeline

(TG/TGG) Choose your pipeline #24

Manually triggered November 25, 2024 12:19

Aswinmcw

⁠ e084ef3

Aswinmcw/tg_all_gather_perf

Status Failure

Total duration 3h 49m 21s

Artifacts 4

pipeline-select-galaxy.yaml

on: workflow_dispatch

build-artifact / ... / build-docker-image

19s

Matrix: build-artifact / build-artifact

Matrix: tg-frequent-tests / tg-frequent-tests

Waiting for pending jobs

Matrix: tg-model-perf-tests / tg-model-perf-tests

Matrix: tg-unit-tests / TG-tests

Waiting for pending jobs

Matrix: tg-unit-tests / TG-UMD-tests

Waiting for pending jobs

Matrix: tgg-frequent-tests / tgg-frequent-tests

Waiting for pending jobs

Matrix: tgg-model-perf-tests / tgg-model-perf-tests

Waiting for pending jobs

Matrix: tgg-unit-tests / TGG-tests

Waiting for pending jobs

Annotations

7 errors, 10 warnings, and 10 notices

tg-model-perf-tests / TG CNN model perf tests

Process completed with exit code 1.

tg-model-perf-tests / TG LLM model perf tests

The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

pcie-cards-are-being-used-cleanup

Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.

unsuccessful-reset-cleanup

Unable to reset board successfully, rebooting

tg-model-perf-tests / TG LLM model perf tests

The operation was canceled.

tg-model-perf-tests / TG LLM model perf tests

Process completed with exit code 1.

tg-model-perf-tests / TG LLM model perf tests

The action 'Run model perf regression tests' has timed out after 60 minutes.

unsuccessful-reset-attempt-cleanup