Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kind that demonstrates how to modify the upstream graph in a transform #438

Closed
wants to merge 2 commits into from

Add hacky kind that can modify upstream parts of the graph

0d686a1
Select commit
Loading
Failed to load commit list.
Closed

Add kind that demonstrates how to modify the upstream graph in a transform #438

Add hacky kind that can modify upstream parts of the graph
0d686a1
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Feb 12, 2024 in 20s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-02-12 19:57:21.076Z] Task ID: KGJH0JBIQLe4FAVYoWPQMg
[taskcluster 2024-02-12 19:57:21.076Z] Worker ID: 2086637781469612454
[taskcluster 2024-02-12 19:57:21.076Z] Worker Group: us-central1
[taskcluster 2024-02-12 19:57:21.076Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-02-12 19:57:21.076Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-02-12 19:57:21.076Z] Worker Version: 38.0.5
[taskcluster 2024-02-12 19:57:21.076Z] Public IP: 35.188.10.127
[taskcluster 2024-02-12 19:57:21.076Z] Hostname: translations-1-decision-gcp-fcae3q-oqzutugpjzqvffa
[taskcluster 2024-02-12 19:57:21.076Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

[taskcluster 2024-02-12 19:57:21.776Z] === Task Starting ===
[setup 2024-02-12T19:57:22.237Z] run-task started in /
[setup 2024-02-12T19:57:22.237Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='9ebfd13903e28015d8008eb814ccc6ea7d7d735a' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='graph-mod' --head-rev='0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' 

[setup 2024-02-12T19:57:22.237Z] Python version: 3.11.2
[vcs 2024-02-12T19:57:22.239Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-02-12T19:57:22.239Z] running as worker:worker
[vcs 2024-02-12T19:57:22.240Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-02-12T19:57:22.243Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-02-12T19:57:22.511Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-12T19:57:22.511Z]  * branch            main       -> FETCH_HEAD
[vcs 2024-02-12T19:57:22.520Z] executing ['git', 'checkout', 'main']
[vcs 2024-02-12T19:57:22.684Z] Switched to branch 'main'
[vcs 2024-02-12T19:57:22.684Z] Your branch is up to date with 'origin/main'.
[vcs 2024-02-12T19:57:22.686Z] executing ['git', 'fetch', 'origin', '9ebfd13903e28015d8008eb814ccc6ea7d7d735a']
[vcs 2024-02-12T19:57:22.983Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-12T19:57:22.983Z]  * branch            9ebfd13903e28015d8008eb814ccc6ea7d7d735a -> FETCH_HEAD
[vcs 2024-02-12T19:57:22.994Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'graph-mod']
[vcs 2024-02-12T19:57:23.332Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-12T19:57:23.332Z]  * branch            graph-mod  -> FETCH_HEAD
[vcs 2024-02-12T19:57:23.336Z] executing ['git', 'checkout', '-f', '-B', 'graph-mod', '0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826']
[vcs 2024-02-12T19:57:23.345Z] Switched to and reset branch 'graph-mod'
[vcs 2024-02-12T19:57:23.347Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-12T19:57:23.387Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-12T19:57:23.442Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-12T19:57:23.452Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-12T19:57:23.462Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-12T19:57:23.478Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-12T19:57:23.495Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-12T19:57:23.505Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-12T19:57:23.508Z] cleaning git checkout...
[vcs 2024-02-12T19:57:23.510Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-12T19:57:23.516Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-02-12T19:57:23.519Z] successfully cleaned git checkout!
[vcs 2024-02-12T19:57:23.524Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' title='Built from firefox-translations-training commit 0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826'>0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826</a>
[pip-install 2024-02-12T19:57:23.525Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-02-12T19:57:23.971Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-02-12T19:57:24.128Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-02-12T19:57:24.258Z] Collecting arrow==1.3.0
[pip-install 2024-02-12T19:57:24.412Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-02-12T19:57:24.457Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.5 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:24.464Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-02-12T19:57:24.509Z] Collecting certifi==2023.11.17
[pip-install 2024-02-12T19:57:24.546Z]   Downloading certifi-2023.11.17-py3-none-any.whl (162 kB)
[pip-install 2024-02-12T19:57:24.651Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 kB 1.5 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:24.684Z] Collecting chardet==5.2.0
[pip-install 2024-02-12T19:57:24.722Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-02-12T19:57:24.766Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 4.7 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:24.956Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-02-12T19:57:24.994Z]   Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-02-12T19:57:25.019Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 6.5 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.062Z] Collecting click==8.1.7
[pip-install 2024-02-12T19:57:25.102Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-02-12T19:57:25.123Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 6.4 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.165Z] Collecting cookiecutter==2.5.0
[pip-install 2024-02-12T19:57:25.202Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-02-12T19:57:25.238Z] Collecting giturlparse==0.12.0
[pip-install 2024-02-12T19:57:25.276Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-02-12T19:57:25.314Z] Collecting idna==3.6
[pip-install 2024-02-12T19:57:25.352Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-02-12T19:57:25.364Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 6.4 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.369Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 135)) (3.1.2)
[pip-install 2024-02-12T19:57:25.399Z] Collecting json-e==4.6.0
[pip-install 2024-02-12T19:57:25.436Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-02-12T19:57:25.486Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-02-12T19:57:25.522Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-02-12T19:57:25.540Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 5.6 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.544Z] Requirement already satisfied: markupsafe==2.1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 147)) (2.1.3)
[pip-install 2024-02-12T19:57:25.567Z] Collecting mdurl==0.1.2
[pip-install 2024-02-12T19:57:25.603Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-02-12T19:57:25.610Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-02-12T19:57:25.656Z] Collecting pygments==2.17.2
[pip-install 2024-02-12T19:57:25.694Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-02-12T19:57:25.907Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 5.6 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.918Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-02-12T19:57:25.920Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 225)) (8.0.1)
[pip-install 2024-02-12T19:57:26.000Z] Collecting pyyaml==6.0.1
[pip-install 2024-02-12T19:57:26.037Z]   Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-02-12T19:57:26.148Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 7.0 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.154Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 283)) (2.0.4)
[pip-install 2024-02-12T19:57:26.156Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 287)) (2.31.0)
[pip-install 2024-02-12T19:57:26.271Z] Collecting rich==13.7.0
[pip-install 2024-02-12T19:57:26.307Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-02-12T19:57:26.335Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 9.8 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.341Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 297)) (1.16.0)
[pip-install 2024-02-12T19:57:26.343Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 301)) (2.0.0)
[pip-install 2024-02-12T19:57:26.386Z] Collecting taskcluster-taskgraph==7.1.0
[pip-install 2024-02-12T19:57:26.424Z]   Downloading taskcluster_taskgraph-7.1.0-py3-none-any.whl (185 kB)
[pip-install 2024-02-12T19:57:26.446Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 185.8/185.8 kB 9.8 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.452Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 309)) (13.0.1)
[pip-install 2024-02-12T19:57:26.454Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 314)) (1.3)
[pip-install 2024-02-12T19:57:26.485Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-02-12T19:57:26.521Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-02-12T19:57:26.581Z] Collecting urllib3==2.1.0
[pip-install 2024-02-12T19:57:26.617Z]   Downloading urllib3-2.1.0-py3-none-any.whl (104 kB)
[pip-install 2024-02-12T19:57:26.632Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 7.9 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.663Z] Collecting voluptuous==0.14.1
[pip-install 2024-02-12T19:57:26.699Z]   Downloading voluptuous-0.14.1-py3-none-any.whl (30 kB)
[pip-install 2024-02-12T19:57:27.149Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, pygments, mdurl, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-02-12T19:57:28.079Z]   WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.079Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.309Z]   WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.309Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.518Z]   WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.518Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.598Z]   WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.598Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.881Z]   WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.882Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.983Z]   WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.983Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:29.053Z] Successfully installed arrow-1.3.0 certifi-2023.11.17 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 json-e-4.6.0 markdown-it-py-3.0.0 mdurl-0.1.2 pygments-2.17.2 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.1.0 types-python-dateutil-2.8.19.20240106 urllib3-2.1.0 voluptuous-0.14.1
[task 2024-02-12T19:57:29.272Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='9ebfd13903e28015d8008eb814ccc6ea7d7d735a' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='graph-mod' --head-rev='0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' \n"]
[task 2024-02-12T19:57:29.274Z] + cd /builds/worker/checkouts/src
[task 2024-02-12T19:57:29.276Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-02-12T19:57:29.277Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=9ebfd13903e28015d8008eb814ccc6ea7d7d735a --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=graph-mod --head-rev=0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826
[task 2024-02-12T19:57:29.534Z] 2024-02-12 19:57:29,534 - INFO - Loading graph configuration.
[task 2024-02-12T19:57:29.560Z] 2024-02-12 19:57:29,559 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-02-12T19:57:29.562Z] 2024-02-12 19:57:29,560 - INFO - Using Parameters(id=50eb316285b1) (from defaults)
[task 2024-02-12T19:57:29.563Z] 2024-02-12 19:57:29,562 - INFO - writing artifact file `parameters.yml`
[task 2024-02-12T19:57:29.573Z] 2024-02-12 19:57:29,573 - INFO - writing artifact file `actions.json`
[task 2024-02-12T19:57:29.575Z] 2024-02-12 19:57:29,575 - INFO - Loading kinds
[task 2024-02-12T19:57:29.837Z] 2024-02-12 19:57:29,837 - INFO - Generating full task set
[task 2024-02-12T19:57:29.866Z] 2024-02-12 19:57:29,866 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-12T19:57:29.868Z] 2024-02-12 19:57:29,868 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-02-12T19:57:29.886Z] 2024-02-12 19:57:29,885 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-02-12T19:57:29.887Z] 2024-02-12 19:57:29,886 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-02-12T19:57:29.888Z] 2024-02-12 19:57:29,887 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-02-12T19:57:29.906Z] 2024-02-12 19:57:29,906 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-12T19:57:29.923Z] 2024-02-12 19:57:29,922 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-12T19:57:29.927Z] 2024-02-12 19:57:29,927 - INFO - Generated 5 tasks for kind tests
[task 2024-02-12T19:57:29.985Z] 2024-02-12 19:57:29,984 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-12T19:57:29.990Z] 2024-02-12 19:57:29,989 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-12T19:57:29.996Z] 2024-02-12 19:57:29,995 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-12T19:57:30.003Z] 2024-02-12 19:57:30,002 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-12T19:57:30.007Z] 2024-02-12 19:57:30,007 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-12T19:57:30.011Z] 2024-02-12 19:57:30,011 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-12T19:57:30.020Z] 2024-02-12 19:57:30,019 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-12T19:57:30.024Z] 2024-02-12 19:57:30,024 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-12T19:57:30.027Z] 2024-02-12 19:57:30,027 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-12T19:57:30.031Z] 2024-02-12 19:57:30,031 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-12T19:57:30.032Z] 2024-02-12 19:57:30,032 - INFO - Generated 1 tasks for kind modify-graph
[task 2024-02-12T19:57:30.058Z] 2024-02-12 19:57:30,058 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-12T19:57:30.061Z] 2024-02-12 19:57:30,061 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-12T19:57:30.064Z] 2024-02-12 19:57:30,064 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-12T19:57:30.070Z] 2024-02-12 19:57:30,070 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-12T19:57:30.074Z] 2024-02-12 19:57:30,074 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-12T19:57:30.078Z] 2024-02-12 19:57:30,078 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-12T19:57:30.083Z] 2024-02-12 19:57:30,083 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-12T19:57:30.088Z] 2024-02-12 19:57:30,088 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-12T19:57:30.093Z] 2024-02-12 19:57:30,093 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-12T19:57:30.097Z] 2024-02-12 19:57:30,097 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-12T19:57:30.100Z] 2024-02-12 19:57:30,100 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-12T19:57:30.104Z] 2024-02-12 19:57:30,103 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-12T19:57:30.107Z] 2024-02-12 19:57:30,107 - INFO - Generated 1 tasks for kind score
[task 2024-02-12T19:57:30.110Z] 2024-02-12 19:57:30,110 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-12T19:57:30.120Z] 2024-02-12 19:57:30,114 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-12T19:57:30.120Z] 2024-02-12 19:57:30,119 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-12T19:57:30.123Z] 2024-02-12 19:57:30,123 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-12T19:57:30.131Z] 2024-02-12 19:57:30,131 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-12T19:57:30.137Z] 2024-02-12 19:57:30,136 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-12T19:57:30.140Z] 2024-02-12 19:57:30,140 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-12T19:57:30.143Z] 2024-02-12 19:57:30,143 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-12T19:57:30.146Z] 2024-02-12 19:57:30,146 - INFO - Generated 1 tasks for kind export
[task 2024-02-12T19:57:30.148Z] 2024-02-12 19:57:30,148 - INFO - Generated 1 tasks for kind all
[task 2024-02-12T19:57:30.153Z] 2024-02-12 19:57:30,153 - INFO - Generated 1 tasks for kind all-pr
[task 2024-02-12T19:57:30.155Z] 2024-02-12 19:57:30,153 - INFO - Generating full task graph
[task 2024-02-12T19:57:30.156Z] 2024-02-12 19:57:30,154 - INFO - Full task graph contains 79 tasks and 217 dependencies
[task 2024-02-12T19:57:30.159Z] 2024-02-12 19:57:30,159 - INFO - writing artifact file `full-task-graph.json`
[task 2024-02-12T19:57:30.176Z] 2024-02-12 19:57:30,176 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-02-12T19:57:30.177Z] 2024-02-12 19:57:30,177 - INFO - Generating target task set
[task 2024-02-12T19:57:30.178Z] 2024-02-12 19:57:30,178 - INFO - Filter filter_target_tasks pruned 64 tasks (15 remain)
[task 2024-02-12T19:57:30.178Z] 2024-02-12 19:57:30,178 - INFO - writing artifact file `target-tasks.json`
[task 2024-02-12T19:57:30.179Z] 2024-02-12 19:57:30,178 - INFO - Generating target task graph
[task 2024-02-12T19:57:30.179Z] 2024-02-12 19:57:30,179 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-02-12T19:57:30.180Z] 2024-02-12 19:57:30,180 - INFO - Generating optimized task graph
[task 2024-02-12T19:57:30.182Z] 2024-02-12 19:57:30,182 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-02-12T19:57:35.489Z] 2024-02-12 19:57:35,488 - INFO - Replaced 28 tasks by index-search (index-search) during optimization.
[task 2024-02-12T19:57:35.494Z] 2024-02-12 19:57:35,494 - INFO - writing artifact file `task-graph.json`
[task 2024-02-12T19:57:35.503Z] 2024-02-12 19:57:35,503 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-02-12T19:57:35.506Z] 2024-02-12 19:57:35,506 - INFO - Creating task with taskId O_8lcNQtSpS2LPKoamqXEA for modify-graph-all
[task 2024-02-12T19:57:35.509Z] 2024-02-12 19:57:35,508 - INFO - Creating task with taskId B_-XYA79SaWge8kKrs-2LQ for merge-corpus-ru-en
[task 2024-02-12T19:57:35.511Z] 2024-02-12 19:57:35,511 - INFO - Creating task with taskId b0QR88XDSNu6oI1RIyv5bw for dataset-news-crawl-news_2008-ru
[task 2024-02-12T19:57:35.514Z] 2024-02-12 19:57:35,512 - INFO - Creating task with taskId QYQZ6YSyQq-5j9Nwqs8b2Q for tests-taskgraph-definition
[task 2024-02-12T19:57:35.518Z] 2024-02-12 19:57:35,518 - INFO - Creating task with taskId Z9geI5RWS9a_wjWJfKsa1g for tests-taskgraph-diff
[task 2024-02-12T19:57:35.521Z] 2024-02-12 19:57:35,521 - INFO - Creating task with taskId LJxcXmcPSTSfJB9bkwIbkg for tests-black
[task 2024-02-12T19:57:35.525Z] 2024-02-12 19:57:35,525 - INFO - Creating task with taskId CgGsmglXQRiyupklepVfMw for dataset-news-crawl-news_2007-en
[task 2024-02-12T19:57:35.527Z] 2024-02-12 19:57:35,526 - INFO - Creating task with taskId EgdLOnV0Qm6y9DI54Vmfew for tests-lint
[task 2024-02-12T19:57:35.644Z] 2024-02-12 19:57:35,642 - INFO - Creating task with taskId LuXfq4WkRw2Sxa8t3h3egg for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-02-12T19:57:35.743Z] 2024-02-12 19:57:35,743 - INFO - Creating task with taskId dZEzXXJlRD244wzjFr3gHQ for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-02-12T19:57:35.747Z] 2024-02-12 19:57:35,746 - INFO - Creating task with taskId eBBkuYeeQFm0rYe1rAybVw for split-corpus-ru-en
[task 2024-02-12T19:57:35.747Z] 2024-02-12 19:57:35,747 - INFO - Creating task with taskId SIz8Cd8yTQuBYfpdWYo_AA for merge-mono-src-ru
[task 2024-02-12T19:57:35.749Z] 2024-02-12 19:57:35,746 - INFO - Creating task with taskId LzYbq9noTw-8Qv26uawz4A for train-vocab-ru-en
[task 2024-02-12T19:57:35.848Z] 2024-02-12 19:57:35,847 - INFO - Creating task with taskId Py2HDteeQNWIJmHJO49oNg for train-backwards-ru-en
[task 2024-02-12T19:57:35.950Z] 2024-02-12 19:57:35,950 - INFO - Creating task with taskId E_kPDJMtQXOEOatO84BeIA for merge-mono-trg-en
[task 2024-02-12T19:57:35.950Z] 2024-02-12 19:57:35,950 - INFO - Creating task with taskId YbbbnsR7QgactCEoBUOfCg for evaluate-backward-flores-devtest-ru-en
[task 2024-02-12T19:57:35.954Z] 2024-02-12 19:57:35,954 - INFO - Creating task with taskId ZgfO37FPQeiuQsyBYi_YpA for split-mono-src-ru
[task 2024-02-12T19:57:36.090Z] 2024-02-12 19:57:36,090 - INFO - Creating task with taskId bgJhQl2UTT-76EwyK31woA for split-mono-trg-en
[task 2024-02-12T19:57:36.185Z] 2024-02-12 19:57:36,185 - INFO - Creating task with taskId OCiHIezTSWKkOjRvb4hwOQ for translate-mono-trg-ru-en-1/2
[task 2024-02-12T19:57:36.188Z] 2024-02-12 19:57:36,185 - INFO - Creating task with taskId EIKUc0OrSjCNmy4lgBIxfw for translate-mono-trg-ru-en-2/2
[task 2024-02-12T19:57:36.291Z] 2024-02-12 19:57:36,291 - INFO - Creating task with taskId NabhPvSASBiTkMGjHmotSA for collect-mono-trg-ru-en
[task 2024-02-12T19:57:36.422Z] 2024-02-12 19:57:36,422 - INFO - Creating task with taskId BCzRUUQ_R1GNrwBnrW6nOQ for train-teacher-ru-en-1/1
[task 2024-02-12T19:57:36.562Z] 2024-02-12 19:57:36,562 - INFO - Creating task with taskId JmKXXerFTJKjsola15fnnQ for translate-mono-src-ru-en-2/2
[task 2024-02-12T19:57:36.565Z] 2024-02-12 19:57:36,565 - INFO - Creating task with taskId QJPviKABRpukXqr9VdvKsA for translate-corpus-ru-en-2/2
[task 2024-02-12T19:57:36.568Z] 2024-02-12 19:57:36,568 - INFO - Creating task with taskId UL1AX6BlQHSj0vziG0F9xQ for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-02-12T19:57:36.571Z] 2024-02-12 19:57:36,571 - INFO - Creating task with taskId WLG6XJPxSzG2xHhI1WyIYg for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-02-12T19:57:36.573Z] 2024-02-12 19:57:36,573 - INFO - Creating task with taskId Ut1IV4CVRLCg5qKqWJVY-w for translate-corpus-ru-en-1/2
[task 2024-02-12T19:57:36.575Z] 2024-02-12 19:57:36,574 - INFO - Creating task with taskId b-npq7kMT9eXlTRmg_cfow for translate-mono-src-ru-en-1/2
[task 2024-02-12T19:57:36.694Z] 2024-02-12 19:57:36,694 - INFO - Creating task with taskId IgfVsTtITNC3TQbfZ--WeA for extract-best-ru-en-2/2
[task 2024-02-12T19:57:36.794Z] 2024-02-12 19:57:36,794 - INFO - Creating task with taskId IMCmOx4mQr61sZK8j6XbPQ for collect-mono-src-ru-en
[task 2024-02-12T19:57:36.797Z] 2024-02-12 19:57:36,796 - INFO - Creating task with taskId WG_rm490QkGLZ9MW4E-QCA for extract-best-ru-en-1/2
[task 2024-02-12T19:57:36.899Z] 2024-02-12 19:57:36,899 - INFO - Creating task with taskId d85xxecXT5u8d18yBi1Grw for collect-corpus-ru-en
[task 2024-02-12T19:57:37.036Z] 2024-02-12 19:57:37,036 - INFO - Creating task with taskId RGpwqErqTX-5vTS7Km84iQ for merge-translated-ru-en
[task 2024-02-12T19:57:37.223Z] 2024-02-12 19:57:37,223 - INFO - Creating task with taskId ObXXZEliRUu_gr0arAs1Qw for score-ru-en
[task 2024-02-12T19:57:37.311Z] 2024-02-12 19:57:37,311 - INFO - Creating task with taskId XQ1xjKGbQBCLb3pMRcPafA for cefilter-ru-en
[task 2024-02-12T19:57:37.405Z] 2024-02-12 19:57:37,405 - INFO - Creating task with taskId bm5wmWvXQ8m3Nwsaa9OmLA for alignments-ru-en
[task 2024-02-12T19:57:37.513Z] 2024-02-12 19:57:37,513 - INFO - Creating task with taskId SlBpGh72TpSgcA7KK0xfCg for train-student-ru-en
[task 2024-02-12T19:57:37.644Z] 2024-02-12 19:57:37,644 - INFO - Creating task with taskId YNwcJAENTk6rTdw9roooyA for evaluate-student-flores-devtest-ru-en
[task 2024-02-12T19:57:37.646Z] 2024-02-12 19:57:37,645 - INFO - Creating task with taskId O9VSxoesT3u1vtvWFfKsnw for finetune-student-ru-en
[task 2024-02-12T19:57:37.775Z] 2024-02-12 19:57:37,775 - INFO - Creating task with taskId bJoEzc1UQE-7_kajESqXnQ for quantize-ru-en
[task 2024-02-12T19:57:37.777Z] 2024-02-12 19:57:37,775 - INFO - Creating task with taskId AV46C7PhS2KYgiAsjMCcuA for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-02-12T19:57:37.890Z] 2024-02-12 19:57:37,890 - INFO - Creating task with taskId dSMiFd-dTKaFK-Yf7JvEow for export-ru-en
[task 2024-02-12T19:57:37.891Z] 2024-02-12 19:57:37,890 - INFO - Creating task with taskId KCvLOtrvQfW0ABzyAgt5MA for evaluate-quantized-flores-devtest-ru-en
[task 2024-02-12T19:57:38.031Z] 2024-02-12 19:57:38,031 - INFO - Creating task with taskId IUJUsSJpSjiQE0c0ieNgQg for all-pr-ru-en-1
[taskcluster 2024-02-12 19:57:38.495Z] === Task Finished ===
[taskcluster 2024-02-12 19:57:41.187Z] Successful task run with exit code: 0 completed in 20.111 seconds