Add kind that demonstrates how to modify the upstream graph in a transform #438
firefoxci-taskcluster / Decision Task (pull-request)
succeeded
Feb 12, 2024 in 20s
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-02-12 19:57:21.076Z] Task ID: KGJH0JBIQLe4FAVYoWPQMg
[taskcluster 2024-02-12 19:57:21.076Z] Worker ID: 2086637781469612454
[taskcluster 2024-02-12 19:57:21.076Z] Worker Group: us-central1
[taskcluster 2024-02-12 19:57:21.076Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-02-12 19:57:21.076Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-02-12 19:57:21.076Z] Worker Version: 38.0.5
[taskcluster 2024-02-12 19:57:21.076Z] Public IP: 35.188.10.127
[taskcluster 2024-02-12 19:57:21.076Z] Hostname: translations-1-decision-gcp-fcae3q-oqzutugpjzqvffa
[taskcluster 2024-02-12 19:57:21.076Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
[taskcluster 2024-02-12 19:57:21.776Z] === Task Starting ===
[setup 2024-02-12T19:57:22.237Z] run-task started in /
[setup 2024-02-12T19:57:22.237Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='9ebfd13903e28015d8008eb814ccc6ea7d7d735a' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='graph-mod' --head-rev='0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826'
[setup 2024-02-12T19:57:22.237Z] Python version: 3.11.2
[vcs 2024-02-12T19:57:22.239Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-02-12T19:57:22.239Z] running as worker:worker
[vcs 2024-02-12T19:57:22.240Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-02-12T19:57:22.243Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-02-12T19:57:22.511Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-12T19:57:22.511Z] * branch main -> FETCH_HEAD
[vcs 2024-02-12T19:57:22.520Z] executing ['git', 'checkout', 'main']
[vcs 2024-02-12T19:57:22.684Z] Switched to branch 'main'
[vcs 2024-02-12T19:57:22.684Z] Your branch is up to date with 'origin/main'.
[vcs 2024-02-12T19:57:22.686Z] executing ['git', 'fetch', 'origin', '9ebfd13903e28015d8008eb814ccc6ea7d7d735a']
[vcs 2024-02-12T19:57:22.983Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-12T19:57:22.983Z] * branch 9ebfd13903e28015d8008eb814ccc6ea7d7d735a -> FETCH_HEAD
[vcs 2024-02-12T19:57:22.994Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'graph-mod']
[vcs 2024-02-12T19:57:23.332Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-12T19:57:23.332Z] * branch graph-mod -> FETCH_HEAD
[vcs 2024-02-12T19:57:23.336Z] executing ['git', 'checkout', '-f', '-B', 'graph-mod', '0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826']
[vcs 2024-02-12T19:57:23.345Z] Switched to and reset branch 'graph-mod'
[vcs 2024-02-12T19:57:23.347Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-12T19:57:23.387Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-12T19:57:23.442Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-12T19:57:23.452Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-12T19:57:23.462Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-12T19:57:23.478Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-12T19:57:23.495Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-12T19:57:23.505Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-12T19:57:23.508Z] cleaning git checkout...
[vcs 2024-02-12T19:57:23.510Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-12T19:57:23.516Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-02-12T19:57:23.519Z] successfully cleaned git checkout!
[vcs 2024-02-12T19:57:23.524Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' title='Built from firefox-translations-training commit 0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826'>0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826</a>
[pip-install 2024-02-12T19:57:23.525Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-02-12T19:57:23.971Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-02-12T19:57:24.128Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-02-12T19:57:24.258Z] Collecting arrow==1.3.0
[pip-install 2024-02-12T19:57:24.412Z] Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-02-12T19:57:24.457Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.5 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:24.464Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-02-12T19:57:24.509Z] Collecting certifi==2023.11.17
[pip-install 2024-02-12T19:57:24.546Z] Downloading certifi-2023.11.17-py3-none-any.whl (162 kB)
[pip-install 2024-02-12T19:57:24.651Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 kB 1.5 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:24.684Z] Collecting chardet==5.2.0
[pip-install 2024-02-12T19:57:24.722Z] Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-02-12T19:57:24.766Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 4.7 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:24.956Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-02-12T19:57:24.994Z] Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-02-12T19:57:25.019Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 6.5 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.062Z] Collecting click==8.1.7
[pip-install 2024-02-12T19:57:25.102Z] Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-02-12T19:57:25.123Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 6.4 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.165Z] Collecting cookiecutter==2.5.0
[pip-install 2024-02-12T19:57:25.202Z] Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-02-12T19:57:25.238Z] Collecting giturlparse==0.12.0
[pip-install 2024-02-12T19:57:25.276Z] Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-02-12T19:57:25.314Z] Collecting idna==3.6
[pip-install 2024-02-12T19:57:25.352Z] Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-02-12T19:57:25.364Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 6.4 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.369Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 135)) (3.1.2)
[pip-install 2024-02-12T19:57:25.399Z] Collecting json-e==4.6.0
[pip-install 2024-02-12T19:57:25.436Z] Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-02-12T19:57:25.486Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-02-12T19:57:25.522Z] Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-02-12T19:57:25.540Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 5.6 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.544Z] Requirement already satisfied: markupsafe==2.1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 147)) (2.1.3)
[pip-install 2024-02-12T19:57:25.567Z] Collecting mdurl==0.1.2
[pip-install 2024-02-12T19:57:25.603Z] Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-02-12T19:57:25.610Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-02-12T19:57:25.656Z] Collecting pygments==2.17.2
[pip-install 2024-02-12T19:57:25.694Z] Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-02-12T19:57:25.907Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 5.6 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:25.918Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-02-12T19:57:25.920Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 225)) (8.0.1)
[pip-install 2024-02-12T19:57:26.000Z] Collecting pyyaml==6.0.1
[pip-install 2024-02-12T19:57:26.037Z] Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-02-12T19:57:26.148Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 7.0 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.154Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 283)) (2.0.4)
[pip-install 2024-02-12T19:57:26.156Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 287)) (2.31.0)
[pip-install 2024-02-12T19:57:26.271Z] Collecting rich==13.7.0
[pip-install 2024-02-12T19:57:26.307Z] Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-02-12T19:57:26.335Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 9.8 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.341Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 297)) (1.16.0)
[pip-install 2024-02-12T19:57:26.343Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 301)) (2.0.0)
[pip-install 2024-02-12T19:57:26.386Z] Collecting taskcluster-taskgraph==7.1.0
[pip-install 2024-02-12T19:57:26.424Z] Downloading taskcluster_taskgraph-7.1.0-py3-none-any.whl (185 kB)
[pip-install 2024-02-12T19:57:26.446Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 185.8/185.8 kB 9.8 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.452Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 309)) (13.0.1)
[pip-install 2024-02-12T19:57:26.454Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 314)) (1.3)
[pip-install 2024-02-12T19:57:26.485Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-02-12T19:57:26.521Z] Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-02-12T19:57:26.581Z] Collecting urllib3==2.1.0
[pip-install 2024-02-12T19:57:26.617Z] Downloading urllib3-2.1.0-py3-none-any.whl (104 kB)
[pip-install 2024-02-12T19:57:26.632Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 7.9 MB/s eta 0:00:00
[pip-install 2024-02-12T19:57:26.663Z] Collecting voluptuous==0.14.1
[pip-install 2024-02-12T19:57:26.699Z] Downloading voluptuous-0.14.1-py3-none-any.whl (30 kB)
[pip-install 2024-02-12T19:57:27.149Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, pygments, mdurl, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-02-12T19:57:28.079Z] WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.079Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.309Z] WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.309Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.518Z] WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.518Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.598Z] WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.598Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.881Z] WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.882Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:28.983Z] WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-12T19:57:28.983Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-12T19:57:29.053Z] Successfully installed arrow-1.3.0 certifi-2023.11.17 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 json-e-4.6.0 markdown-it-py-3.0.0 mdurl-0.1.2 pygments-2.17.2 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.1.0 types-python-dateutil-2.8.19.20240106 urllib3-2.1.0 voluptuous-0.14.1
[task 2024-02-12T19:57:29.272Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='9ebfd13903e28015d8008eb814ccc6ea7d7d735a' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='graph-mod' --head-rev='0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' \n"]
[task 2024-02-12T19:57:29.274Z] + cd /builds/worker/checkouts/src
[task 2024-02-12T19:57:29.276Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-02-12T19:57:29.277Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=9ebfd13903e28015d8008eb814ccc6ea7d7d735a --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=graph-mod --head-rev=0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826
[task 2024-02-12T19:57:29.534Z] 2024-02-12 19:57:29,534 - INFO - Loading graph configuration.
[task 2024-02-12T19:57:29.560Z] 2024-02-12 19:57:29,559 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-02-12T19:57:29.562Z] 2024-02-12 19:57:29,560 - INFO - Using Parameters(id=50eb316285b1) (from defaults)
[task 2024-02-12T19:57:29.563Z] 2024-02-12 19:57:29,562 - INFO - writing artifact file `parameters.yml`
[task 2024-02-12T19:57:29.573Z] 2024-02-12 19:57:29,573 - INFO - writing artifact file `actions.json`
[task 2024-02-12T19:57:29.575Z] 2024-02-12 19:57:29,575 - INFO - Loading kinds
[task 2024-02-12T19:57:29.837Z] 2024-02-12 19:57:29,837 - INFO - Generating full task set
[task 2024-02-12T19:57:29.866Z] 2024-02-12 19:57:29,866 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-12T19:57:29.868Z] 2024-02-12 19:57:29,868 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-02-12T19:57:29.886Z] 2024-02-12 19:57:29,885 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-02-12T19:57:29.887Z] 2024-02-12 19:57:29,886 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-02-12T19:57:29.888Z] 2024-02-12 19:57:29,887 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-02-12T19:57:29.906Z] 2024-02-12 19:57:29,906 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-12T19:57:29.923Z] 2024-02-12 19:57:29,922 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-12T19:57:29.927Z] 2024-02-12 19:57:29,927 - INFO - Generated 5 tasks for kind tests
[task 2024-02-12T19:57:29.985Z] 2024-02-12 19:57:29,984 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-12T19:57:29.990Z] 2024-02-12 19:57:29,989 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-12T19:57:29.996Z] 2024-02-12 19:57:29,995 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-12T19:57:30.003Z] 2024-02-12 19:57:30,002 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-12T19:57:30.007Z] 2024-02-12 19:57:30,007 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-12T19:57:30.011Z] 2024-02-12 19:57:30,011 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-12T19:57:30.020Z] 2024-02-12 19:57:30,019 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-12T19:57:30.024Z] 2024-02-12 19:57:30,024 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-12T19:57:30.027Z] 2024-02-12 19:57:30,027 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-12T19:57:30.031Z] 2024-02-12 19:57:30,031 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-12T19:57:30.032Z] 2024-02-12 19:57:30,032 - INFO - Generated 1 tasks for kind modify-graph
[task 2024-02-12T19:57:30.058Z] 2024-02-12 19:57:30,058 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-12T19:57:30.061Z] 2024-02-12 19:57:30,061 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-12T19:57:30.064Z] 2024-02-12 19:57:30,064 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-12T19:57:30.070Z] 2024-02-12 19:57:30,070 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-12T19:57:30.074Z] 2024-02-12 19:57:30,074 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-12T19:57:30.078Z] 2024-02-12 19:57:30,078 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-12T19:57:30.083Z] 2024-02-12 19:57:30,083 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-12T19:57:30.088Z] 2024-02-12 19:57:30,088 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-12T19:57:30.093Z] 2024-02-12 19:57:30,093 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-12T19:57:30.097Z] 2024-02-12 19:57:30,097 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-12T19:57:30.100Z] 2024-02-12 19:57:30,100 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-12T19:57:30.104Z] 2024-02-12 19:57:30,103 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-12T19:57:30.107Z] 2024-02-12 19:57:30,107 - INFO - Generated 1 tasks for kind score
[task 2024-02-12T19:57:30.110Z] 2024-02-12 19:57:30,110 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-12T19:57:30.120Z] 2024-02-12 19:57:30,114 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-12T19:57:30.120Z] 2024-02-12 19:57:30,119 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-12T19:57:30.123Z] 2024-02-12 19:57:30,123 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-12T19:57:30.131Z] 2024-02-12 19:57:30,131 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-12T19:57:30.137Z] 2024-02-12 19:57:30,136 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-12T19:57:30.140Z] 2024-02-12 19:57:30,140 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-12T19:57:30.143Z] 2024-02-12 19:57:30,143 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-12T19:57:30.146Z] 2024-02-12 19:57:30,146 - INFO - Generated 1 tasks for kind export
[task 2024-02-12T19:57:30.148Z] 2024-02-12 19:57:30,148 - INFO - Generated 1 tasks for kind all
[task 2024-02-12T19:57:30.153Z] 2024-02-12 19:57:30,153 - INFO - Generated 1 tasks for kind all-pr
[task 2024-02-12T19:57:30.155Z] 2024-02-12 19:57:30,153 - INFO - Generating full task graph
[task 2024-02-12T19:57:30.156Z] 2024-02-12 19:57:30,154 - INFO - Full task graph contains 79 tasks and 217 dependencies
[task 2024-02-12T19:57:30.159Z] 2024-02-12 19:57:30,159 - INFO - writing artifact file `full-task-graph.json`
[task 2024-02-12T19:57:30.176Z] 2024-02-12 19:57:30,176 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-02-12T19:57:30.177Z] 2024-02-12 19:57:30,177 - INFO - Generating target task set
[task 2024-02-12T19:57:30.178Z] 2024-02-12 19:57:30,178 - INFO - Filter filter_target_tasks pruned 64 tasks (15 remain)
[task 2024-02-12T19:57:30.178Z] 2024-02-12 19:57:30,178 - INFO - writing artifact file `target-tasks.json`
[task 2024-02-12T19:57:30.179Z] 2024-02-12 19:57:30,178 - INFO - Generating target task graph
[task 2024-02-12T19:57:30.179Z] 2024-02-12 19:57:30,179 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-02-12T19:57:30.180Z] 2024-02-12 19:57:30,180 - INFO - Generating optimized task graph
[task 2024-02-12T19:57:30.182Z] 2024-02-12 19:57:30,182 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-02-12T19:57:35.489Z] 2024-02-12 19:57:35,488 - INFO - Replaced 28 tasks by index-search (index-search) during optimization.
[task 2024-02-12T19:57:35.494Z] 2024-02-12 19:57:35,494 - INFO - writing artifact file `task-graph.json`
[task 2024-02-12T19:57:35.503Z] 2024-02-12 19:57:35,503 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-02-12T19:57:35.506Z] 2024-02-12 19:57:35,506 - INFO - Creating task with taskId O_8lcNQtSpS2LPKoamqXEA for modify-graph-all
[task 2024-02-12T19:57:35.509Z] 2024-02-12 19:57:35,508 - INFO - Creating task with taskId B_-XYA79SaWge8kKrs-2LQ for merge-corpus-ru-en
[task 2024-02-12T19:57:35.511Z] 2024-02-12 19:57:35,511 - INFO - Creating task with taskId b0QR88XDSNu6oI1RIyv5bw for dataset-news-crawl-news_2008-ru
[task 2024-02-12T19:57:35.514Z] 2024-02-12 19:57:35,512 - INFO - Creating task with taskId QYQZ6YSyQq-5j9Nwqs8b2Q for tests-taskgraph-definition
[task 2024-02-12T19:57:35.518Z] 2024-02-12 19:57:35,518 - INFO - Creating task with taskId Z9geI5RWS9a_wjWJfKsa1g for tests-taskgraph-diff
[task 2024-02-12T19:57:35.521Z] 2024-02-12 19:57:35,521 - INFO - Creating task with taskId LJxcXmcPSTSfJB9bkwIbkg for tests-black
[task 2024-02-12T19:57:35.525Z] 2024-02-12 19:57:35,525 - INFO - Creating task with taskId CgGsmglXQRiyupklepVfMw for dataset-news-crawl-news_2007-en
[task 2024-02-12T19:57:35.527Z] 2024-02-12 19:57:35,526 - INFO - Creating task with taskId EgdLOnV0Qm6y9DI54Vmfew for tests-lint
[task 2024-02-12T19:57:35.644Z] 2024-02-12 19:57:35,642 - INFO - Creating task with taskId LuXfq4WkRw2Sxa8t3h3egg for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-02-12T19:57:35.743Z] 2024-02-12 19:57:35,743 - INFO - Creating task with taskId dZEzXXJlRD244wzjFr3gHQ for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-02-12T19:57:35.747Z] 2024-02-12 19:57:35,746 - INFO - Creating task with taskId eBBkuYeeQFm0rYe1rAybVw for split-corpus-ru-en
[task 2024-02-12T19:57:35.747Z] 2024-02-12 19:57:35,747 - INFO - Creating task with taskId SIz8Cd8yTQuBYfpdWYo_AA for merge-mono-src-ru
[task 2024-02-12T19:57:35.749Z] 2024-02-12 19:57:35,746 - INFO - Creating task with taskId LzYbq9noTw-8Qv26uawz4A for train-vocab-ru-en
[task 2024-02-12T19:57:35.848Z] 2024-02-12 19:57:35,847 - INFO - Creating task with taskId Py2HDteeQNWIJmHJO49oNg for train-backwards-ru-en
[task 2024-02-12T19:57:35.950Z] 2024-02-12 19:57:35,950 - INFO - Creating task with taskId E_kPDJMtQXOEOatO84BeIA for merge-mono-trg-en
[task 2024-02-12T19:57:35.950Z] 2024-02-12 19:57:35,950 - INFO - Creating task with taskId YbbbnsR7QgactCEoBUOfCg for evaluate-backward-flores-devtest-ru-en
[task 2024-02-12T19:57:35.954Z] 2024-02-12 19:57:35,954 - INFO - Creating task with taskId ZgfO37FPQeiuQsyBYi_YpA for split-mono-src-ru
[task 2024-02-12T19:57:36.090Z] 2024-02-12 19:57:36,090 - INFO - Creating task with taskId bgJhQl2UTT-76EwyK31woA for split-mono-trg-en
[task 2024-02-12T19:57:36.185Z] 2024-02-12 19:57:36,185 - INFO - Creating task with taskId OCiHIezTSWKkOjRvb4hwOQ for translate-mono-trg-ru-en-1/2
[task 2024-02-12T19:57:36.188Z] 2024-02-12 19:57:36,185 - INFO - Creating task with taskId EIKUc0OrSjCNmy4lgBIxfw for translate-mono-trg-ru-en-2/2
[task 2024-02-12T19:57:36.291Z] 2024-02-12 19:57:36,291 - INFO - Creating task with taskId NabhPvSASBiTkMGjHmotSA for collect-mono-trg-ru-en
[task 2024-02-12T19:57:36.422Z] 2024-02-12 19:57:36,422 - INFO - Creating task with taskId BCzRUUQ_R1GNrwBnrW6nOQ for train-teacher-ru-en-1/1
[task 2024-02-12T19:57:36.562Z] 2024-02-12 19:57:36,562 - INFO - Creating task with taskId JmKXXerFTJKjsola15fnnQ for translate-mono-src-ru-en-2/2
[task 2024-02-12T19:57:36.565Z] 2024-02-12 19:57:36,565 - INFO - Creating task with taskId QJPviKABRpukXqr9VdvKsA for translate-corpus-ru-en-2/2
[task 2024-02-12T19:57:36.568Z] 2024-02-12 19:57:36,568 - INFO - Creating task with taskId UL1AX6BlQHSj0vziG0F9xQ for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-02-12T19:57:36.571Z] 2024-02-12 19:57:36,571 - INFO - Creating task with taskId WLG6XJPxSzG2xHhI1WyIYg for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-02-12T19:57:36.573Z] 2024-02-12 19:57:36,573 - INFO - Creating task with taskId Ut1IV4CVRLCg5qKqWJVY-w for translate-corpus-ru-en-1/2
[task 2024-02-12T19:57:36.575Z] 2024-02-12 19:57:36,574 - INFO - Creating task with taskId b-npq7kMT9eXlTRmg_cfow for translate-mono-src-ru-en-1/2
[task 2024-02-12T19:57:36.694Z] 2024-02-12 19:57:36,694 - INFO - Creating task with taskId IgfVsTtITNC3TQbfZ--WeA for extract-best-ru-en-2/2
[task 2024-02-12T19:57:36.794Z] 2024-02-12 19:57:36,794 - INFO - Creating task with taskId IMCmOx4mQr61sZK8j6XbPQ for collect-mono-src-ru-en
[task 2024-02-12T19:57:36.797Z] 2024-02-12 19:57:36,796 - INFO - Creating task with taskId WG_rm490QkGLZ9MW4E-QCA for extract-best-ru-en-1/2
[task 2024-02-12T19:57:36.899Z] 2024-02-12 19:57:36,899 - INFO - Creating task with taskId d85xxecXT5u8d18yBi1Grw for collect-corpus-ru-en
[task 2024-02-12T19:57:37.036Z] 2024-02-12 19:57:37,036 - INFO - Creating task with taskId RGpwqErqTX-5vTS7Km84iQ for merge-translated-ru-en
[task 2024-02-12T19:57:37.223Z] 2024-02-12 19:57:37,223 - INFO - Creating task with taskId ObXXZEliRUu_gr0arAs1Qw for score-ru-en
[task 2024-02-12T19:57:37.311Z] 2024-02-12 19:57:37,311 - INFO - Creating task with taskId XQ1xjKGbQBCLb3pMRcPafA for cefilter-ru-en
[task 2024-02-12T19:57:37.405Z] 2024-02-12 19:57:37,405 - INFO - Creating task with taskId bm5wmWvXQ8m3Nwsaa9OmLA for alignments-ru-en
[task 2024-02-12T19:57:37.513Z] 2024-02-12 19:57:37,513 - INFO - Creating task with taskId SlBpGh72TpSgcA7KK0xfCg for train-student-ru-en
[task 2024-02-12T19:57:37.644Z] 2024-02-12 19:57:37,644 - INFO - Creating task with taskId YNwcJAENTk6rTdw9roooyA for evaluate-student-flores-devtest-ru-en
[task 2024-02-12T19:57:37.646Z] 2024-02-12 19:57:37,645 - INFO - Creating task with taskId O9VSxoesT3u1vtvWFfKsnw for finetune-student-ru-en
[task 2024-02-12T19:57:37.775Z] 2024-02-12 19:57:37,775 - INFO - Creating task with taskId bJoEzc1UQE-7_kajESqXnQ for quantize-ru-en
[task 2024-02-12T19:57:37.777Z] 2024-02-12 19:57:37,775 - INFO - Creating task with taskId AV46C7PhS2KYgiAsjMCcuA for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-02-12T19:57:37.890Z] 2024-02-12 19:57:37,890 - INFO - Creating task with taskId dSMiFd-dTKaFK-Yf7JvEow for export-ru-en
[task 2024-02-12T19:57:37.891Z] 2024-02-12 19:57:37,890 - INFO - Creating task with taskId KCvLOtrvQfW0ABzyAgt5MA for evaluate-quantized-flores-devtest-ru-en
[task 2024-02-12T19:57:38.031Z] 2024-02-12 19:57:38,031 - INFO - Creating task with taskId IUJUsSJpSjiQE0c0ieNgQg for all-pr-ru-en-1
[taskcluster 2024-02-12 19:57:38.495Z] === Task Finished ===
[taskcluster 2024-02-12 19:57:41.187Z] Successful task run with exit code: 0 completed in 20.111 seconds
Loading