Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kind that demonstrates how to modify the upstream graph in a transform #438

Closed
wants to merge 2 commits into from

Add hacky kind that can modify upstream parts of the graph

0d686a1
Select commit
Loading
Failed to load commit list.
Closed

Add kind that demonstrates how to modify the upstream graph in a transform #438

Add hacky kind that can modify upstream parts of the graph
0d686a1
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / tests-taskgraph-definition succeeded Feb 12, 2024 in 2m 12s

FirefoxCI (pull_request)

Test the full translations_taskgraph to validate the latest changes

Details

View task in Taskcluster
View logs in Taskcluster


[setup 2024-02-12T19:59:35.800Z] Python version: 3.10.12
[cache 2024-02-12T19:59:35.802Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-02-12T19:59:35.802Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2024-02-12T19:59:35.802Z] volume /builds/worker/checkouts is a cache
[setup 2024-02-12T19:59:35.802Z] running as worker:worker
[vcs 2024-02-12T19:59:35.802Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-02-12T19:59:35.804Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-02-12T19:59:35.805Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-02-12T19:59:36.533Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'graph-mod']
[vcs 2024-02-12T19:59:36.801Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-12T19:59:36.801Z]  * branch            graph-mod  -> FETCH_HEAD
[vcs 2024-02-12T19:59:36.803Z] executing ['git', 'checkout', '-f', '-B', 'graph-mod', '0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826']
[vcs 2024-02-12T19:59:36.858Z] Switched to a new branch 'graph-mod'
[vcs 2024-02-12T19:59:36.858Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-12T19:59:36.877Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-02-12T19:59:36.877Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-02-12T19:59:36.877Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-02-12T19:59:36.878Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-02-12T19:59:36.878Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-02-12T19:59:36.878Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-02-12T19:59:36.879Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-12T19:59:36.898Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-02-12T19:59:38.010Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-02-12T19:59:38.308Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-02-12T19:59:38.630Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-02-12T19:59:39.278Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-02-12T19:59:40.553Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-02-12T19:59:41.033Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-12T19:59:41.042Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-12T19:59:41.051Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-12T19:59:41.074Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-12T19:59:41.174Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-12T19:59:41.191Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-12T19:59:41.192Z] cleaning git checkout...
[vcs 2024-02-12T19:59:41.192Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-12T19:59:41.194Z] removing []
[vcs 2024-02-12T19:59:41.194Z] successfully cleaned git checkout!
[vcs 2024-02-12T19:59:41.196Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' title='Built from firefox-translations-training commit 0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826'>0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826</a>
[task 2024-02-12T19:59:41.196Z] executing ['bash', '-cx', 'make validate-taskgraph']
[task 2024-02-12T19:59:41.197Z] + make validate-taskgraph
[task 2024-02-12T19:59:41.198Z] pip3 install -r taskcluster/requirements.txt && taskgraph full
[task 2024-02-12T19:59:41.527Z] Defaulting to user installation because normal site-packages is not writeable
[task 2024-02-12T19:59:41.696Z] Collecting appdirs==1.4.4
[task 2024-02-12T19:59:41.868Z]   Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
[task 2024-02-12T19:59:41.912Z] Collecting arrow==1.3.0
[task 2024-02-12T19:59:41.948Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[task 2024-02-12T19:59:41.992Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 KB 1.5 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.011Z] Collecting binaryornot==0.4.4
[task 2024-02-12T19:59:42.047Z]   Downloading binaryornot-0.4.4-py2.py3-none-any.whl (9.0 kB)
[task 2024-02-12T19:59:42.083Z] Collecting certifi==2023.11.17
[task 2024-02-12T19:59:42.119Z]   Downloading certifi-2023.11.17-py3-none-any.whl (162 kB)
[task 2024-02-12T19:59:42.159Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 KB 4.0 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.184Z] Collecting chardet==5.2.0
[task 2024-02-12T19:59:42.219Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[task 2024-02-12T19:59:42.233Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 KB 16.6 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.415Z] Collecting charset-normalizer==3.3.2
[task 2024-02-12T19:59:42.451Z]   Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2024-02-12T19:59:42.458Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.1/142.1 KB 26.0 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.495Z] Collecting click==8.1.7
[task 2024-02-12T19:59:42.530Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[task 2024-02-12T19:59:42.536Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 KB 26.5 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.578Z] Collecting cookiecutter==2.5.0
[task 2024-02-12T19:59:42.614Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[task 2024-02-12T19:59:42.636Z] Collecting giturlparse==0.12.0
[task 2024-02-12T19:59:42.671Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[task 2024-02-12T19:59:42.698Z] Collecting idna==3.6
[task 2024-02-12T19:59:42.734Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[task 2024-02-12T19:59:42.738Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 KB 26.0 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.769Z] Collecting jinja2==3.1.2
[task 2024-02-12T19:59:42.805Z]   Downloading Jinja2-3.1.2-py3-none-any.whl (133 kB)
[task 2024-02-12T19:59:42.813Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 KB 22.8 MB/s eta 0:00:00
[task 2024-02-12T19:59:42.838Z] Collecting json-e==4.6.0
[task 2024-02-12T19:59:42.874Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[task 2024-02-12T19:59:42.912Z] Collecting markdown-it-py==3.0.0
[task 2024-02-12T19:59:42.949Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[task 2024-02-12T19:59:42.954Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 KB 28.7 MB/s eta 0:00:00
[task 2024-02-12T19:59:43.069Z] Collecting markupsafe==2.1.3
[task 2024-02-12T19:59:43.104Z]   Downloading MarkupSafe-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
[task 2024-02-12T19:59:43.129Z] Collecting mdurl==0.1.2
[task 2024-02-12T19:59:43.165Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[task 2024-02-12T19:59:43.186Z] Collecting mozilla-repo-urls==0.1.1
[task 2024-02-12T19:59:43.222Z]   Downloading mozilla_repo_urls-0.1.1-py3-none-any.whl (6.2 kB)
[task 2024-02-12T19:59:43.265Z] Collecting pygments==2.17.2
[task 2024-02-12T19:59:43.300Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[task 2024-02-12T19:59:43.358Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 21.3 MB/s eta 0:00:00
[task 2024-02-12T19:59:43.390Z] Collecting python-dateutil==2.8.2
[task 2024-02-12T19:59:43.426Z]   Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
[task 2024-02-12T19:59:43.431Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 KB 88.9 MB/s eta 0:00:00
[task 2024-02-12T19:59:43.461Z] Collecting python-slugify==8.0.1
[task 2024-02-12T19:59:43.497Z]   Downloading python_slugify-8.0.1-py2.py3-none-any.whl (9.7 kB)
[task 2024-02-12T19:59:43.576Z] Collecting pyyaml==6.0.1
[task 2024-02-12T19:59:43.612Z]   Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
[task 2024-02-12T19:59:43.623Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 KB 87.9 MB/s eta 0:00:00
[task 2024-02-12T19:59:43.646Z] Collecting redo==2.0.4
[task 2024-02-12T19:59:43.693Z]   Downloading redo-2.0.4-py2.py3-none-any.whl (12 kB)
[task 2024-02-12T19:59:43.747Z] Collecting requests==2.31.0
[task 2024-02-12T19:59:43.782Z]   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2024-02-12T19:59:43.786Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 KB 30.8 MB/s eta 0:00:00
[task 2024-02-12T19:59:43.894Z] Collecting rich==13.7.0
[task 2024-02-12T19:59:43.932Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[task 2024-02-12T19:59:43.937Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 KB 87.7 MB/s eta 0:00:00
[task 2024-02-12T19:59:43.962Z] Collecting six==1.16.0
[task 2024-02-12T19:59:43.998Z]   Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
[task 2024-02-12T19:59:44.019Z] Collecting slugid==2.0.0
[task 2024-02-12T19:59:44.054Z]   Downloading slugid-2.0.0-py2.py3-none-any.whl (8.2 kB)
[task 2024-02-12T19:59:44.095Z] Collecting taskcluster-taskgraph==7.1.0
[task 2024-02-12T19:59:44.131Z]   Downloading taskcluster_taskgraph-7.1.0-py3-none-any.whl (185 kB)
[task 2024-02-12T19:59:44.136Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 185.8/185.8 KB 69.3 MB/s eta 0:00:00
[task 2024-02-12T19:59:44.157Z] Collecting taskcluster-urls==13.0.1
[task 2024-02-12T19:59:44.193Z]   Downloading taskcluster_urls-13.0.1-py3-none-any.whl (10 kB)
[task 2024-02-12T19:59:44.215Z] Collecting text-unidecode==1.3
[task 2024-02-12T19:59:44.250Z]   Downloading text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
[task 2024-02-12T19:59:44.254Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.2/78.2 KB 35.4 MB/s eta 0:00:00
[task 2024-02-12T19:59:44.285Z] Collecting types-python-dateutil==2.8.19.20240106
[task 2024-02-12T19:59:44.321Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[task 2024-02-12T19:59:44.381Z] Collecting urllib3==2.1.0
[task 2024-02-12T19:59:44.417Z]   Downloading urllib3-2.1.0-py3-none-any.whl (104 kB)
[task 2024-02-12T19:59:44.422Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 KB 47.1 MB/s eta 0:00:00
[task 2024-02-12T19:59:44.450Z] Collecting voluptuous==0.14.1
[task 2024-02-12T19:59:44.486Z]   Downloading voluptuous-0.14.1-py3-none-any.whl (30 kB)
[task 2024-02-12T19:59:44.799Z] Installing collected packages: text-unidecode, taskcluster-urls, slugid, redo, json-e, appdirs, voluptuous, urllib3, types-python-dateutil, six, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, requests, python-dateutil, mozilla-repo-urls, markdown-it-py, jinja2, binaryornot, rich, arrow, cookiecutter, taskcluster-taskgraph
[task 2024-02-12T19:59:46.275Z] Successfully installed appdirs-1.4.4 arrow-1.3.0 binaryornot-0.4.4 certifi-2023.11.17 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.2 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.3 mdurl-0.1.2 mozilla-repo-urls-0.1.1 pygments-2.17.2 python-dateutil-2.8.2 python-slugify-8.0.1 pyyaml-6.0.1 redo-2.0.4 requests-2.31.0 rich-13.7.0 six-1.16.0 slugid-2.0.0 taskcluster-taskgraph-7.1.0 taskcluster-urls-13.0.1 text-unidecode-1.3 types-python-dateutil-2.8.19.20240106 urllib3-2.1.0 voluptuous-0.14.1
[task 2024-02-12T19:59:46.571Z] 2024-02-12 19:59:46,571 - INFO - Loading graph configuration.
[task 2024-02-12T19:59:46.591Z] 2024-02-12 19:59:46,591 - INFO - Using Parameters(id=1abc964a7ed4) (from defaults)
[task 2024-02-12T19:59:46.593Z] 2024-02-12 19:59:46,593 - INFO - Loading kinds
[task 2024-02-12T19:59:46.886Z] 2024-02-12 19:59:46,886 - INFO - Generating full task set
[task 2024-02-12T19:59:46.916Z] 2024-02-12 19:59:46,915 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-12T19:59:46.949Z] 2024-02-12 19:59:46,949 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-12T19:59:46.965Z] 2024-02-12 19:59:46,964 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-12T19:59:46.968Z] 2024-02-12 19:59:46,968 - INFO - Generated 5 tasks for kind tests
[task 2024-02-12T19:59:47.021Z] 2024-02-12 19:59:47,021 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-12T19:59:47.023Z] 2024-02-12 19:59:47,023 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-12T19:59:47.026Z] 2024-02-12 19:59:47,026 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-12T19:59:47.029Z] 2024-02-12 19:59:47,029 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-12T19:59:47.032Z] 2024-02-12 19:59:47,032 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-12T19:59:47.034Z] 2024-02-12 19:59:47,034 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-12T19:59:47.038Z] 2024-02-12 19:59:47,038 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-12T19:59:47.040Z] 2024-02-12 19:59:47,040 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-12T19:59:47.042Z] 2024-02-12 19:59:47,042 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-12T19:59:47.044Z] 2024-02-12 19:59:47,044 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-12T19:59:47.045Z] 2024-02-12 19:59:47,045 - INFO - Generated 1 tasks for kind modify-graph
[task 2024-02-12T19:59:47.049Z] 2024-02-12 19:59:47,049 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-12T19:59:47.051Z] 2024-02-12 19:59:47,051 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-12T19:59:47.052Z] 2024-02-12 19:59:47,052 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-12T19:59:47.057Z] 2024-02-12 19:59:47,056 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-12T19:59:47.060Z] 2024-02-12 19:59:47,059 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-12T19:59:47.062Z] 2024-02-12 19:59:47,062 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-12T19:59:47.066Z] 2024-02-12 19:59:47,066 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-12T19:59:47.068Z] 2024-02-12 19:59:47,068 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-12T19:59:47.072Z] 2024-02-12 19:59:47,072 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-12T19:59:47.074Z] 2024-02-12 19:59:47,074 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-12T19:59:47.076Z] 2024-02-12 19:59:47,076 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-12T19:59:47.078Z] 2024-02-12 19:59:47,078 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-12T19:59:47.080Z] 2024-02-12 19:59:47,080 - INFO - Generated 1 tasks for kind score
[task 2024-02-12T19:59:47.082Z] 2024-02-12 19:59:47,082 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-12T19:59:47.083Z] 2024-02-12 19:59:47,083 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-12T19:59:47.086Z] 2024-02-12 19:59:47,086 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-12T19:59:47.088Z] 2024-02-12 19:59:47,088 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-12T19:59:47.090Z] 2024-02-12 19:59:47,090 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-12T19:59:47.092Z] 2024-02-12 19:59:47,091 - INFO - Generated 1 tasks for kind export
[task 2024-02-12T19:59:47.094Z] 2024-02-12 19:59:47,094 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-12T19:59:47.099Z] 2024-02-12 19:59:47,099 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-12T19:59:47.102Z] 2024-02-12 19:59:47,101 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-12T19:59:47.102Z] 2024-02-12 19:59:47,102 - INFO - Generated 1 tasks for kind all
[task 2024-02-12T19:59:47.105Z] 2024-02-12 19:59:47,105 - INFO - Generated 0 tasks for kind all-pr
[task 2024-02-12T19:59:47.105Z] 2024-02-12 19:59:47,105 - INFO - Generating full task graph
[task 2024-02-12T19:59:47.105Z] 2024-02-12 19:59:47,105 - INFO - Full task graph contains 78 tasks and 209 dependencies
[task 2024-02-12T19:59:47.109Z] Dumping result with parameters from defaults:
[task 2024-02-12T19:59:47.109Z] alignments-ru-en
[task 2024-02-12T19:59:47.109Z] all-ru-en-1
[task 2024-02-12T19:59:47.109Z] bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-12T19:59:47.109Z] bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-02-12T19:59:47.109Z] bicleaner-model-ru-en
[task 2024-02-12T19:59:47.109Z] build-docker-image-base
[task 2024-02-12T19:59:47.109Z] build-docker-image-test
[task 2024-02-12T19:59:47.109Z] build-docker-image-toolchain-build
[task 2024-02-12T19:59:47.109Z] build-docker-image-train
[task 2024-02-12T19:59:47.109Z] cefilter-ru-en
[task 2024-02-12T19:59:47.109Z] clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-12T19:59:47.109Z] clean-corpus-opus-ada83_v1-ru-en
[task 2024-02-12T19:59:47.109Z] clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-02-12T19:59:47.109Z] clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-02-12T19:59:47.109Z] collect-corpus-ru-en
[task 2024-02-12T19:59:47.109Z] collect-mono-src-ru-en
[task 2024-02-12T19:59:47.109Z] collect-mono-trg-ru-en
[task 2024-02-12T19:59:47.109Z] dataset-flores-dev-ru-en
[task 2024-02-12T19:59:47.109Z] dataset-flores-devtest-ru-en
[task 2024-02-12T19:59:47.109Z] dataset-news-crawl-news_2007-en
[task 2024-02-12T19:59:47.109Z] dataset-news-crawl-news_2008-ru
[task 2024-02-12T19:59:47.109Z] dataset-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-12T19:59:47.109Z] dataset-opus-ada83_v1-ru-en
[task 2024-02-12T19:59:47.109Z] dataset-sacrebleu-aug-mix_wmt19-ru-en
[task 2024-02-12T19:59:47.109Z] evaluate-backward-flores-devtest-ru-en
[task 2024-02-12T19:59:47.109Z] evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-02-12T19:59:47.109Z] evaluate-quantized-flores-devtest-ru-en
[task 2024-02-12T19:59:47.109Z] evaluate-student-flores-devtest-ru-en
[task 2024-02-12T19:59:47.109Z] evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-02-12T19:59:47.109Z] evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-02-12T19:59:47.109Z] export-ru-en
[task 2024-02-12T19:59:47.109Z] extract-best-ru-en-1/2
[task 2024-02-12T19:59:47.109Z] extract-best-ru-en-2/2
[task 2024-02-12T19:59:47.109Z] fetch-browsermt-marian
[task 2024-02-12T19:59:47.109Z] fetch-cuda
[task 2024-02-12T19:59:47.109Z] fetch-cuda-11
[task 2024-02-12T19:59:47.109Z] fetch-extract-lex
[task 2024-02-12T19:59:47.109Z] fetch-fast-align
[task 2024-02-12T19:59:47.109Z] fetch-hunspell
[task 2024-02-12T19:59:47.109Z] fetch-kenlm
[task 2024-02-12T19:59:47.109Z] fetch-marian
[task 2024-02-12T19:59:47.109Z] fetch-preprocess
[task 2024-02-12T19:59:47.109Z] finetune-student-ru-en
[task 2024-02-12T19:59:47.109Z] merge-corpus-ru-en
[task 2024-02-12T19:59:47.109Z] merge-devset-ru-en
[task 2024-02-12T19:59:47.109Z] merge-mono-src-ru
[task 2024-02-12T19:59:47.109Z] merge-mono-trg-en
[task 2024-02-12T19:59:47.109Z] merge-translated-ru-en
[task 2024-02-12T19:59:47.109Z] modify-graph-all
[task 2024-02-12T19:59:47.109Z] quantize-ru-en
[task 2024-02-12T19:59:47.109Z] score-ru-en
[task 2024-02-12T19:59:47.109Z] split-corpus-ru-en
[task 2024-02-12T19:59:47.109Z] split-mono-src-ru
[task 2024-02-12T19:59:47.109Z] split-mono-trg-en
[task 2024-02-12T19:59:47.109Z] tests-black
[task 2024-02-12T19:59:47.109Z] tests-lint
[task 2024-02-12T19:59:47.109Z] tests-taskgraph-definition
[task 2024-02-12T19:59:47.109Z] tests-taskgraph-diff
[task 2024-02-12T19:59:47.109Z] tests-test
[task 2024-02-12T19:59:47.109Z] toolchain-browsermt-marian
[task 2024-02-12T19:59:47.109Z] toolchain-cuda-toolkit
[task 2024-02-12T19:59:47.109Z] toolchain-cuda-toolkit-11
[task 2024-02-12T19:59:47.109Z] toolchain-extract-lex
[task 2024-02-12T19:59:47.109Z] toolchain-fast-align
[task 2024-02-12T19:59:47.109Z] toolchain-hunspell
[task 2024-02-12T19:59:47.109Z] toolchain-kenlm
[task 2024-02-12T19:59:47.109Z] toolchain-marian
[task 2024-02-12T19:59:47.109Z] toolchain-preprocess
[task 2024-02-12T19:59:47.109Z] train-backwards-ru-en
[task 2024-02-12T19:59:47.109Z] train-student-ru-en
[task 2024-02-12T19:59:47.109Z] train-teacher-ru-en-1/1
[task 2024-02-12T19:59:47.109Z] train-vocab-ru-en
[task 2024-02-12T19:59:47.109Z] translate-corpus-ru-en-1/2
[task 2024-02-12T19:59:47.109Z] translate-corpus-ru-en-2/2
[task 2024-02-12T19:59:47.109Z] translate-mono-src-ru-en-1/2
[task 2024-02-12T19:59:47.109Z] translate-mono-src-ru-en-2/2
[task 2024-02-12T19:59:47.109Z] translate-mono-trg-ru-en-1/2
[task 2024-02-12T19:59:47.109Z] translate-mono-trg-ru-en-2/2
[task 2024-02-12T19:59:47.109Z] 
[taskcluster 2024-02-12 19:59:47.576Z] === Task Finished ===
[taskcluster 2024-02-12 19:59:47.576Z] Successful task run with exit code: 0 completed in 29.356 seconds