Add kind that demonstrates how to modify the upstream graph in a transform #438
firefoxci-taskcluster / merge-corpus-ru-en
failed
Feb 12, 2024 in 2m 31s
FirefoxCI (pull_request)
merge corpus for ru-en
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-02-12 19:59:21.315Z] Task ID: B_-XYA79SaWge8kKrs-2LQ
[taskcluster 2024-02-12 19:59:21.315Z] Worker ID: 524514852579296937
[taskcluster 2024-02-12 19:59:21.315Z] Worker Group: us-central1
[taskcluster 2024-02-12 19:59:21.315Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-02-12 19:59:21.315Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2024-02-12 19:59:21.315Z] Worker Version: 38.0.5
[taskcluster 2024-02-12 19:59:21.315Z] Public IP: 34.122.73.82
[taskcluster 2024-02-12 19:59:21.315Z] Hostname: translations-1-b-linux-large-gcp-300gb-cus60yzctvmdh9dn2isfsq
[taskcluster 2024-02-12 19:59:21.315Z] using cache "translations-level-1-checkouts-v3-58974d7dcf0417b3fe53-f9v6Z1KkRZuzZXoqK-Q4rg" -> /builds/worker/checkouts
[taskcluster 2024-02-12 19:59:24.247Z] Downloading artifact "public/image.tar.zst" from task ID: f9v6Z1KkRZuzZXoqK-Q4rg.
[taskcluster 2024-02-12 19:59:26.392Z] Downloaded artifact successfully.
[taskcluster 2024-02-12 19:59:26.393Z] Downloaded 264.083 mb
[taskcluster 2024-02-12 19:59:26.394Z] Decompressing downloaded image
[taskcluster 2024-02-12 19:59:28.011Z] Loading docker image from downloaded archive.
[taskcluster 2024-02-12 19:59:58.012Z] Image 'public/image.tar.zst' from task 'f9v6Z1KkRZuzZXoqK-Q4rg' loaded. Using image ID sha256:377e5cf268945040e51f09b9261679365b3a09539429ff28b42c40a173e820e8.
[taskcluster 2024-02-12 19:59:58.155Z] === Task Starting ===
[setup 2024-02-12T19:59:59.612Z] run-task started in /builds/worker
[setup 2024-02-12T19:59:59.612Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c export BIN=$MOZ_FETCHES_DIR && $VCS_PATH/pipeline/clean/merge-corpus.sh artifacts/corpus $MOZ_FETCHES_DIR/*.zst
[setup 2024-02-12T19:59:59.612Z] Python version: 3.10.12
[cache 2024-02-12T19:59:59.616Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-02-12T19:59:59.616Z] volume /builds/worker/checkouts is a cache
[setup 2024-02-12T19:59:59.616Z] running as worker:worker
[vcs 2024-02-12T19:59:59.617Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-02-12T19:59:59.620Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-02-12T19:59:59.622Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-02-12T20:00:00.387Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'graph-mod']
[vcs 2024-02-12T20:00:00.679Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-12T20:00:00.679Z] * branch graph-mod -> FETCH_HEAD
[vcs 2024-02-12T20:00:00.683Z] executing ['git', 'checkout', '-f', '-B', 'graph-mod', '0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826']
[vcs 2024-02-12T20:00:00.750Z] Switched to a new branch 'graph-mod'
[vcs 2024-02-12T20:00:00.751Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-12T20:00:00.784Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-02-12T20:00:00.785Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-02-12T20:00:00.789Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-02-12T20:00:00.791Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-02-12T20:00:00.794Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-02-12T20:00:00.797Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-02-12T20:00:00.798Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-12T20:00:00.832Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-02-12T20:00:02.281Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-02-12T20:00:02.736Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-02-12T20:00:03.104Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-02-12T20:00:03.761Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-02-12T20:00:05.228Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-02-12T20:00:05.767Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-12T20:00:05.779Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-12T20:00:05.791Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-12T20:00:05.817Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-12T20:00:05.931Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-12T20:00:05.951Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-12T20:00:05.952Z] cleaning git checkout...
[vcs 2024-02-12T20:00:05.952Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-12T20:00:05.955Z] removing []
[vcs 2024-02-12T20:00:05.955Z] successfully cleaned git checkout!
[vcs 2024-02-12T20:00:05.958Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' title='Built from firefox-translations-training commit 0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826'>0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826</a>
[setup 2024-02-12T20:00:05.958Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2024-02-12T20:00:05.958Z] fetching artifacts
[fetches 2024-02-12T20:00:05.958Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
Traceback (most recent call last):
File "/usr/local/bin/fetch-content", line 899, in <module>
sys.exit(main())
File "/usr/local/bin/fetch-content", line 895, in main
return args.func(args)
File "/usr/local/bin/fetch-content", line 786, in command_task_artifacts
if fetch.get("verify-hash"):
AttributeError: 'list' object has no attribute 'get'
[fetches 2024-02-12T20:00:06.067Z] removing /builds/worker/fetches
[fetches 2024-02-12T20:00:06.068Z] finished
Traceback (most recent call last):
File "/usr/local/bin/run-task", line 1352, in <module>
sys.exit(main(sys.argv[1:]))
File "/usr/local/bin/run-task", line 1323, in main
fetch_artifacts()
File "/usr/local/bin/run-task", line 865, in fetch_artifacts
subprocess.run(cmd, check=True, env=os.environ)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']' returned non-zero exit status 1.
[taskcluster 2024-02-12 20:00:06.601Z] === Task Finished ===
[taskcluster 2024-02-12 20:00:06.636Z] Unsuccessful task run with exit code: 1 completed in 45.322 seconds
Loading