Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kind that demonstrates how to modify the upstream graph in a transform #438

Closed
wants to merge 2 commits into from

Add hacky kind that can modify upstream parts of the graph

0d686a1
Select commit
Loading
Failed to load commit list.
Closed

Add kind that demonstrates how to modify the upstream graph in a transform #438

Add hacky kind that can modify upstream parts of the graph
0d686a1
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / merge-corpus-ru-en failed Feb 12, 2024 in 2m 31s

FirefoxCI (pull_request)

merge corpus for ru-en

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-02-12 19:59:21.315Z] Task ID: B_-XYA79SaWge8kKrs-2LQ
[taskcluster 2024-02-12 19:59:21.315Z] Worker ID: 524514852579296937
[taskcluster 2024-02-12 19:59:21.315Z] Worker Group: us-central1
[taskcluster 2024-02-12 19:59:21.315Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-02-12 19:59:21.315Z] Worker Pool: translations-1/b-linux-large-gcp-300gb
[taskcluster 2024-02-12 19:59:21.315Z] Worker Version: 38.0.5
[taskcluster 2024-02-12 19:59:21.315Z] Public IP: 34.122.73.82
[taskcluster 2024-02-12 19:59:21.315Z] Hostname: translations-1-b-linux-large-gcp-300gb-cus60yzctvmdh9dn2isfsq
[taskcluster 2024-02-12 19:59:21.315Z] using cache "translations-level-1-checkouts-v3-58974d7dcf0417b3fe53-f9v6Z1KkRZuzZXoqK-Q4rg" -> /builds/worker/checkouts

[taskcluster 2024-02-12 19:59:24.247Z] Downloading artifact "public/image.tar.zst" from task ID: f9v6Z1KkRZuzZXoqK-Q4rg.
[taskcluster 2024-02-12 19:59:26.392Z] Downloaded artifact successfully.
[taskcluster 2024-02-12 19:59:26.393Z] Downloaded 264.083 mb
[taskcluster 2024-02-12 19:59:26.394Z] Decompressing downloaded image
[taskcluster 2024-02-12 19:59:28.011Z] Loading docker image from downloaded archive.
[taskcluster 2024-02-12 19:59:58.012Z] Image 'public/image.tar.zst' from task 'f9v6Z1KkRZuzZXoqK-Q4rg' loaded.  Using image ID sha256:377e5cf268945040e51f09b9261679365b3a09539429ff28b42c40a173e820e8.
[taskcluster 2024-02-12 19:59:58.155Z] === Task Starting ===
[setup 2024-02-12T19:59:59.612Z] run-task started in /builds/worker
[setup 2024-02-12T19:59:59.612Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c export BIN=$MOZ_FETCHES_DIR && $VCS_PATH/pipeline/clean/merge-corpus.sh artifacts/corpus $MOZ_FETCHES_DIR/*.zst
[setup 2024-02-12T19:59:59.612Z] Python version: 3.10.12
[cache 2024-02-12T19:59:59.616Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-02-12T19:59:59.616Z] volume /builds/worker/checkouts is a cache
[setup 2024-02-12T19:59:59.616Z] running as worker:worker
[vcs 2024-02-12T19:59:59.617Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-02-12T19:59:59.620Z] executing ['git', 'clone', 'https://github.com/mozilla/firefox-translations-training', '/builds/worker/checkouts/vcs']
[vcs 2024-02-12T19:59:59.622Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-02-12T20:00:00.387Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'graph-mod']
[vcs 2024-02-12T20:00:00.679Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-12T20:00:00.679Z]  * branch            graph-mod  -> FETCH_HEAD
[vcs 2024-02-12T20:00:00.683Z] executing ['git', 'checkout', '-f', '-B', 'graph-mod', '0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826']
[vcs 2024-02-12T20:00:00.750Z] Switched to a new branch 'graph-mod'
[vcs 2024-02-12T20:00:00.751Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-12T20:00:00.784Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-02-12T20:00:00.785Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-02-12T20:00:00.789Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-02-12T20:00:00.791Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-02-12T20:00:00.794Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-02-12T20:00:00.797Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-02-12T20:00:00.798Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-12T20:00:00.832Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-02-12T20:00:02.281Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-02-12T20:00:02.736Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-02-12T20:00:03.104Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-02-12T20:00:03.761Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-02-12T20:00:05.228Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-02-12T20:00:05.767Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-12T20:00:05.779Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-12T20:00:05.791Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-12T20:00:05.817Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-12T20:00:05.931Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-12T20:00:05.951Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-12T20:00:05.952Z] cleaning git checkout...
[vcs 2024-02-12T20:00:05.952Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-12T20:00:05.955Z] removing []
[vcs 2024-02-12T20:00:05.955Z] successfully cleaned git checkout!
[vcs 2024-02-12T20:00:05.958Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826' title='Built from firefox-translations-training commit 0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826'>0d686a1b21f9e8395ead4d22f4e2e0a8bcf5b826</a>
[setup 2024-02-12T20:00:05.958Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2024-02-12T20:00:05.958Z] fetching artifacts
[fetches 2024-02-12T20:00:05.958Z] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
Traceback (most recent call last):
  File "/usr/local/bin/fetch-content", line 899, in <module>
    sys.exit(main())
  File "/usr/local/bin/fetch-content", line 895, in main
    return args.func(args)
  File "/usr/local/bin/fetch-content", line 786, in command_task_artifacts
    if fetch.get("verify-hash"):
AttributeError: 'list' object has no attribute 'get'
[fetches 2024-02-12T20:00:06.067Z] removing /builds/worker/fetches
[fetches 2024-02-12T20:00:06.068Z] finished
Traceback (most recent call last):
  File "/usr/local/bin/run-task", line 1352, in <module>
    sys.exit(main(sys.argv[1:]))
  File "/usr/local/bin/run-task", line 1323, in main
    fetch_artifacts()
  File "/usr/local/bin/run-task", line 865, in fetch_artifacts
    subprocess.run(cmd, check=True, env=os.environ)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']' returned non-zero exit status 1.
[taskcluster 2024-02-12 20:00:06.601Z] === Task Finished ===
[taskcluster 2024-02-12 20:00:06.636Z] Unsuccessful task run with exit code: 1 completed in 45.322 seconds