Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kind that demonstrates how to modify the upstream graph in a transform #438

Closed
wants to merge 2 commits into from

Add hacky kind that can modify upstream parts of the graph

0d686a1
Select commit
Loading
Failed to load commit list.
Closed

Add kind that demonstrates how to modify the upstream graph in a transform #438

Add hacky kind that can modify upstream parts of the graph
0d686a1
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / dataset-news-crawl-news_2007-en succeeded Feb 12, 2024 in 2m 43s

FirefoxCI (pull_request)

Fetch news-crawl dataset for {trg_locale}

Details

View task in Taskcluster
View logs in Taskcluster


[task 2024-02-12T20:00:15.489Z] 168550K .......... .......... .......... .......... .......... 93%  305M 1s
[task 2024-02-12T20:00:15.490Z] 168600K .......... .......... .......... .......... .......... 93%  293M 1s
[task 2024-02-12T20:00:15.490Z] 168650K .......... .......... .......... .......... .......... 93%  331M 1s
[task 2024-02-12T20:00:15.490Z] 168700K .......... .......... .......... .......... .......... 93%  295M 1s
[task 2024-02-12T20:00:15.494Z] 168750K .......... .......... .......... .......... .......... 93% 11.0M 1s
[task 2024-02-12T20:00:15.494Z] 168800K .......... .......... .......... .......... .......... 93%  327M 1s
[task 2024-02-12T20:00:15.495Z] 168850K .......... .......... .......... .......... .......... 93%  290M 1s
[task 2024-02-12T20:00:15.495Z] 168900K .......... .......... .......... .......... .......... 93% 76.3M 1s
[task 2024-02-12T20:00:15.501Z] 168950K .......... .......... .......... .......... .......... 93% 8.88M 1s
[task 2024-02-12T20:00:15.508Z] 169000K .......... .......... .......... .......... .......... 93% 6.85M 1s
[task 2024-02-12T20:00:15.509Z] 169050K .......... .......... .......... .......... .......... 93% 49.0M 1s
[task 2024-02-12T20:00:15.509Z] 169100K .......... .......... .......... .......... .......... 93%  162M 1s
[task 2024-02-12T20:00:15.513Z] 169150K .......... .......... .......... .......... .......... 94% 13.5M 1s
[task 2024-02-12T20:00:15.514Z] 169200K .......... .......... .......... .......... .......... 94% 30.7M 1s
[task 2024-02-12T20:00:15.518Z] 169250K .......... .......... .......... .......... .......... 94% 15.5M 1s
[task 2024-02-12T20:00:15.518Z] 169300K .......... .......... .......... .......... .......... 94%  325M 1s
[task 2024-02-12T20:00:15.518Z] 169350K .......... .......... .......... .......... .......... 94%  207M 1s
[task 2024-02-12T20:00:15.532Z] 169400K .......... .......... .......... .......... .......... 94% 3.37M 1s
[task 2024-02-12T20:00:15.545Z] 169450K .......... .......... .......... .......... .......... 94% 3.83M 1s
[task 2024-02-12T20:00:15.546Z] 169500K .......... .......... .......... .......... .......... 94% 94.4M 1s
[task 2024-02-12T20:00:15.546Z] 169550K .......... .......... .......... .......... .......... 94%  137M 1s
[task 2024-02-12T20:00:15.547Z] 169600K .......... .......... .......... .......... .......... 94% 81.5M 1s
[task 2024-02-12T20:00:15.547Z] 169650K .......... .......... .......... .......... .......... 94%  132M 1s
[task 2024-02-12T20:00:15.547Z] 169700K .......... .......... .......... .......... .......... 94%  124M 1s
[task 2024-02-12T20:00:15.552Z] 169750K .......... .......... .......... .......... .......... 94% 11.4M 1s
[task 2024-02-12T20:00:15.552Z] 169800K .......... .......... .......... .......... .......... 94%  311M 1s
[task 2024-02-12T20:00:15.552Z] 169850K .......... .......... .......... .......... .......... 94%  287M 1s
[task 2024-02-12T20:00:15.552Z] 169900K .......... .......... .......... .......... .......... 94%  312M 1s
[task 2024-02-12T20:00:15.552Z] 169950K .......... .......... .......... .......... .......... 94%  266M 1s
[task 2024-02-12T20:00:15.557Z] 170000K .......... .......... .......... .......... .......... 94% 10.9M 1s
[task 2024-02-12T20:00:15.557Z] 170050K .......... .......... .......... .......... .......... 94%  318M 1s
[task 2024-02-12T20:00:15.557Z] 170100K .......... .......... .......... .......... .......... 94%  273M 1s
[task 2024-02-12T20:00:15.557Z] 170150K .......... .......... .......... .......... .......... 94%  334M 1s
[task 2024-02-12T20:00:15.558Z] 170200K .......... .......... .......... .......... .......... 94%  301M 1s
[task 2024-02-12T20:00:15.562Z] 170250K .......... .......... .......... .......... .......... 94%  376M 1s
[task 2024-02-12T20:00:15.562Z] 170300K .......... .......... .......... .......... .......... 94% 10.9M 1s
[task 2024-02-12T20:00:15.562Z] 170350K .......... .......... .......... .......... .......... 94%  296M 1s
[task 2024-02-12T20:00:15.562Z] 170400K .......... .......... .......... .......... .......... 94%  329M 1s
[task 2024-02-12T20:00:15.563Z] 170450K .......... .......... .......... .......... .......... 94%  286M 1s
[task 2024-02-12T20:00:15.563Z] 170500K .......... .......... .......... .......... .......... 94%  358M 1s
[task 2024-02-12T20:00:15.574Z] 170550K .......... .......... .......... .......... .......... 94% 4.36M 1s
[task 2024-02-12T20:00:15.574Z] 170600K .......... .......... .......... .......... .......... 94%  111M 1s
[task 2024-02-12T20:00:15.580Z] 170650K .......... .......... .......... .......... .......... 94% 9.25M 1s
[task 2024-02-12T20:00:15.585Z] 170700K .......... .......... .......... .......... .......... 94% 9.95M 0s
[task 2024-02-12T20:00:15.585Z] 170750K .......... .......... .......... .......... .......... 94%  140M 0s
[task 2024-02-12T20:00:15.589Z] 170800K .......... .......... .......... .......... .......... 94% 11.0M 0s
[task 2024-02-12T20:00:15.591Z] 170850K .......... .......... .......... .......... .......... 94% 32.0M 0s
[task 2024-02-12T20:00:15.597Z] 170900K .......... .......... .......... .......... .......... 94% 7.52M 0s
[task 2024-02-12T20:00:15.602Z] 170950K .......... .......... .......... .......... .......... 95% 11.2M 0s
[task 2024-02-12T20:00:15.602Z] 171000K .......... .......... .......... .......... .......... 95%  124M 0s
[task 2024-02-12T20:00:15.622Z] 171050K .......... .......... .......... .......... .......... 95% 2.42M 0s
[task 2024-02-12T20:00:15.623Z] 171100K .......... .......... .......... .......... .......... 95%  120M 0s
[task 2024-02-12T20:00:15.623Z] 171150K .......... .......... .......... .......... .......... 95%  123M 0s
[task 2024-02-12T20:00:15.624Z] 171200K .......... .......... .......... .......... .......... 95% 74.2M 0s
[task 2024-02-12T20:00:15.624Z] 171250K .......... .......... .......... .......... .......... 95%  123M 0s
[task 2024-02-12T20:00:15.628Z] 171300K .......... .......... .......... .......... .......... 95% 11.5M 0s
[task 2024-02-12T20:00:15.629Z] 171350K .......... .......... .......... .......... .......... 95%  262M 0s
[task 2024-02-12T20:00:15.629Z] 171400K .......... .......... .......... .......... .......... 95%  212M 0s
[task 2024-02-12T20:00:15.629Z] 171450K .......... .......... .......... .......... .......... 95%  222M 0s
[task 2024-02-12T20:00:15.629Z] 171500K .......... .......... .......... .......... .......... 95%  297M 0s
[task 2024-02-12T20:00:15.634Z] 171550K .......... .......... .......... .......... .......... 95% 10.7M 0s
[task 2024-02-12T20:00:15.634Z] 171600K .......... .......... .......... .......... .......... 95%  248M 0s
[task 2024-02-12T20:00:15.634Z] 171650K .......... .......... .......... .......... .......... 95%  243M 0s
[task 2024-02-12T20:00:15.634Z] 171700K .......... .......... .......... .......... .......... 95%  255M 0s
[task 2024-02-12T20:00:15.635Z] 171750K .......... .......... .......... .......... .......... 95%  282M 0s
[task 2024-02-12T20:00:15.639Z] 171800K .......... .......... .......... .......... .......... 95% 11.0M 0s
[task 2024-02-12T20:00:15.639Z] 171850K .......... .......... .......... .......... .......... 95%  265M 0s
[task 2024-02-12T20:00:15.639Z] 171900K .......... .......... .......... .......... .......... 95%  257M 0s
[task 2024-02-12T20:00:15.640Z] 171950K .......... .......... .......... .......... .......... 95%  270M 0s
[task 2024-02-12T20:00:15.640Z] 172000K .......... .......... .......... .......... .......... 95%  314M 0s
[task 2024-02-12T20:00:15.646Z] 172050K .......... .......... .......... .......... .......... 95% 7.88M 0s
[task 2024-02-12T20:00:15.647Z] 172100K .......... .......... .......... .......... .......... 95% 41.0M 0s
[task 2024-02-12T20:00:15.647Z] 172150K .......... .......... .......... .......... .......... 95%  155M 0s
[task 2024-02-12T20:00:15.651Z] 172200K .......... .......... .......... .......... .......... 95% 14.2M 0s
[task 2024-02-12T20:00:15.655Z] 172250K .......... .......... .......... .......... .......... 95% 10.7M 0s
[task 2024-02-12T20:00:15.657Z] 172300K .......... .......... .......... .......... .......... 95%  119M 0s
[task 2024-02-12T20:00:15.657Z] 172350K .......... .......... .......... .......... .......... 95% 52.0M 0s
[task 2024-02-12T20:00:15.657Z] 172400K .......... .......... .......... .......... .......... 95%  283M 0s
[task 2024-02-12T20:00:15.677Z] 172450K .......... .......... .......... .......... .......... 95% 2.47M 0s
[task 2024-02-12T20:00:15.683Z] 172500K .......... .......... .......... .......... .......... 95% 7.28M 0s
[task 2024-02-12T20:00:15.690Z] 172550K .......... .......... .......... .......... .......... 95% 7.84M 0s
[task 2024-02-12T20:00:15.690Z] 172600K .......... .......... .......... .......... .......... 95%  102M 0s
[task 2024-02-12T20:00:15.691Z] 172650K .......... .......... .......... .......... .......... 95%  111M 0s
[task 2024-02-12T20:00:15.691Z] 172700K .......... .......... .......... .......... .......... 95%  100M 0s
[task 2024-02-12T20:00:15.691Z] 172750K .......... .......... .......... .......... .......... 96%  116M 0s
[task 2024-02-12T20:00:15.692Z] 172800K .......... .......... .......... .......... .......... 96%  123M 0s
[task 2024-02-12T20:00:15.696Z] 172850K .......... .......... .......... .......... .......... 96% 11.5M 0s
[task 2024-02-12T20:00:15.696Z] 172900K .......... .......... .......... .......... .......... 96%  321M 0s
[task 2024-02-12T20:00:15.696Z] 172950K .......... .......... .......... .......... .......... 96%  243M 0s
[task 2024-02-12T20:00:15.697Z] 173000K .......... .......... .......... .......... .......... 96%  293M 0s
[task 2024-02-12T20:00:15.697Z] 173050K .......... .......... .......... .......... .......... 96%  269M 0s
[task 2024-02-12T20:00:15.701Z] 173100K .......... .......... .......... .......... .......... 96% 10.9M 0s
[task 2024-02-12T20:00:15.701Z] 173150K .......... .......... .......... .......... .......... 96%  323M 0s
[task 2024-02-12T20:00:15.702Z] 173200K .......... .......... .......... .......... .......... 96%  233M 0s
[task 2024-02-12T20:00:15.702Z] 173250K .......... .......... .......... .......... .......... 96%  292M 0s
[task 2024-02-12T20:00:15.711Z] 173300K .......... .......... .......... .......... .......... 96% 5.08M 0s
[task 2024-02-12T20:00:15.712Z] 173350K .......... .......... .......... .......... .......... 96%  120M 0s
[task 2024-02-12T20:00:15.712Z] 173400K .......... .......... .......... .......... .......... 96% 99.4M 0s
[task 2024-02-12T20:00:15.713Z] 173450K .......... .......... .......... .......... .......... 96% 95.7M 0s
[task 2024-02-12T20:00:15.713Z] 173500K .......... .......... .......... .......... .......... 96%  173M 0s
[task 2024-02-12T20:00:15.714Z] 173550K .......... .......... .......... .......... .......... 96%  100M 0s
[task 2024-02-12T20:00:15.718Z] 173600K .......... .......... .......... .......... .......... 96% 11.1M 0s
[task 2024-02-12T20:00:15.718Z] 173650K .......... .......... .......... .......... .......... 96%  288M 0s
[task 2024-02-12T20:00:15.718Z] 173700K .......... .......... .......... .......... .......... 96%  215M 0s
[task 2024-02-12T20:00:15.723Z] 173750K .......... .......... .......... .......... .......... 96% 11.7M 0s
[task 2024-02-12T20:00:15.723Z] 173800K .......... .......... .......... .......... .......... 96%  144M 0s
[task 2024-02-12T20:00:15.728Z] 173850K .......... .......... .......... .......... .......... 96% 9.15M 0s
[task 2024-02-12T20:00:15.729Z] 173900K .......... .......... .......... .......... .......... 96% 62.4M 0s
[task 2024-02-12T20:00:15.740Z] 173950K .......... .......... .......... .......... .......... 96% 4.43M 0s
[task 2024-02-12T20:00:15.740Z] 174000K .......... .......... .......... .......... .......... 96%  140M 0s
[task 2024-02-12T20:00:15.741Z] 174050K .......... .......... .......... .......... .......... 96%  291M 0s
[task 2024-02-12T20:00:15.760Z] 174100K .......... .......... .......... .......... .......... 96% 2.45M 0s
[task 2024-02-12T20:00:15.761Z] 174150K .......... .......... .......... .......... .......... 96%  145M 0s
[task 2024-02-12T20:00:15.766Z] 174200K .......... .......... .......... .......... .......... 96% 8.72M 0s
[task 2024-02-12T20:00:15.767Z] 174250K .......... .......... .......... .......... .......... 96%  220M 0s
[task 2024-02-12T20:00:15.767Z] 174300K .......... .......... .......... .......... .......... 96%  104M 0s
[task 2024-02-12T20:00:15.771Z] 174350K .......... .......... .......... .......... .......... 96% 78.6M 0s
[task 2024-02-12T20:00:15.772Z] 174400K .......... .......... .......... .......... .......... 96% 12.6M 0s
[task 2024-02-12T20:00:15.772Z] 174450K .......... .......... .......... .......... .......... 96%  282M 0s
[task 2024-02-12T20:00:15.772Z] 174500K .......... .......... .......... .......... .......... 96%  300M 0s
[task 2024-02-12T20:00:15.772Z] 174550K .......... .......... .......... .......... .......... 97%  321M 0s
[task 2024-02-12T20:00:15.776Z] 174600K .......... .......... .......... .......... .......... 97%  330M 0s
[task 2024-02-12T20:00:15.777Z] 174650K .......... .......... .......... .......... .......... 97% 11.1M 0s
[task 2024-02-12T20:00:15.777Z] 174700K .......... .......... .......... .......... .......... 97%  252M 0s
[task 2024-02-12T20:00:15.777Z] 174750K .......... .......... .......... .......... .......... 97%  336M 0s
[task 2024-02-12T20:00:15.777Z] 174800K .......... .......... .......... .......... .......... 97%  322M 0s
[task 2024-02-12T20:00:15.777Z] 174850K .......... .......... .......... .......... .......... 97%  330M 0s
[task 2024-02-12T20:00:15.783Z] 174900K .......... .......... .......... .......... .......... 97% 8.05M 0s
[task 2024-02-12T20:00:15.784Z] 174950K .......... .......... .......... .......... .......... 97%  106M 0s
[task 2024-02-12T20:00:15.784Z] 175000K .......... .......... .......... .......... .......... 97% 93.9M 0s
[task 2024-02-12T20:00:15.785Z] 175050K .......... .......... .......... .......... .......... 97% 88.7M 0s
[task 2024-02-12T20:00:15.785Z] 175100K .......... .......... .......... .......... .......... 97%  174M 0s
[task 2024-02-12T20:00:15.790Z] 175150K .......... .......... .......... .......... .......... 97% 11.0M 0s
[task 2024-02-12T20:00:15.790Z] 175200K .......... .......... .......... .......... .......... 97%  185M 0s
[task 2024-02-12T20:00:15.790Z] 175250K .......... .......... .......... .......... .......... 97%  114M 0s
[task 2024-02-12T20:00:15.794Z] 175300K .......... .......... .......... .......... .......... 97% 15.3M 0s
[task 2024-02-12T20:00:15.795Z] 175350K .......... .......... .......... .......... .......... 97% 42.8M 0s
[task 2024-02-12T20:00:15.808Z] 175400K .......... .......... .......... .......... .......... 97% 3.61M 0s
[task 2024-02-12T20:00:15.809Z] 175450K .......... .......... .......... .......... .......... 97%  110M 0s
[task 2024-02-12T20:00:15.814Z] 175500K .......... .......... .......... .......... .......... 97% 8.36M 0s
[task 2024-02-12T20:00:15.822Z] 175550K .......... .......... .......... .......... .......... 97% 6.76M 0s
[task 2024-02-12T20:00:15.827Z] 175600K .......... .......... .......... .......... .......... 97% 8.50M 0s
[task 2024-02-12T20:00:15.828Z] 175650K .......... .......... .......... .......... .......... 97% 50.5M 0s
[task 2024-02-12T20:00:15.829Z] 175700K .......... .......... .......... .......... .......... 97% 92.0M 0s
[task 2024-02-12T20:00:15.834Z] 175750K .......... .......... .......... .......... .......... 97% 9.08M 0s
[task 2024-02-12T20:00:15.835Z] 175800K .......... .......... .......... .......... .......... 97%  141M 0s
[task 2024-02-12T20:00:15.835Z] 175850K .......... .......... .......... .......... .......... 97% 79.0M 0s
[task 2024-02-12T20:00:15.841Z] 175900K .......... .......... .......... .......... .......... 97% 8.88M 0s
[task 2024-02-12T20:00:15.841Z] 175950K .......... .......... .......... .......... .......... 97%  282M 0s
[task 2024-02-12T20:00:15.841Z] 176000K .......... .......... .......... .......... .......... 97%  338M 0s
[task 2024-02-12T20:00:15.841Z] 176050K .......... .......... .......... .......... .......... 97%  323M 0s
[task 2024-02-12T20:00:15.841Z] 176100K .......... .......... .......... .......... .......... 97%  233M 0s
[task 2024-02-12T20:00:15.847Z] 176150K .......... .......... .......... .......... .......... 97% 8.89M 0s
[task 2024-02-12T20:00:15.850Z] 176200K .......... .......... .......... .......... .......... 97% 17.0M 0s
[task 2024-02-12T20:00:15.850Z] 176250K .......... .......... .......... .......... .......... 97%  118M 0s
[task 2024-02-12T20:00:15.851Z] 176300K .......... .......... .......... .......... .......... 97%  111M 0s
[task 2024-02-12T20:00:15.851Z] 176350K .......... .......... .......... .......... .......... 98%  105M 0s
[task 2024-02-12T20:00:15.856Z] 176400K .......... .......... .......... .......... .......... 98%  164M 0s
[task 2024-02-12T20:00:15.857Z] 176450K .......... .......... .......... .......... .......... 98% 9.45M 0s
[task 2024-02-12T20:00:15.857Z] 176500K .......... .......... .......... .......... .......... 98%  314M 0s
[task 2024-02-12T20:00:15.857Z] 176550K .......... .......... .......... .......... .......... 98%  365M 0s
[task 2024-02-12T20:00:15.857Z] 176600K .......... .......... .......... .......... .......... 98%  294M 0s
[task 2024-02-12T20:00:15.863Z] 176650K .......... .......... .......... .......... .......... 98%  377M 0s
[task 2024-02-12T20:00:15.863Z] 176700K .......... .......... .......... .......... .......... 98% 8.49M 0s
[task 2024-02-12T20:00:15.863Z] 176750K .......... .......... .......... .......... .......... 98%  327M 0s
[task 2024-02-12T20:00:15.865Z] 176800K .......... .......... .......... .......... .......... 98% 22.2M 0s
[task 2024-02-12T20:00:15.866Z] 176850K .......... .......... .......... .......... .......... 98% 67.4M 0s
[task 2024-02-12T20:00:15.866Z] 176900K .......... .......... .......... .......... .......... 98%  104M 0s
[task 2024-02-12T20:00:15.871Z] 176950K .......... .......... .......... .......... .......... 98% 9.74M 0s
[task 2024-02-12T20:00:15.878Z] 177000K .......... .......... .......... .......... .......... 98% 7.15M 0s
[task 2024-02-12T20:00:15.898Z] 177050K .......... .......... .......... .......... .......... 98% 2.50M 0s
[task 2024-02-12T20:00:15.898Z] 177100K .......... .......... .......... .......... .......... 98%  116M 0s
[task 2024-02-12T20:00:15.899Z] 177150K .......... .......... .......... .......... .......... 98% 80.8M 0s
[task 2024-02-12T20:00:15.904Z] 177200K .......... .......... .......... .......... .......... 98% 8.79M 0s
[task 2024-02-12T20:00:15.910Z] 177250K .......... .......... .......... .......... .......... 98% 9.57M 0s
[task 2024-02-12T20:00:15.910Z] 177300K .......... .......... .......... .......... .......... 98%  130M 0s
[task 2024-02-12T20:00:15.910Z] 177350K .......... .......... .......... .......... .......... 98%  130M 0s
[task 2024-02-12T20:00:15.911Z] 177400K .......... .......... .......... .......... .......... 98% 87.9M 0s
[task 2024-02-12T20:00:15.915Z] 177450K .......... .......... .......... .......... .......... 98% 11.8M 0s
[task 2024-02-12T20:00:15.915Z] 177500K .......... .......... .......... .......... .......... 98%  310M 0s
[task 2024-02-12T20:00:15.915Z] 177550K .......... .......... .......... .......... .......... 98%  320M 0s
[task 2024-02-12T20:00:15.916Z] 177600K .......... .......... .......... .......... .......... 98%  262M 0s
[task 2024-02-12T20:00:15.916Z] 177650K .......... .......... .......... .......... .......... 98%  345M 0s
[task 2024-02-12T20:00:15.920Z] 177700K .......... .......... .......... .......... .......... 98% 11.0M 0s
[task 2024-02-12T20:00:15.920Z] 177750K .......... .......... .......... .......... .......... 98%  324M 0s
[task 2024-02-12T20:00:15.920Z] 177800K .......... .......... .......... .......... .......... 98%  338M 0s
[task 2024-02-12T20:00:15.921Z] 177850K .......... .......... .......... .......... .......... 98% 46.1M 0s
[task 2024-02-12T20:00:15.922Z] 177900K .......... .......... .......... .......... .......... 98%  110M 0s
[task 2024-02-12T20:00:15.926Z] 177950K .......... .......... .......... .......... .......... 98% 11.7M 0s
[task 2024-02-12T20:00:15.926Z] 178000K .......... .......... .......... .......... .......... 98%  319M 0s
[task 2024-02-12T20:00:15.926Z] 178050K .......... .......... .......... .......... .......... 98%  336M 0s
[task 2024-02-12T20:00:15.927Z] 178100K .......... .......... .......... .......... .......... 98%  295M 0s
[task 2024-02-12T20:00:15.928Z] 178150K .......... .......... .......... .......... .......... 99% 50.2M 0s
[task 2024-02-12T20:00:15.931Z] 178200K .......... .......... .......... .......... .......... 99% 13.2M 0s
[task 2024-02-12T20:00:15.931Z] 178250K .......... .......... .......... .......... .......... 99%  286M 0s
[task 2024-02-12T20:00:15.932Z] 178300K .......... .......... .......... .......... .......... 99%  329M 0s
[task 2024-02-12T20:00:15.932Z] 178350K .......... .......... .......... .......... .......... 99% 53.8M 0s
[task 2024-02-12T20:00:15.946Z] 178400K .......... .......... .......... .......... .......... 99% 3.57M 0s
[task 2024-02-12T20:00:15.946Z] 178450K .......... .......... .......... .......... .......... 99%  156M 0s
[task 2024-02-12T20:00:15.952Z] 178500K .......... .......... .......... .......... .......... 99% 8.43M 0s
[task 2024-02-12T20:00:15.959Z] 178550K .......... .......... .......... .......... .......... 99% 7.50M 0s
[task 2024-02-12T20:00:15.965Z] 178600K .......... .......... .......... .......... .......... 99% 7.50M 0s
[task 2024-02-12T20:00:15.966Z] 178650K .......... .......... .......... .......... .......... 99% 59.1M 0s
[task 2024-02-12T20:00:15.970Z] 178700K .......... .......... .......... .......... .......... 99% 95.6M 0s
[task 2024-02-12T20:00:15.979Z] 178750K .......... .......... .......... .......... .......... 99% 3.86M 0s
[task 2024-02-12T20:00:15.980Z] 178800K .......... .......... .......... .......... .......... 99% 99.4M 0s
[task 2024-02-12T20:00:15.980Z] 178850K .......... .......... .......... .......... .......... 99%  135M 0s
[task 2024-02-12T20:00:15.980Z] 178900K .......... .......... .......... .......... .......... 99%  134M 0s
[task 2024-02-12T20:00:15.985Z] 178950K .......... .......... .......... .......... .......... 99%  111M 0s
[task 2024-02-12T20:00:15.985Z] 179000K .......... .......... .......... .......... .......... 99% 11.8M 0s
[task 2024-02-12T20:00:15.985Z] 179050K .......... .......... .......... .......... .......... 99%  326M 0s
[task 2024-02-12T20:00:15.988Z] 179100K .......... .......... .......... .......... .......... 99% 18.3M 0s
[task 2024-02-12T20:00:15.988Z] 179150K .......... .......... .......... .......... .......... 99%  160M 0s
[task 2024-02-12T20:00:15.989Z] 179200K .......... .......... .......... .......... .......... 99% 71.0M 0s
[task 2024-02-12T20:00:15.993Z] 179250K .......... .......... .......... .......... .......... 99% 12.3M 0s
[task 2024-02-12T20:00:15.993Z] 179300K .......... .......... .......... .......... .......... 99%  322M 0s
[task 2024-02-12T20:00:15.993Z] 179350K .......... .......... .......... .......... .......... 99%  287M 0s
[task 2024-02-12T20:00:15.993Z] 179400K .......... .......... .......... .......... .......... 99%  324M 0s
[task 2024-02-12T20:00:15.995Z] 179450K .......... .......... .......... .......... .......... 99% 33.9M 0s
[task 2024-02-12T20:00:15.999Z] 179500K .......... .......... .......... .......... .......... 99% 11.9M 0s
[task 2024-02-12T20:00:15.999Z] 179550K .......... .......... .......... .......... .......... 99%  302M 0s
[task 2024-02-12T20:00:15.999Z] 179600K .......... .......... .......... .......... .......... 99%  275M 0s
[task 2024-02-12T20:00:15.999Z] 179650K .......... .......... .......... .......... .......... 99%  335M 0s
[task 2024-02-12T20:00:16.001Z] 179700K .......... .......... .......... .......... .......... 99% 28.9M 0s
[task 2024-02-12T20:00:16.005Z] 179750K .......... .......... .......... .......... .......... 99% 11.2M 0s
[task 2024-02-12T20:00:16.006Z] 179800K .......... .......... .......... .......... .......... 99%  351M 0s
[task 2024-02-12T20:00:16.006Z] 179850K .......... .......... .......... .......... .......... 99%  286M 0s
[task 2024-02-12T20:00:16.006Z] 179900K .......... .......... .......... .......... .......... 99%  340M 0s
[task 2024-02-12T20:00:16.006Z] 179950K .......... .....                                      100%  263M=9.6s
[task 2024-02-12T20:00:16.006Z] 
[task 2024-02-12T20:00:16.006Z] 2024-02-12 20:00:16 (18.2 MB/s) - written to stdout [184284260/184284260]
[task 2024-02-12T20:00:16.006Z] 
[task 2024-02-12T20:00:16.067Z] + echo '###### Done: Downloading WMT newscrawl monolingual data'
[task 2024-02-12T20:00:16.067Z] ###### Done: Downloading WMT newscrawl monolingual data
[task 2024-02-12T20:00:16.067Z] + echo '### Sampling dataset'
[task 2024-02-12T20:00:16.067Z] ### Sampling dataset
[task 2024-02-12T20:00:16.067Z] + set +o pipefail
[task 2024-02-12T20:00:16.067Z] + zstdmt -dc /builds/worker/artifacts/original/news-crawl_news.2007.original.en.zst
[task 2024-02-12T20:00:16.068Z] + perl -ne 'print if(split(/\s/, $_) < 100)'
[task 2024-02-12T20:00:16.068Z] + head -n 10000
[task 2024-02-12T20:00:16.068Z] ++ bc -l
[task 2024-02-12T20:00:16.068Z] + zstdmt
[task 2024-02-12T20:00:16.069Z] + shuf -n 11000
[task 2024-02-12T20:00:17.546Z] + set -o pipefail
[task 2024-02-12T20:00:17.546Z] + rm -rf /builds/worker/artifacts/original/news-crawl_news.2007.original.en.zst
[task 2024-02-12T20:00:17.567Z] + echo '###### Done: Downloading monolingual data'
[task 2024-02-12T20:00:17.567Z] ###### Done: Downloading monolingual data
[taskcluster 2024-02-12 20:00:18.041Z] === Task Finished ===
[taskcluster 2024-02-12 20:00:18.277Z] Successful task run with exit code: 0 completed in 76.908 seconds