Add kind that demonstrates how to modify the upstream graph in a transform #438
firefoxci-taskcluster / clean-mono-news-crawl-ru-news_2008-mono-src
succeeded
Feb 12, 2024 in 2m 43s
FirefoxCI (pull_request)
Clean news-crawl news_2008 dataset mono-src ru
Details
View task in Taskcluster
View logs in Taskcluster
[task 2024-02-12T20:00:15.101Z] 117250K .......... .......... .......... .......... .......... 91% 249M 0s
[task 2024-02-12T20:00:15.102Z] 117300K .......... .......... .......... .......... .......... 91% 316M 0s
[task 2024-02-12T20:00:15.102Z] 117350K .......... .......... .......... .......... .......... 91% 329M 0s
[task 2024-02-12T20:00:15.102Z] 117400K .......... .......... .......... .......... .......... 91% 264M 0s
[task 2024-02-12T20:00:15.102Z] 117450K .......... .......... .......... .......... .......... 91% 284M 0s
[task 2024-02-12T20:00:15.102Z] 117500K .......... .......... .......... .......... .......... 91% 305M 0s
[task 2024-02-12T20:00:15.102Z] 117550K .......... .......... .......... .......... .......... 91% 259M 0s
[task 2024-02-12T20:00:15.103Z] 117600K .......... .......... .......... .......... .......... 91% 318M 0s
[task 2024-02-12T20:00:15.103Z] 117650K .......... .......... .......... .......... .......... 91% 263M 0s
[task 2024-02-12T20:00:15.103Z] 117700K .......... .......... .......... .......... .......... 91% 302M 0s
[task 2024-02-12T20:00:15.103Z] 117750K .......... .......... .......... .......... .......... 91% 310M 0s
[task 2024-02-12T20:00:15.103Z] 117800K .......... .......... .......... .......... .......... 91% 294M 0s
[task 2024-02-12T20:00:15.103Z] 117850K .......... .......... .......... .......... .......... 91% 278M 0s
[task 2024-02-12T20:00:15.104Z] 117900K .......... .......... .......... .......... .......... 92% 322M 0s
[task 2024-02-12T20:00:15.104Z] 117950K .......... .......... .......... .......... .......... 92% 331M 0s
[task 2024-02-12T20:00:15.104Z] 118000K .......... .......... .......... .......... .......... 92% 334M 0s
[task 2024-02-12T20:00:15.104Z] 118050K .......... .......... .......... .......... .......... 92% 266M 0s
[task 2024-02-12T20:00:15.104Z] 118100K .......... .......... .......... .......... .......... 92% 336M 0s
[task 2024-02-12T20:00:15.104Z] 118150K .......... .......... .......... .......... .......... 92% 325M 0s
[task 2024-02-12T20:00:15.105Z] 118200K .......... .......... .......... .......... .......... 92% 168M 0s
[task 2024-02-12T20:00:15.105Z] 118250K .......... .......... .......... .......... .......... 92% 305M 0s
[task 2024-02-12T20:00:15.105Z] 118300K .......... .......... .......... .......... .......... 92% 294M 0s
[task 2024-02-12T20:00:15.105Z] 118350K .......... .......... .......... .......... .......... 92% 325M 0s
[task 2024-02-12T20:00:15.105Z] 118400K .......... .......... .......... .......... .......... 92% 297M 0s
[task 2024-02-12T20:00:15.105Z] 118450K .......... .......... .......... .......... .......... 92% 297M 0s
[task 2024-02-12T20:00:15.106Z] 118500K .......... .......... .......... .......... .......... 92% 313M 0s
[task 2024-02-12T20:00:15.106Z] 118550K .......... .......... .......... .......... .......... 92% 326M 0s
[task 2024-02-12T20:00:15.106Z] 118600K .......... .......... .......... .......... .......... 92% 315M 0s
[task 2024-02-12T20:00:15.106Z] 118650K .......... .......... .......... .......... .......... 92% 293M 0s
[task 2024-02-12T20:00:15.106Z] 118700K .......... .......... .......... .......... .......... 92% 310M 0s
[task 2024-02-12T20:00:15.106Z] 118750K .......... .......... .......... .......... .......... 92% 264M 0s
[task 2024-02-12T20:00:15.107Z] 118800K .......... .......... .......... .......... .......... 92% 313M 0s
[task 2024-02-12T20:00:15.107Z] 118850K .......... .......... .......... .......... .......... 92% 281M 0s
[task 2024-02-12T20:00:15.107Z] 118900K .......... .......... .......... .......... .......... 92% 319M 0s
[task 2024-02-12T20:00:15.107Z] 118950K .......... .......... .......... .......... .......... 92% 338M 0s
[task 2024-02-12T20:00:15.107Z] 119000K .......... .......... .......... .......... .......... 92% 337M 0s
[task 2024-02-12T20:00:15.107Z] 119050K .......... .......... .......... .......... .......... 92% 289M 0s
[task 2024-02-12T20:00:15.108Z] 119100K .......... .......... .......... .......... .......... 92% 321M 0s
[task 2024-02-12T20:00:15.108Z] 119150K .......... .......... .......... .......... .......... 92% 331M 0s
[task 2024-02-12T20:00:15.108Z] 119200K .......... .......... .......... .......... .......... 93% 81.0M 0s
[task 2024-02-12T20:00:15.109Z] 119250K .......... .......... .......... .......... .......... 93% 223M 0s
[task 2024-02-12T20:00:15.109Z] 119300K .......... .......... .......... .......... .......... 93% 305M 0s
[task 2024-02-12T20:00:15.109Z] 119350K .......... .......... .......... .......... .......... 93% 298M 0s
[task 2024-02-12T20:00:15.109Z] 119400K .......... .......... .......... .......... .......... 93% 328M 0s
[task 2024-02-12T20:00:15.109Z] 119450K .......... .......... .......... .......... .......... 93% 252M 0s
[task 2024-02-12T20:00:15.109Z] 119500K .......... .......... .......... .......... .......... 93% 302M 0s
[task 2024-02-12T20:00:15.109Z] 119550K .......... .......... .......... .......... .......... 93% 322M 0s
[task 2024-02-12T20:00:15.110Z] 119600K .......... .......... .......... .......... .......... 93% 329M 0s
[task 2024-02-12T20:00:15.110Z] 119650K .......... .......... .......... .......... .......... 93% 280M 0s
[task 2024-02-12T20:00:15.110Z] 119700K .......... .......... .......... .......... .......... 93% 337M 0s
[task 2024-02-12T20:00:15.110Z] 119750K .......... .......... .......... .......... .......... 93% 333M 0s
[task 2024-02-12T20:00:15.110Z] 119800K .......... .......... .......... .......... .......... 93% 337M 0s
[task 2024-02-12T20:00:15.110Z] 119850K .......... .......... .......... .......... .......... 93% 241M 0s
[task 2024-02-12T20:00:15.111Z] 119900K .......... .......... .......... .......... .......... 93% 329M 0s
[task 2024-02-12T20:00:15.111Z] 119950K .......... .......... .......... .......... .......... 93% 330M 0s
[task 2024-02-12T20:00:15.111Z] 120000K .......... .......... .......... .......... .......... 93% 344M 0s
[task 2024-02-12T20:00:15.111Z] 120050K .......... .......... .......... .......... .......... 93% 284M 0s
[task 2024-02-12T20:00:15.111Z] 120100K .......... .......... .......... .......... .......... 93% 332M 0s
[task 2024-02-12T20:00:15.111Z] 120150K .......... .......... .......... .......... .......... 93% 335M 0s
[task 2024-02-12T20:00:15.112Z] 120200K .......... .......... .......... .......... .......... 93% 333M 0s
[task 2024-02-12T20:00:15.112Z] 120250K .......... .......... .......... .......... .......... 93% 76.9M 0s
[task 2024-02-12T20:00:15.112Z] 120300K .......... .......... .......... .......... .......... 93% 253M 0s
[task 2024-02-12T20:00:15.113Z] 120350K .......... .......... .......... .......... .......... 93% 267M 0s
[task 2024-02-12T20:00:15.113Z] 120400K .......... .......... .......... .......... .......... 93% 306M 0s
[task 2024-02-12T20:00:15.113Z] 120450K .......... .......... .......... .......... .......... 94% 234M 0s
[task 2024-02-12T20:00:15.113Z] 120500K .......... .......... .......... .......... .......... 94% 308M 0s
[task 2024-02-12T20:00:15.113Z] 120550K .......... .......... .......... .......... .......... 94% 318M 0s
[task 2024-02-12T20:00:15.113Z] 120600K .......... .......... .......... .......... .......... 94% 291M 0s
[task 2024-02-12T20:00:15.114Z] 120650K .......... .......... .......... .......... .......... 94% 283M 0s
[task 2024-02-12T20:00:15.114Z] 120700K .......... .......... .......... .......... .......... 94% 309M 0s
[task 2024-02-12T20:00:15.114Z] 120750K .......... .......... .......... .......... .......... 94% 309M 0s
[task 2024-02-12T20:00:15.114Z] 120800K .......... .......... .......... .......... .......... 94% 328M 0s
[task 2024-02-12T20:00:15.114Z] 120850K .......... .......... .......... .......... .......... 94% 275M 0s
[task 2024-02-12T20:00:15.114Z] 120900K .......... .......... .......... .......... .......... 94% 273M 0s
[task 2024-02-12T20:00:15.115Z] 120950K .......... .......... .......... .......... .......... 94% 322M 0s
[task 2024-02-12T20:00:15.115Z] 121000K .......... .......... .......... .......... .......... 94% 305M 0s
[task 2024-02-12T20:00:15.115Z] 121050K .......... .......... .......... .......... .......... 94% 275M 0s
[task 2024-02-12T20:00:15.115Z] 121100K .......... .......... .......... .......... .......... 94% 332M 0s
[task 2024-02-12T20:00:15.115Z] 121150K .......... .......... .......... .......... .......... 94% 316M 0s
[task 2024-02-12T20:00:15.115Z] 121200K .......... .......... .......... .......... .......... 94% 305M 0s
[task 2024-02-12T20:00:15.115Z] 121250K .......... .......... .......... .......... .......... 94% 276M 0s
[task 2024-02-12T20:00:15.116Z] 121300K .......... .......... .......... .......... .......... 94% 324M 0s
[task 2024-02-12T20:00:15.116Z] 121350K .......... .......... .......... .......... .......... 94% 333M 0s
[task 2024-02-12T20:00:15.116Z] 121400K .......... .......... .......... .......... .......... 94% 335M 0s
[task 2024-02-12T20:00:15.116Z] 121450K .......... .......... .......... .......... .......... 94% 280M 0s
[task 2024-02-12T20:00:15.116Z] 121500K .......... .......... .......... .......... .......... 94% 323M 0s
[task 2024-02-12T20:00:15.116Z] 121550K .......... .......... .......... .......... .......... 94% 308M 0s
[task 2024-02-12T20:00:15.117Z] 121600K .......... .......... .......... .......... .......... 94% 322M 0s
[task 2024-02-12T20:00:15.117Z] 121650K .......... .......... .......... .......... .......... 94% 285M 0s
[task 2024-02-12T20:00:15.117Z] 121700K .......... .......... .......... .......... .......... 94% 320M 0s
[task 2024-02-12T20:00:15.117Z] 121750K .......... .......... .......... .......... .......... 95% 314M 0s
[task 2024-02-12T20:00:15.117Z] 121800K .......... .......... .......... .......... .......... 95% 321M 0s
[task 2024-02-12T20:00:15.117Z] 121850K .......... .......... .......... .......... .......... 95% 273M 0s
[task 2024-02-12T20:00:15.118Z] 121900K .......... .......... .......... .......... .......... 95% 313M 0s
[task 2024-02-12T20:00:15.118Z] 121950K .......... .......... .......... .......... .......... 95% 329M 0s
[task 2024-02-12T20:00:15.118Z] 122000K .......... .......... .......... .......... .......... 95% 328M 0s
[task 2024-02-12T20:00:15.118Z] 122050K .......... .......... .......... .......... .......... 95% 82.3M 0s
[task 2024-02-12T20:00:15.119Z] 122100K .......... .......... .......... .......... .......... 95% 320M 0s
[task 2024-02-12T20:00:15.119Z] 122150K .......... .......... .......... .......... .......... 95% 291M 0s
[task 2024-02-12T20:00:15.119Z] 122200K .......... .......... .......... .......... .......... 95% 298M 0s
[task 2024-02-12T20:00:15.119Z] 122250K .......... .......... .......... .......... .......... 95% 276M 0s
[task 2024-02-12T20:00:15.119Z] 122300K .......... .......... .......... .......... .......... 95% 312M 0s
[task 2024-02-12T20:00:15.119Z] 122350K .......... .......... .......... .......... .......... 95% 293M 0s
[task 2024-02-12T20:00:15.120Z] 122400K .......... .......... .......... .......... .......... 95% 298M 0s
[task 2024-02-12T20:00:15.120Z] 122450K .......... .......... .......... .......... .......... 95% 263M 0s
[task 2024-02-12T20:00:15.120Z] 122500K .......... .......... .......... .......... .......... 95% 309M 0s
[task 2024-02-12T20:00:15.120Z] 122550K .......... .......... .......... .......... .......... 95% 304M 0s
[task 2024-02-12T20:00:15.120Z] 122600K .......... .......... .......... .......... .......... 95% 333M 0s
[task 2024-02-12T20:00:15.120Z] 122650K .......... .......... .......... .......... .......... 95% 275M 0s
[task 2024-02-12T20:00:15.121Z] 122700K .......... .......... .......... .......... .......... 95% 323M 0s
[task 2024-02-12T20:00:15.121Z] 122750K .......... .......... .......... .......... .......... 95% 327M 0s
[task 2024-02-12T20:00:15.121Z] 122800K .......... .......... .......... .......... .......... 95% 325M 0s
[task 2024-02-12T20:00:15.121Z] 122850K .......... .......... .......... .......... .......... 95% 285M 0s
[task 2024-02-12T20:00:15.121Z] 122900K .......... .......... .......... .......... .......... 95% 333M 0s
[task 2024-02-12T20:00:15.121Z] 122950K .......... .......... .......... .......... .......... 95% 309M 0s
[task 2024-02-12T20:00:15.121Z] 123000K .......... .......... .......... .......... .......... 95% 329M 0s
[task 2024-02-12T20:00:15.122Z] 123050K .......... .......... .......... .......... .......... 96% 273M 0s
[task 2024-02-12T20:00:15.122Z] 123100K .......... .......... .......... .......... .......... 96% 291M 0s
[task 2024-02-12T20:00:15.122Z] 123150K .......... .......... .......... .......... .......... 96% 325M 0s
[task 2024-02-12T20:00:15.122Z] 123200K .......... .......... .......... .......... .......... 96% 303M 0s
[task 2024-02-12T20:00:15.122Z] 123250K .......... .......... .......... .......... .......... 96% 240M 0s
[task 2024-02-12T20:00:15.123Z] 123300K .......... .......... .......... .......... .......... 96% 73.1M 0s
[task 2024-02-12T20:00:15.123Z] 123350K .......... .......... .......... .......... .......... 96% 283M 0s
[task 2024-02-12T20:00:15.123Z] 123400K .......... .......... .......... .......... .......... 96% 270M 0s
[task 2024-02-12T20:00:15.124Z] 123450K .......... .......... .......... .......... .......... 96% 268M 0s
[task 2024-02-12T20:00:15.124Z] 123500K .......... .......... .......... .......... .......... 96% 311M 0s
[task 2024-02-12T20:00:15.124Z] 123550K .......... .......... .......... .......... .......... 96% 309M 0s
[task 2024-02-12T20:00:15.124Z] 123600K .......... .......... .......... .......... .......... 96% 291M 0s
[task 2024-02-12T20:00:15.124Z] 123650K .......... .......... .......... .......... .......... 96% 261M 0s
[task 2024-02-12T20:00:15.124Z] 123700K .......... .......... .......... .......... .......... 96% 285M 0s
[task 2024-02-12T20:00:15.125Z] 123750K .......... .......... .......... .......... .......... 96% 319M 0s
[task 2024-02-12T20:00:15.125Z] 123800K .......... .......... .......... .......... .......... 96% 328M 0s
[task 2024-02-12T20:00:15.125Z] 123850K .......... .......... .......... .......... .......... 96% 262M 0s
[task 2024-02-12T20:00:15.125Z] 123900K .......... .......... .......... .......... .......... 96% 328M 0s
[task 2024-02-12T20:00:15.125Z] 123950K .......... .......... .......... .......... .......... 96% 304M 0s
[task 2024-02-12T20:00:15.125Z] 124000K .......... .......... .......... .......... .......... 96% 304M 0s
[task 2024-02-12T20:00:15.126Z] 124050K .......... .......... .......... .......... .......... 96% 266M 0s
[task 2024-02-12T20:00:15.126Z] 124100K .......... .......... .......... .......... .......... 96% 326M 0s
[task 2024-02-12T20:00:15.126Z] 124150K .......... .......... .......... .......... .......... 96% 337M 0s
[task 2024-02-12T20:00:15.126Z] 124200K .......... .......... .......... .......... .......... 96% 311M 0s
[task 2024-02-12T20:00:15.126Z] 124250K .......... .......... .......... .......... .......... 96% 282M 0s
[task 2024-02-12T20:00:15.126Z] 124300K .......... .......... .......... .......... .......... 97% 298M 0s
[task 2024-02-12T20:00:15.128Z] 124350K .......... .......... .......... .......... .......... 97% 38.3M 0s
[task 2024-02-12T20:00:15.128Z] 124400K .......... .......... .......... .......... .......... 97% 285M 0s
[task 2024-02-12T20:00:15.128Z] 124450K .......... .......... .......... .......... .......... 97% 273M 0s
[task 2024-02-12T20:00:15.128Z] 124500K .......... .......... .......... .......... .......... 97% 319M 0s
[task 2024-02-12T20:00:15.128Z] 124550K .......... .......... .......... .......... .......... 97% 331M 0s
[task 2024-02-12T20:00:15.128Z] 124600K .......... .......... .......... .......... .......... 97% 290M 0s
[task 2024-02-12T20:00:15.129Z] 124650K .......... .......... .......... .......... .......... 97% 289M 0s
[task 2024-02-12T20:00:15.129Z] 124700K .......... .......... .......... .......... .......... 97% 301M 0s
[task 2024-02-12T20:00:15.129Z] 124750K .......... .......... .......... .......... .......... 97% 313M 0s
[task 2024-02-12T20:00:15.129Z] 124800K .......... .......... .......... .......... .......... 97% 306M 0s
[task 2024-02-12T20:00:15.129Z] 124850K .......... .......... .......... .......... .......... 97% 274M 0s
[task 2024-02-12T20:00:15.129Z] 124900K .......... .......... .......... .......... .......... 97% 289M 0s
[task 2024-02-12T20:00:15.130Z] 124950K .......... .......... .......... .......... .......... 97% 228M 0s
[task 2024-02-12T20:00:15.130Z] 125000K .......... .......... .......... .......... .......... 97% 316M 0s
[task 2024-02-12T20:00:15.130Z] 125050K .......... .......... .......... .......... .......... 97% 286M 0s
[task 2024-02-12T20:00:15.130Z] 125100K .......... .......... .......... .......... .......... 97% 331M 0s
[task 2024-02-12T20:00:15.130Z] 125150K .......... .......... .......... .......... .......... 97% 317M 0s
[task 2024-02-12T20:00:15.130Z] 125200K .......... .......... .......... .......... .......... 97% 273M 0s
[task 2024-02-12T20:00:15.131Z] 125250K .......... .......... .......... .......... .......... 97% 265M 0s
[task 2024-02-12T20:00:15.131Z] 125300K .......... .......... .......... .......... .......... 97% 313M 0s
[task 2024-02-12T20:00:15.131Z] 125350K .......... .......... .......... .......... .......... 97% 305M 0s
[task 2024-02-12T20:00:15.131Z] 125400K .......... .......... .......... .......... .......... 97% 183M 0s
[task 2024-02-12T20:00:15.131Z] 125450K .......... .......... .......... .......... .......... 97% 252M 0s
[task 2024-02-12T20:00:15.132Z] 125500K .......... .......... .......... .......... .......... 97% 324M 0s
[task 2024-02-12T20:00:15.132Z] 125550K .......... .......... .......... .......... .......... 97% 298M 0s
[task 2024-02-12T20:00:15.132Z] 125600K .......... .......... .......... .......... .......... 98% 280M 0s
[task 2024-02-12T20:00:15.132Z] 125650K .......... .......... .......... .......... .......... 98% 270M 0s
[task 2024-02-12T20:00:15.132Z] 125700K .......... .......... .......... .......... .......... 98% 331M 0s
[task 2024-02-12T20:00:15.132Z] 125750K .......... .......... .......... .......... .......... 98% 262M 0s
[task 2024-02-12T20:00:15.133Z] 125800K .......... .......... .......... .......... .......... 98% 305M 0s
[task 2024-02-12T20:00:15.133Z] 125850K .......... .......... .......... .......... .......... 98% 282M 0s
[task 2024-02-12T20:00:15.133Z] 125900K .......... .......... .......... .......... .......... 98% 328M 0s
[task 2024-02-12T20:00:15.133Z] 125950K .......... .......... .......... .......... .......... 98% 332M 0s
[task 2024-02-12T20:00:15.133Z] 126000K .......... .......... .......... .......... .......... 98% 328M 0s
[task 2024-02-12T20:00:15.133Z] 126050K .......... .......... .......... .......... .......... 98% 263M 0s
[task 2024-02-12T20:00:15.133Z] 126100K .......... .......... .......... .......... .......... 98% 337M 0s
[task 2024-02-12T20:00:15.134Z] 126150K .......... .......... .......... .......... .......... 98% 326M 0s
[task 2024-02-12T20:00:15.134Z] 126200K .......... .......... .......... .......... .......... 98% 314M 0s
[task 2024-02-12T20:00:15.134Z] 126250K .......... .......... .......... .......... .......... 98% 288M 0s
[task 2024-02-12T20:00:15.134Z] 126300K .......... .......... .......... .......... .......... 98% 332M 0s
[task 2024-02-12T20:00:15.134Z] 126350K .......... .......... .......... .......... .......... 98% 282M 0s
[task 2024-02-12T20:00:15.135Z] 126400K .......... .......... .......... .......... .......... 98% 255M 0s
[task 2024-02-12T20:00:15.135Z] 126450K .......... .......... .......... .......... .......... 98% 254M 0s
[task 2024-02-12T20:00:15.135Z] 126500K .......... .......... .......... .......... .......... 98% 320M 0s
[task 2024-02-12T20:00:15.135Z] 126550K .......... .......... .......... .......... .......... 98% 319M 0s
[task 2024-02-12T20:00:15.135Z] 126600K .......... .......... .......... .......... .......... 98% 322M 0s
[task 2024-02-12T20:00:15.135Z] 126650K .......... .......... .......... .......... .......... 98% 276M 0s
[task 2024-02-12T20:00:15.135Z] 126700K .......... .......... .......... .......... .......... 98% 295M 0s
[task 2024-02-12T20:00:15.136Z] 126750K .......... .......... .......... .......... .......... 98% 322M 0s
[task 2024-02-12T20:00:15.136Z] 126800K .......... .......... .......... .......... .......... 98% 289M 0s
[task 2024-02-12T20:00:15.136Z] 126850K .......... .......... .......... .......... .......... 98% 283M 0s
[task 2024-02-12T20:00:15.136Z] 126900K .......... .......... .......... .......... .......... 99% 367M 0s
[task 2024-02-12T20:00:15.136Z] 126950K .......... .......... .......... .......... .......... 99% 333M 0s
[task 2024-02-12T20:00:15.136Z] 127000K .......... .......... .......... .......... .......... 99% 320M 0s
[task 2024-02-12T20:00:15.137Z] 127050K .......... .......... .......... .......... .......... 99% 294M 0s
[task 2024-02-12T20:00:15.137Z] 127100K .......... .......... .......... .......... .......... 99% 319M 0s
[task 2024-02-12T20:00:15.137Z] 127150K .......... .......... .......... .......... .......... 99% 319M 0s
[task 2024-02-12T20:00:15.137Z] 127200K .......... .......... .......... .......... .......... 99% 307M 0s
[task 2024-02-12T20:00:15.137Z] 127250K .......... .......... .......... .......... .......... 99% 155M 0s
[task 2024-02-12T20:00:15.138Z] 127300K .......... .......... .......... .......... .......... 99% 279M 0s
[task 2024-02-12T20:00:15.138Z] 127350K .......... .......... .......... .......... .......... 99% 326M 0s
[task 2024-02-12T20:00:15.138Z] 127400K .......... .......... .......... .......... .......... 99% 75.6M 0s
[task 2024-02-12T20:00:15.139Z] 127450K .......... .......... .......... .......... .......... 99% 179M 0s
[task 2024-02-12T20:00:15.139Z] 127500K .......... .......... .......... .......... .......... 99% 305M 0s
[task 2024-02-12T20:00:15.139Z] 127550K .......... .......... .......... .......... .......... 99% 313M 0s
[task 2024-02-12T20:00:15.139Z] 127600K .......... .......... .......... .......... .......... 99% 306M 0s
[task 2024-02-12T20:00:15.139Z] 127650K .......... .......... .......... .......... .......... 99% 264M 0s
[task 2024-02-12T20:00:15.139Z] 127700K .......... .......... .......... .......... .......... 99% 288M 0s
[task 2024-02-12T20:00:15.140Z] 127750K .......... .......... .......... .......... .......... 99% 313M 0s
[task 2024-02-12T20:00:15.140Z] 127800K .......... .......... .......... .......... .......... 99% 307M 0s
[task 2024-02-12T20:00:15.140Z] 127850K .......... .......... .......... .......... .......... 99% 253M 0s
[task 2024-02-12T20:00:15.140Z] 127900K .......... .......... .......... .......... .......... 99% 311M 0s
[task 2024-02-12T20:00:15.140Z] 127950K .......... .......... .......... .......... .......... 99% 326M 0s
[task 2024-02-12T20:00:15.140Z] 128000K .......... .......... .......... .......... .......... 99% 305M 0s
[task 2024-02-12T20:00:15.141Z] 128050K .......... .......... .......... .......... .......... 99% 267M 0s
[task 2024-02-12T20:00:15.141Z] 128100K .......... .......... .......... .......... .......... 99% 338M 0s
[task 2024-02-12T20:00:15.141Z] 128150K .......... .......... .......... ......... 100% 306M=0.6s
[task 2024-02-12T20:00:15.141Z]
[task 2024-02-12T20:00:15.141Z] 2024-02-12 20:00:15 (195 MB/s) - ‘tools/lid.176.bin’ saved [131266198/131266198]
[task 2024-02-12T20:00:15.141Z]
[task 2024-02-12T20:00:15.142Z] + zstdmt -dc /builds/worker/artifacts/news_2008.ru.monofix.zst
[task 2024-02-12T20:00:15.142Z] + cut -f2
[task 2024-02-12T20:00:15.142Z] + grep -P '^ru\t'
[task 2024-02-12T20:00:15.143Z] + zstdmt
[task 2024-02-12T20:00:15.143Z] ++ echo 32/4
[task 2024-02-12T20:00:15.143Z] ++ bc
[task 2024-02-12T20:00:15.144Z] + parallel --no-notice --pipe -k -j 8 --block 50M 'python3 tools/langid_fasttext.py'
[task 2024-02-12T20:00:15.729Z] Warning : `load_model` does not return WordVectorModel or SupervisedModel any more, but a `FastText` object which is very similar.
[task 2024-02-12T20:00:15.746Z] + echo '### Rule-based filtering'
[task 2024-02-12T20:00:15.746Z] ### Rule-based filtering
[task 2024-02-12T20:00:15.746Z] + zstdmt -dc /builds/worker/artifacts/news_2008.ru.langid.zst
[task 2024-02-12T20:00:15.746Z] + parallel --no-notice --pipe -k -j 32 --block 50M 'python3 tools/clean_mono.py -l ru --debug'
[task 2024-02-12T20:00:15.746Z] + zstdmt
[task 2024-02-12T20:00:16.284Z] + test -s /builds/worker/artifacts/news_2008.ru.zst
[task 2024-02-12T20:00:16.284Z] + echo '### Remove data from intermediate steps'
[task 2024-02-12T20:00:16.284Z] ### Remove data from intermediate steps
[task 2024-02-12T20:00:16.284Z] + rm -rf /builds/worker/artifacts/news_2008.ru.nrm.zst /builds/worker/artifacts/news_2008.ru.langid.zst /builds/worker/artifacts/news_2008.ru.monofix.zst
[task 2024-02-12T20:00:16.286Z] + echo '### Rule-based cleaning log written to: /builds/worker/artifacts/news_2008.ru.clean.debug.txt'
[task 2024-02-12T20:00:16.286Z] ### Rule-based cleaning log written to: /builds/worker/artifacts/news_2008.ru.clean.debug.txt
[task 2024-02-12T20:00:16.286Z] + echo '### Clean data is written to: /builds/worker/artifacts/news_2008.ru.zst'
[task 2024-02-12T20:00:16.286Z] ### Clean data is written to: /builds/worker/artifacts/news_2008.ru.zst
[task 2024-02-12T20:00:16.286Z] + echo '###### Done: Cleaning monolingual data'
[task 2024-02-12T20:00:16.286Z] ###### Done: Cleaning monolingual data
[fetches 2024-02-12T20:00:16.286Z] removing /builds/worker/fetches
[fetches 2024-02-12T20:00:16.286Z] finished
[taskcluster 2024-02-12 20:00:17.792Z] === Task Finished ===
[taskcluster 2024-02-12 20:00:18.249Z] Successful task run with exit code: 0 completed in 6.378 seconds
Loading