HPCC-29657 Produce aggregate stats (e.g. spill, cost) whilst a job is running #6255

Job	Run time
Check Skip	10s
Build Docker (ubuntu-23.04, pull_request)	44m 31s
Build Docker (ubuntu-22.04, k8s, true, schedule)	16s
Build Docker (ubuntu-22.04, schedule)	1m 11s
Build Bare Metal (ubuntu-20.04, mono, sudo, -DCMAKE_BUILD_TYPE=RelWithDebInfo -DINCLUDE_PLUGINS=O...	4s
Build Bare Metal (ubuntu-22.04, mono, sudo, -DCMAKE_BUILD_TYPE=RelWithDebInfo -DINCLUDE_PLUGINS=O...	42m 42s
Build Docker (ubuntu-20.04, schedule)	1m 23s
Build Bare Metal (windows-2019, -T host=x64 -A x64 -DUSE_OPTIONAL=OFF -DCLIENTTOOLS_ONLY=ON -DUSE...	4s
Build Docker (centos-8, schedule)	59s
Build Bare Metal (windows-2022, -T host=x64 -A x64 -DUSE_OPTIONAL=OFF -DCLIENTTOOLS_ONLY=ON -DUSE...	23m 0s
Build Bare Metal (macos-11, mono, sudo, -DCMAKE_BUILD_TYPE=Release -DUSE_OPTIONAL=OFF -DCLIENTTOO...	4s
Build Docker (centos-7, pull_request)	47m 56s
Build Bare Metal (macos-12, mono, sudo, -DCMAKE_BUILD_TYPE=Release -DUSE_OPTIONAL=OFF -DCLIENTTOO...	19m 15s
Build Docker (amazonlinux, schedule)	1m 18s
Build Docker (centos-7, LN, true, schedule)	54s
	3h 3m 47s

Provide feedback