Releases: m-lab/etl-gardener
Add gardener configuration for ndt/hopannotation1
Add PCAP index and increase reprocessing rate in legacy pipeline
Embed a static git commit hash in the gardener binary (#324)
Separate integration tests (#326)
Add support for cloudbuild deployment (#327)
Add create script for parser-pool-16 with 16 CPUs and appropriate scopes (#333)
Increase reprocessing rate for legacy types (#334)
Add gardener configuration for PCAP datatype (#335)
Slow reprocessing queues used by legacy gardener
Add ndt7/annotation table join, and production of ndt.ndt7 "final" table.
This deployment results in creation of mlab-oti:ndt.ndt7 table. It will not initially be visible in measurement-lab, and there is currently no table or view of that name, so it will not impact users.
The new table will have the "server" and "client" annotation fields, and the schema should be in keeping with Standard Columns.
This also adjusts the number of traceroute queues, to reduce the rate that traceroute is reprocessed in the LEGACY system. Consequently, it is a full deployment, rather than a universal only deployment.
We also need to add the new table to the schema update system.
reduce to 4 traceroute queues (#312)
Join op (#313)
Add action to join with annotations (#314)
Add GCS file check before dispatching jobs.
Check whether job has any files before dispatching. (#311)
First deployment of universal gardener
Start processing "yesterday" data after 10:30 UTC
restore staging instances (#241) …
add state metrics (#243) …
Initialize start date and index (#245) …
Support more stats in universal (#244) …
Add skeleton code for general dedup queries (#246) …
Add configuration through configmap (#249) …
Refactor NextJob to client.NextJob (#250) …
remove kubectl describe (#251) …
Keep state history (#253) …
Cleanup delay (#257) …
Use config (#256) …
Bq ops (#262) …
Bq ops (#263) …
Use new bq ops in Monitor actions (#264) …
adds Filter field to Job, to allow partial processing (#265) …
migrate to go/cloud/bqx (#266) …
fix updatetime (#268) …
implement job filter (#269) …
Create etl-gardener-scamper-service (#275)
Custom error (#271) …
deploy to universal only on u-sandbox (#279) …
fix Retry handling (#282) …
Job Service persistence (#283) …
Support standard column datatypes: ndt7 & annotation (#284) …
Fix restarts (#285) …
use copy on write on status history updates (#286) …
add yesterday functionality (#287) …
Fixes job service persistence and adds logging (#290) …
allow restart of failed jobs (#292) …
Delay legacy daily (#296) …
Start processing "yesterday" data around 10:30 UTC (#299)
