v0.21.0

What's Changed

• ignore tables in raw table if no schema known for table by @serprex in #2317
• [clickhouse] optional enforcement of SMT tables by @heavycrystal in #2313
• nexus: support uuid arrays by @serprex in #2316
• qvalue: UUID array type by @serprex in #2327
• [cdc] better manual handling of partitioned tables by @heavycrystal in #2323
• tags: don't log when no tags by @serprex in #2330
• e2e test CustomSyncs by @serprex in #2333
• ch: implement GetTableSchemaConnector by @serprex in #2337
• [clickhouse] test types test by @heavycrystal in #2185
• add throttling when there is a syncErr by @iskakaushik in #2356
• Handle syncing UUID arrays into BQ by @lukejudd-lux in #2358
• feat: upgrade docker-compose.yml stable image tags by @github-actions in #2360
• [clickhouse] start moving validation to shared for reuse by @heavycrystal in #2348
• BQ: fix create/replace logic for resync by @Amogh-Bharadwaj in #2314
• move normalize into sync activity by @serprex in #2329
• [temporal] adjust threshold for workflows to ContinueAsNew by @heavycrystal in #2328
• [cdc] treat all pkms as reply_requested by @heavycrystal in #2353
• [validate] run IDENTIFY_SYSTEM on replication conn by @heavycrystal in #2373
• remove table name schema migration by @serprex in #2375
• TSTZRange: Account for infinity modifier by @Amogh-Bharadwaj in #2377
• Current LSN : Account for NULL LSN value being returned by @Amogh-Bharadwaj in #2372
• [cdc] always initialize childToParentRelIDMapping by @heavycrystal in #2369
• generic e2e test for partitioned tables by @heavycrystal in #2383

New Contributors

• @lukejudd-lux made their first contribution in #2358

Full Changelog: v0.20.1...v0.21.0

v0.20.2

What's Changed

• ignore tables in raw table if no schema known for table by @serprex in #2317
• [clickhouse] optional enforcement of SMT tables by @heavycrystal in #2313
• nexus: support uuid arrays by @serprex in #2316
• qvalue: UUID array type by @serprex in #2327
• [cdc] better manual handling of partitioned tables by @heavycrystal in #2323
• tags: don't log when no tags by @serprex in #2330
• e2e test CustomSyncs by @serprex in #2333
• nexus: need to kms decrypt PEERDB_ENC_KEYS by @serprex in #2325
• feat: upgrade docker-compose.yml stable image tags by @github-actions in #2336
• ch: implement GetTableSchemaConnector by @serprex in #2337
• chore(deps): pin dependencies by @renovate in #2339
• fix(deps): update cargo dependencies by @renovate in #2340
• chore(deps): update postgres:17-alpine docker digest to ccfa992 by @renovate in #2338
• chore(deps): update dockerfile dependencies by @renovate in #2342
• renovate: hold back react by @serprex in #2344
• renovate: also ignore react siblings by @serprex in #2345
• fix(deps): update npm dependencies by @renovate in #2343
• fix ui ci by @serprex in #2346
• replace broken redpanda gh action with gh service entry by @serprex in #2347
• update go dependencies by @serprex in #2349
• [clickhouse] test types test by @heavycrystal in #2185

Full Changelog: v0.20.1...v0.20.2

v0.20.1

What's Changed

• ClickHouse: Put numeric-string mapping behind feature flag by @Amogh-Bharadwaj in #2305
• remove/refactor functions from shared by @heavycrystal in #2307
• Feat/workflow for docker compose image tags by @iamKunalGupta in #2319
• fix: docker compose image tag workflow by @iamKunalGupta in #2322
• feat: upgrade docker-compose.yml stable image tags by @github-actions in #2321

New Contributors

• @github-actions made their first contribution in #2321

Full Changelog: v0.20.0...v0.20.1

v0.20.0

What's Changed

• Clickhouse: add select consistency by @Amogh-Bharadwaj in #2300
• ClickHouse Cloud Private Preview by @iskakaushik in #2288
• otel: fetched bytes by @serprex in #2276
• lift DeploymentUidKey attribute to newOtelResource by @serprex in #2296
• Add tags for Flows along with routes to set and get by @iskakaushik in #2297

Full Changelog: v0.19.3...v0.20.0

v0.19.3

What's Changed

• chore: update dependencies by @serprex in #2216
• Create renovate.json by @iamKunalGupta in #2222
• avoid dividing by zero when calculating page by @serprex in #2228
• fix: temporal admin tools image version by @iamKunalGupta in #2230
• Implement table rename with atomic exchange by @martin31821 in #2229
• nexus: EXECUTE peer($$query$$) by @serprex in #2232
• EXCHANGE: quote table names by @heavycrystal in #2233
• quote table names for drop,fallback rename by @heavycrystal in #2235
• quote table names by @iskakaushik in #2234
• chore(deps): pin dependencies by @renovate in #2245
• ClickHouse: Normalize one batch at a time by @Amogh-Bharadwaj in #2219
• Revert "ClickHouse: Normalize one batch at a time" by @heavycrystal in #2249
• cleanup error handling, fixes 2 bugs by @serprex in #2250
• ci: replace s3 with minio by @serprex in #2241
• e2e: resync weird names by @serprex in #2237
• fix(deps): update cargo dependencies by @renovate in #2242
• nexus: ssh by @serprex in #2231
• chore(deps): pin dependencies by @renovate in #2244
• Fix resync logic for postgres to postgres by @Amogh-Bharadwaj in #2240
• [clickhouse] change raw table definition to use int64 for _peerdb_batch_id by @heavycrystal in #2248
• [postgres] reduce unnecessary queries by @heavycrystal in #2214
• add dynamic config to adjust s3 part size by @serprex in #2251
• update s3 part size config description by @serprex in #2252
• fix lint by @serprex in #2253
• Enable wal heartbeats by default by @serprex in #2217
• feat: add maintenance mode for upgrades by @iamKunalGupta in #2211
• PEERDB_CLICKHOUSE_MAX_INSERT_THREADS by @serprex in #2255
• PEERDB_CLICKHOUSE_PARALLEL_NORMALIZE by @serprex in #2256
• use disconnected ctx to ensure snapshot connection drops by @heavycrystal in #2258
• Update end time for batches where end time is not set by @iskakaushik in #2260
• cdc graph: fix filtering not including flow_name by @serprex in #2261
• Postgres to Postgres: Introduce support for more types by @Amogh-Bharadwaj in #2238
• QRep Overwrite Mode: introduce full refresh code path by @Amogh-Bharadwaj in #2239
• fix(deps): update cargo dependencies by @renovate in #2266
• refactor: reduce default batch and partition sizes for improved stability by @iskakaushik in #2262
• chore(deps): update dockerfile dependencies by @renovate in #2265
• chore(deps): update docker-compose dependencies by @renovate in #2264
• chore: replace debezium in ci and test on multiple pg versions by @iamKunalGupta in #2269
• chore(deps): pin dependencies by @renovate in #2267
• feat: use latest-stable in docker-compose.yml by @iamKunalGupta in #2270
• fix(deps): update npm dependencies by @renovate in #2268
• Replace SyncGauge with upstream otel sdk gauges by @serprex in #2272
• Introduce Completed flow status by @Amogh-Bharadwaj in #2274
• Optimise state setting for initial load only by @Amogh-Bharadwaj in #2275
• Remove PEERDB_MAX_SYNCS_PER_CDC_FLOW by @serprex in #2273
• chore(deps): pin dependencies by @renovate in #2277
• fix: latest-stable tag in docker compose by @iamKunalGupta in #2279
• Miscellaneous fixes - add more alerting for maintainpull, fix lag graph function by @Amogh-Bharadwaj in #2263
• Revamp settings page by @Amogh-Bharadwaj in #2280
• [dropflow] delete flow configs only after finish drop by @heavycrystal in #2281
• CH Normalize: fix error return by @Amogh-Bharadwaj in #2282
• Fix slot guage by @Amogh-Bharadwaj in #2283
• add cause for context in ch normalize errgroup by @iskakaushik in #2285
• Tag network errors as err:Net by @iskakaushik in #2287

New Contributors

• @martin31821 made their first contribution in #2229
• @renovate made their first contribution in #2245

Full Changelog: v0.19.0...v0.19.3

v0.19.2

What's Changed

• PEERDB_CLICKHOUSE_MAX_INSERT_THREADS by @serprex in #2255
• PEERDB_CLICKHOUSE_PARALLEL_NORMALIZE by @serprex in #2256
• use disconnected ctx to ensure snapshot connection drops by @heavycrystal in #2258
• Update end time for batches where end time is not set by @iskakaushik in #2260
• cdc graph: fix filtering not including flow_name by @serprex in #2261
• Postgres to Postgres: Introduce support for more types by @Amogh-Bharadwaj in #2238
• QRep Overwrite Mode: introduce full refresh code path by @Amogh-Bharadwaj in #2239
• fix(deps): update cargo dependencies by @renovate in #2266
• refactor: reduce default batch and partition sizes for improved stability by @iskakaushik in #2262
• chore(deps): update dockerfile dependencies by @renovate in #2265
• chore(deps): update docker-compose dependencies by @renovate in #2264
• chore: replace debezium in ci and test on multiple pg versions by @iamKunalGupta in #2269
• chore(deps): pin dependencies by @renovate in #2267
• feat: use latest-stable in docker-compose.yml by @iamKunalGupta in #2270
• fix(deps): update npm dependencies by @renovate in #2268
• Replace SyncGauge with upstream otel sdk gauges by @serprex in #2272
• Introduce Completed flow status by @Amogh-Bharadwaj in #2274
• Optimise state setting for initial load only by @Amogh-Bharadwaj in #2275
• Remove PEERDB_MAX_SYNCS_PER_CDC_FLOW by @serprex in #2273
• chore(deps): pin dependencies by @renovate in #2277
• fix: latest-stable tag in docker compose by @iamKunalGupta in #2279

Full Changelog: v0.19.1...v0.19.2

v0.19.1

What's Changed

• chore: update dependencies by @serprex in #2216
• Create renovate.json by @iamKunalGupta in #2222
• avoid dividing by zero when calculating page by @serprex in #2228
• fix: temporal admin tools image version by @iamKunalGupta in #2230
• Implement table rename with atomic exchange by @martin31821 in #2229
• nexus: EXECUTE peer($$query$$) by @serprex in #2232
• EXCHANGE: quote table names by @heavycrystal in #2233
• quote table names for drop,fallback rename by @heavycrystal in #2235
• quote table names by @iskakaushik in #2234
• chore(deps): pin dependencies by @renovate in #2245
• ClickHouse: Normalize one batch at a time by @Amogh-Bharadwaj in #2219
• Revert "ClickHouse: Normalize one batch at a time" by @heavycrystal in #2249
• cleanup error handling, fixes 2 bugs by @serprex in #2250
• ci: replace s3 with minio by @serprex in #2241
• e2e: resync weird names by @serprex in #2237
• fix(deps): update cargo dependencies by @renovate in #2242
• nexus: ssh by @serprex in #2231
• chore(deps): pin dependencies by @renovate in #2244
• Fix resync logic for postgres to postgres by @Amogh-Bharadwaj in #2240
• [clickhouse] change raw table definition to use int64 for _peerdb_batch_id by @heavycrystal in #2248
• [postgres] reduce unnecessary queries by @heavycrystal in #2214
• add dynamic config to adjust s3 part size by @serprex in #2251
• update s3 part size config description by @serprex in #2252
• fix lint by @serprex in #2253
• Enable wal heartbeats by default by @serprex in #2217
• feat: add maintenance mode for upgrades by @iamKunalGupta in #2211

New Contributors

• @martin31821 made their first contribution in #2229
• @renovate made their first contribution in #2245

Full Changelog: v0.19.0...v0.19.1

v0.19.0

What's Changed

• feat(temporal): enable sdk metrics by @iamKunalGupta in #2200
• refactor: update temporal metrics list env by @iamKunalGupta in #2204
• reduce setup srcconn spam and hushWarn for message types by @heavycrystal in #2205
• feat: add request logging interceptor for API by @iamKunalGupta in #2203
• improve logs pagination by @serprex in #2202
• drop flow refactor by @heavycrystal in #2208
• [clickhouse] handle numerics with >76 precision as string by @heavycrystal in #2209
• Remove s3 path from mirror log based on ClickPipes feedback by @serprex in #2212
• Sync batch pagination by @serprex in #2207

Full Changelog: v0.18.8...v0.19.0

v0.18.9

What's Changed

• feat(temporal): enable sdk metrics by @iamKunalGupta in #2200 and #2204
• reduce setup srcconn spam and hushWarn for message types by @heavycrystal in #2205
• feat: add request logging interceptor for API by @iamKunalGupta in #2203
• improve logs pagination by @serprex in #2202
• drop flow refactor by @heavycrystal in #2208
• [clickhouse] handle numerics with >76 precision as string by @heavycrystal in #2209

Full Changelog: v0.18.8...v0.18.9

v0.18.8

What's Changed

• improve error logging for query execution by @iskakaushik in #150
• revert limit 0 by @iskakaushik in #152
• set allow_nullable_key = 1 when PEERDB_NULLABLE true by @serprex in #2191
• call connectors.CloseConnector when creating GetVersionConnector by @serprex in #2194
• chore: update dependencies by @serprex in #2193
• ClickHouse: Quote table name in insertions by @Amogh-Bharadwaj in #2197
• Alerts: tag context.Canceled / io.EOF / net.ErrClosed by @serprex in #2196
• lag graph: always show precise time in tooltip by @serprex in #2198
• validation: list missing tables from publication by @serprex in #2195
• slot lag graph: also have lsn graph by @serprex in #2199
• Fix sorting key ui pick order by @Amogh-Bharadwaj in #2201

Full Changelog: v0.18.7...v0.18.8