You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Existing implementation of cdc backfill will start a new snapshot upon receiving a barrier message. And to ensure make progress of the backfill, we guarantee to consume and emit a snapshot chunk for each epoch, which could cause barrier piles up in some scenario for example the wide table use case.
As comparison, here is the metric that we alter the barrier interval to 5 mins instead of apply the patch #15684, the barrier doesn't pile up.
The text was updated successfully, but these errors were encountered:
Existing implementation of cdc backfill will start a new snapshot upon receiving a barrier message. And to ensure make progress of the backfill, we guarantee to consume and emit a snapshot chunk for each epoch, which could cause barrier piles up in some scenario for example the wide table use case.
As comparison, here is the metric that we alter the barrier interval to 5 mins instead of apply the patch #15684, the barrier doesn't pile up.
The text was updated successfully, but these errors were encountered: