You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Do we also want to handle recovery for this issue? Seems like this PR only persist the backfill state for cdc executor, but I'm not sure if that's sufficient.
In meta, we need to persist the table fragments and table proto as well. Otherwise they will be lost on recovery.
I take a look of #12167, since CREATE TABLE is always Foreground (it will return success after collect the initial barrier), so I think we don't need to recover its progress likes Background streaming job does.
I take a look of #12167, since CREATE TABLE is always Foreground (it will return success after collect the initial barrier), so I think we don't need to recover its progress likes Background streaming job does.
Ah got it. Makes sense to me.
StrikeW
changed the title
Persist the backfill state when the backfill task is finished
Persist the backfill state to record backfill progress
Nov 14, 2023
#12535 doesn’t persist the backfill state yet, it will backfill again during recovery.
The text was updated successfully, but these errors were encountered: