You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
kwannoel
changed the title
Parallelize state completion for arrangement backfill
Parallelize backfill: Make backfill vnode level within each partition
Mar 15, 2024
This issue has been open for 60 days with no activity.
If you think it is still relevant today, and needs to be done in the near future, you can comment to update the status, or just manually remove the no-issue-activity label.
You can also confidently close this issue as not planned to keep our backlog clean.
Don't worry if you think the issue is still valuable to continue in the future.
It's searchable and can be reopened when it's time. 😄
We can read from storage at a vnode level, and spawn different threads for each vnode to handle backfilling.
This increases the concurrency of backfilling, and for finished vnode partitions, we no longer have to re-read s3 again.
The text was updated successfully, but these errors were encountered: