Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor meta to commit catalogs only after first barrier #17501

Open
kwannoel opened this issue Jun 28, 2024 · 0 comments
Open

Refactor meta to commit catalogs only after first barrier #17501

kwannoel opened this issue Jun 28, 2024 · 0 comments
Assignees
@kwannoel
Labels
type/feature
Milestone
release-2.2

Comments

@kwannoel
Copy link
Contributor

kwannoel commented Jun 28, 2024 •
edited
Loading

  1. IF committed after first barrier, it means that the actors have been initialized.
  2. Things like alter rate limit can then take effect for an in progress stream job.
  3. Also it will fix the inconsistent behaviour of show jobs for background ddl. When barrier latency is high, background ddl still returns immediately, but is not visible in show jobs, until the first barrier is collected.
@kwannoel kwannoel self-assigned this Jun 28, 2024
@github-actions github-actions bot added this to the release-1.10 milestone Jun 28, 2024
@fuyufjh fuyufjh modified the milestones: release-1.10, release-1.11 Jul 10, 2024
@kwannoel kwannoel modified the milestones: release-2.0, release-2.1 Aug 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kwannoel kwannoel

Labels
type/feature
Projects
None yet
Milestone
release-2.2
Development

No branches or pull requests
2 participants
@fuyufjh @kwannoel