Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support scaling in sql backend #14757

Merged
merged 7 commits into from
Feb 1, 2024
Merged

feat: support scaling in sql backend #14757

merged 7 commits into from
Feb 1, 2024

Conversation

shanicky
Copy link
Contributor

@shanicky shanicky commented Jan 23, 2024

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

It supports low-level operations but doesn't yet support automatic scaling (lacking the field for table parallelism).

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • All checks passed in ./risedev check (or alias, ./risedev c)

@shanicky shanicky marked this pull request as ready for review January 23, 2024 16:13
@shanicky shanicky force-pushed the peng/scale-model-v2 branch from 22d8d98 to 40b99a0 Compare January 23, 2024 16:13
@shanicky shanicky requested a review from yezizp2012 January 23, 2024 16:14
@@ -124,6 +124,7 @@ pub async fn rpc_serve(
Some(backend) => {
let mut options = sea_orm::ConnectOptions::new(backend.endpoint);
options
.sqlx_logging(false)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here will be reverted before the PR is merged.

@shanicky shanicky force-pushed the peng/scale-model-v2 branch 3 times, most recently from f7b0afb to d5c06d1 Compare January 30, 2024 11:09
@shanicky shanicky force-pushed the peng/scale-model-v2 branch from 0cb5d21 to ec1b8aa Compare January 31, 2024 07:15
Copy link
Member

@yezizp2012 yezizp2012 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx for the job, generally LGTM. We need to rely on some tests to help us discover some corner cases, as well as take advantage of the benefits of the SQL backend to make necessary optimizations. We can merge it now and do it in later PRs.

src/meta/src/controller/fragment.rs Outdated Show resolved Hide resolved
src/meta/src/controller/streaming_job.rs Outdated Show resolved Hide resolved
src/meta/src/controller/streaming_job.rs Outdated Show resolved Hide resolved
@shanicky shanicky enabled auto-merge January 31, 2024 13:43
@shanicky shanicky disabled auto-merge January 31, 2024 14:04
@shanicky shanicky enabled auto-merge January 31, 2024 14:06
auto-merge was automatically disabled January 31, 2024 23:49

Merge queue setting changed

@shanicky shanicky added this pull request to the merge queue Feb 1, 2024
Merged via the queue into main with commit 3276239 Feb 1, 2024
20 of 29 checks passed
@shanicky shanicky deleted the peng/scale-model-v2 branch February 1, 2024 06:44
github-actions bot pushed a commit that referenced this pull request Feb 1, 2024
shanicky added a commit that referenced this pull request Feb 1, 2024
Signed-off-by: Shanicky Chen <[email protected]>
Co-authored-by: Shanicky Chen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants