Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(test): use rate limit instead in background ddl test #13179

Merged
merged 22 commits into from
Nov 1, 2023

Conversation

kwannoel
Copy link
Contributor

@kwannoel kwannoel commented Oct 31, 2023

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

Use rate limit instead. After #13144 , thanks to @wangrunji0408's help, we support rate limit in madsim. Then in cancel tests, it was failing, even with rate limit, because the MV finished creating too fast before it could be cancelled.

So now we just ingest more data when creating the background MV which will be recovered, then cancelled.

We can now remove the env var in no_shuffle_backfill.

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features Sqlsmith: Sql feature generation #7934).
  • My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
  • All checks passed in ./risedev check (or alias, ./risedev c)
  • My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)
  • My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

  • My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note

If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

@kwannoel kwannoel force-pushed the kwannoel/use-rate-limit branch from 526bec0 to fd18cd1 Compare October 31, 2023 11:02
@kwannoel kwannoel disabled auto-merge October 31, 2023 11:11
@kwannoel kwannoel enabled auto-merge October 31, 2023 11:23
@kwannoel kwannoel disabled auto-merge October 31, 2023 11:35
@kwannoel kwannoel changed the title fix(test): use rate limit instead in backgorund ddl test fix(test): use rate limit instead in background ddl test Oct 31, 2023
@@ -16,7 +16,6 @@ mv target/ci-sim target/sim
echo "--- Run integration tests in deterministic simulation mode"
seq $TEST_NUM | parallel MADSIM_TEST_SEED={} NEXTEST_PROFILE=ci-sim \
cargo nextest run \
--no-capture \
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kwannoel kwannoel enabled auto-merge October 31, 2023 11:46
@kwannoel kwannoel marked this pull request as draft October 31, 2023 13:35
auto-merge was automatically disabled October 31, 2023 13:35

Pull request was converted to draft

@kwannoel kwannoel force-pushed the kwannoel/use-rate-limit branch from 5fccb81 to ba06539 Compare October 31, 2023 14:30
@kwannoel kwannoel force-pushed the kwannoel/use-rate-limit branch from ba06539 to a3c50d1 Compare October 31, 2023 14:31
@kwannoel
Copy link
Contributor Author

kwannoel commented Oct 31, 2023

Screenshot 2023-10-31 at 11 33 00 PM

Seems like deterministic test failure is triggered by something else... It failed even when all background_ddl tests disabled at commit f966b06.

@kwannoel kwannoel marked this pull request as ready for review October 31, 2023 15:44
@kwannoel kwannoel enabled auto-merge October 31, 2023 15:44
@kwannoel kwannoel disabled auto-merge October 31, 2023 15:45
@kwannoel
Copy link
Contributor Author

Temporarily add 2 commits from #13178, so we can see if it resolves the failure.

Copy link

codecov bot commented Oct 31, 2023

Codecov Report

Merging #13179 (54567a1) into main (4302765) will increase coverage by 0.00%.
Report is 1 commits behind head on main.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main   #13179   +/-   ##
=======================================
  Coverage   68.15%   68.16%           
=======================================
  Files        1506     1506           
  Lines      255354   255354           
=======================================
+ Hits       174049   174061   +12     
+ Misses      81305    81293   -12     
Flag Coverage Δ
rust 68.16% <ø> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Coverage Δ
...tream/src/executor/backfill/no_shuffle_backfill.rs 0.00% <ø> (ø)
src/stream/src/executor/flow_control.rs 0.00% <ø> (ø)

... and 8 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@kwannoel kwannoel enabled auto-merge November 1, 2023 04:08
@kwannoel kwannoel added this pull request to the merge queue Nov 1, 2023
Merged via the queue into main with commit 7122d6c Nov 1, 2023
6 of 7 checks passed
@kwannoel kwannoel deleted the kwannoel/use-rate-limit branch November 1, 2023 04:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants