Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(ci): introduce meta backend agnostic e2e tests #19568

Merged
merged 16 commits into from
Nov 28, 2024

Conversation

BugenZhao
Copy link
Member

@BugenZhao BugenZhao commented Nov 26, 2024

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

See ideas in #19527.

Reimplement #19152 with the approach introduced in #19560.

  • Change meta-backend to env for ci-3streaming-2serving-3fe, so that we can use this single profile for running e2e tests against 3 backends.

  • Based on above, introduce a build matrix for all 3 backends and their endpoints to merge end-to-end tests against 3 backends in main-cron.

  • For pull-request, only MySQL and Postgres are included in the matrix since I still want to make it optional to run tests against them, which was triggered by PR label ci/run-e2e-test-other-backends.

Note that this PR does not introduce any new tests but only refactors existing pipelines.

For the future plan, personally I prefer keeping steps lightweight in pull-request, that is, maintain the status quo that only the basic and common (may also include the source one?) end-to-end tests are covered with PG/MySQL backends. For main-cron, we may extend the coverage as much as possible by simply adding 2 lines for every step.

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • All checks passed in ./risedev check (or alias, ./risedev c)

Documentation

  • My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note

If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

@BugenZhao BugenZhao changed the title refactor(ci): meta backend agnostic e2e tests refactor(ci): meta backend agnostic e2e tests [WIP] Nov 26, 2024
Copy link
Member Author

BugenZhao commented Nov 26, 2024

@BugenZhao BugenZhao force-pushed the bz/ci-adopt-env-sql-backend branch from d27d964 to 5a5255b Compare November 26, 2024 08:23
@BugenZhao BugenZhao force-pushed the bz/ci-adopt-env-sql-backend branch from a43d77e to 3a7df77 Compare November 26, 2024 15:49
@BugenZhao BugenZhao requested a review from a team as a code owner November 26, 2024 15:50
@BugenZhao BugenZhao requested review from xxchan and removed request for a team November 26, 2024 15:50
@BugenZhao BugenZhao force-pushed the bz/ci-adopt-env-sql-backend branch from 3a7df77 to c197fb8 Compare November 26, 2024 15:50
@BugenZhao BugenZhao changed the title refactor(ci): meta backend agnostic e2e tests [WIP] refactor(ci): meta backend agnostic e2e tests Nov 26, 2024
@BugenZhao BugenZhao changed the title refactor(ci): meta backend agnostic e2e tests refactor(ci): introduce meta backend agnostic e2e tests Nov 26, 2024
Base automatically changed from bz/junior-jackal to main November 26, 2024 17:22
@graphite-app graphite-app bot requested a review from a team November 26, 2024 17:22
@BugenZhao BugenZhao force-pushed the bz/ci-adopt-env-sql-backend branch from c197fb8 to f8e36b8 Compare November 27, 2024 03:59
@BugenZhao BugenZhao requested review from yezizp2012, fuyufjh and xxchan and removed request for xxchan and a team November 27, 2024 04:03
@BugenZhao BugenZhao force-pushed the bz/ci-adopt-env-sql-backend branch from a2f39c6 to 985cb45 Compare November 27, 2024 07:38
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
Signed-off-by: Bugen Zhao <[email protected]>
@BugenZhao BugenZhao force-pushed the bz/ci-adopt-env-sql-backend branch from 1299e28 to 6f02e68 Compare November 28, 2024 05:18
docker-compose-common: &docker-compose-common
config: ci/docker-compose.yml
mount-buildkite-agent: true
propagate-environment: true
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So that RISEDEV_SQL_ENDPOINT can be propagated into the container.

config: ci/docker-compose.yml
mount-buildkite-agent: true
<<: *docker-compose-common
run: pg-mysql-backend-test-env
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can override the entry in *docker-compose-common.

@BugenZhao BugenZhao enabled auto-merge November 28, 2024 05:20
@BugenZhao BugenZhao added this pull request to the merge queue Nov 28, 2024
Merged via the queue into main with commit 521f674 Nov 28, 2024
32 of 33 checks passed
@BugenZhao BugenZhao deleted the bz/ci-adopt-env-sql-backend branch November 28, 2024 05:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants