Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the weekly CI for running functionality regression testing of the latest released artifacts #2583

Open
1 of 4 tasks
zyy17 opened this issue Oct 12, 2023 · 0 comments
Open
1 of 4 tasks
Labels
C-enhancement Category Enhancements
Milestone

Comments

@zyy17
Copy link
Collaborator

zyy17 commented Oct 12, 2023

What type of enhancement is this?

Other

What does the enhancement do?

The greptimedb ecosystem is growing rapidly and may bring unexpected behaviors for downstream software, such as SDKs, greptimedb-operator, gtctl, etc. To resolve the problem, we need to add the weekly CI to run functionality regression testing based on the latest weekly release artifacts.

The test cases should cover most scenarios that are described in docs.

Implementation challenges

It's the big job of writing multiple test cases! I will create multiple tasks to track these issues, which may be growing:

  • Add the CI skeleton to run the functionality regression testing periodically. Each test case should be the standalone CI job;
  • Basic operations of binaries and images;
  • SDKs tests: ci: run sdk tests for weekly build #2579;
  • Deployment tests(K8s operator,helm charts, gtctl);
@zyy17 zyy17 added the C-enhancement Category Enhancements label Oct 12, 2023
@zyy17 zyy17 self-assigned this Oct 12, 2023
@zyy17 zyy17 added this to the v0.5 milestone Oct 12, 2023
@zyy17 zyy17 changed the title Add the functionality regression testing weekly CI for latest artifacts Add the weekly CI for running functionality regression testing of the latest released artifacts Oct 12, 2023
@fengjiachun fengjiachun modified the milestones: v0.5, v0.8 Feb 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-enhancement Category Enhancements
Projects
None yet
Development

No branches or pull requests

2 participants