Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update integration test failure issues with more details #5122

Closed
gaiksaya opened this issue Oct 21, 2024 · 1 comment · Fixed by #5142
Closed

Update integration test failure issues with more details #5122

gaiksaya opened this issue Oct 21, 2024 · 1 comment · Fixed by #5142
Assignees
Labels
enhancement New Enhancement

Comments

@gaiksaya
Copy link
Member

gaiksaya commented Oct 21, 2024

Is your feature request related to a problem? Please describe

With opensearch-project/opensearch-metrics#68 going in, we can now know exact failing tests/classes for a given component.

This is what the current integration failure issue looks like: opensearch-project/security#4816

Describe the solution you'd like

Add more details to the table mentioning below details:

  • RC number (if applicable)
  • Build number which was used to run the integration test
  • Exact failing tests (classes and names) visualization
  • Tag release owner if one is assigned for given release issue

Describe alternatives you've considered

No response

Additional context

No response

@gaiksaya gaiksaya added enhancement New Enhancement untriaged Issues that have not yet been triaged labels Oct 21, 2024
@gaiksaya gaiksaya removed the untriaged Issues that have not yet been triaged label Oct 22, 2024
@gaiksaya gaiksaya self-assigned this Oct 22, 2024
@gaiksaya gaiksaya moved this from 🆕 New to 🏗 In progress in Engineering Effectiveness Board Oct 22, 2024
@gaiksaya
Copy link
Member Author

After discussing it with @prudhvigodithi we decided to post visualization dashboard with exact version and component, It should give detail list of all the tests failing for given component. Problem with adding failing test cases in the GH issue is, it will be too much information. (Example, index-management has 132 test cases failing for with security for 2.18.0.) The test-report.yml that is attached in the issue already has the same data mentioned. Since the intention of the integration-test failure GitHub issue is to give an overview of the failure, the mentioned visualization should do the job.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New Enhancement
Projects
Status: ✅ Done
Development

Successfully merging a pull request may close this issue.

1 participant