Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Don't tell pytest to try to kill the integration tests on failure #4371

Merged
merged 3 commits into from
May 21, 2024

Conversation

gtrepta
Copy link
Contributor

@gtrepta gtrepta commented May 21, 2024

There's a bug with pytest-xdist where using multiple runners doesn't properly terminate the test run when there's a failure and --maxfail=1 has been passed. Instead, the runner that ran the failed test exits and the remaining runners continue. What this results in on CI is the remaining runners are not able to finish the integration tests before the timeout for the job, killing pytest before it can finish and report the reason for the failed test.

This change removes the --maxfail option when running on CI, so when there's a test failure, all of the runners continue, so they should be able to finish before the timeout and pytest can properly finish and report the failure reason(s).

@gtrepta gtrepta marked this pull request as ready for review May 21, 2024 19:13
@gtrepta gtrepta requested a review from a team as a code owner May 21, 2024 19:13
@gtrepta gtrepta requested review from Baltoli and tothtamas28 May 21, 2024 19:14
Copy link
Contributor

@Baltoli Baltoli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice - I like that we keep fail-fast for local runs

@rv-jenkins rv-jenkins merged commit 498efb4 into develop May 21, 2024
17 checks passed
@rv-jenkins rv-jenkins deleted the ci/pyk-integration-logging branch May 21, 2024 21:02
@tothtamas28 tothtamas28 restored the ci/pyk-integration-logging branch May 22, 2024 08:40
@tothtamas28 tothtamas28 deleted the ci/pyk-integration-logging branch May 22, 2024 08:51
rv-jenkins added a commit that referenced this pull request May 22, 2024
Does the same as #4371, but without modifying code generated from the
Python project template.

---------

Co-authored-by: rv-jenkins <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants