-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: fix flaky test in org.apache.helix.rest.server.TestResourceAccessor #3
base: master
Are you sure you want to change the base?
fix: fix flaky test in org.apache.helix.rest.server.TestResourceAccessor #3
Conversation
346afa2
to
3216a09
Compare
The fix looks good to me. But I guess you can add few more details to the PR description like linking which test is fixed and may be images. Good Work! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
General comments on your PR description summary-
- Spelling error for 'flaky' - 'flack'
- Give more context about NonDex tool and flaky tests in general
- Point the developers to relevant resources (java docs) to understand that HashMap order is not guaranteed.
- Explain that AssertEquals checks ordering as well
- I don't think you would need to include 'mvn test' command output as the developers would have automated pipelines to check it.
helix-rest/src/test/java/org/apache/helix/rest/server/TestResourceAccessor.java
Outdated
Show resolved
Hide resolved
helix-rest/src/test/java/org/apache/helix/rest/server/TestResourceAccessor.java
Outdated
Show resolved
Hide resolved
@219sansim thanks for the great feedback! |
e1050de
to
3517468
Compare
helix-rest/src/test/java/org/apache/helix/rest/server/TestResourceAccessor.java
Show resolved
Hide resolved
helix-rest/src/test/java/org/apache/helix/rest/server/TestResourceAccessor.java
Outdated
Show resolved
Hide resolved
in org.apache.helix.rest.server. TestResourceAccessor#testGetResources
b8f5c20
to
a5d25cf
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
You can consider if it makes sense to combine some of your PRs for helix into a larger one. You can proceed to open a real PR. Once you open a real PR, please mark this tentative PR as |
Issues
Fixes apache#2643
Description
This fix changes the flaky assertions of the tests in the class org.apache.helix.rest.server.TestResourceAccessor.
Sets return the elements in a non-deterministic order which means that this assertion is not correct, because it checks whether the collections contain the same elements in the same order. (This was changed in the library.)This leads to a flaky test. To fix this problem, the assertion has been rewritten to check if the collections contain the same amount of elements as well as both collections contain all values of the other collection.
The flaky test has been found by using the NonDex tool – to reproduce run
Tests
There have been no tests added, one test condition was changed.
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:54 min
[INFO] Finished at: 2023-10-04T22:44:58-05:00