You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Verdicts_sameOrder, Verdicts_randomOrder of the tests-overview
This is bad, because it makes the resulting CSV output non-deterministic, since the sets have non-deterministic order between different Python executions.
Originally it was used to filter out duplicate result entries (the same test is reported multiple times in the same run), which actually occurs in certain junit-xml files.
Solution: keep the duplicated-dropping set operation, but wrap it in sorted to convert it back to a list.
Watch out for the following also needed adjustments:
Following columns contain sets as values:
Passed_sameOrder
,Failed_sameOrder
, ...) of the passed-failed overviewVerdicts_sameOrder
,Verdicts_randomOrder
of the tests-overviewThis is bad, because it makes the resulting CSV output non-deterministic, since the sets have non-deterministic order between different Python executions.
Originally it was used to filter out duplicate result entries (the same test is reported multiple times in the same run), which actually occurs in certain junit-xml files.
Solution: keep the duplicated-dropping set operation, but wrap it in
sorted
to convert it back to a list.Watch out for the following also needed adjustments:
The text was updated successfully, but these errors were encountered: