Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

We found 2 flaky tests #70

Open
shaker-project opened this issue Nov 12, 2020 · 0 comments
Open

We found 2 flaky tests #70

shaker-project opened this issue Nov 12, 2020 · 0 comments

Comments

@shaker-project
Copy link

shaker-project commented Nov 12, 2020

Hello, we are a group of researchers that investigate the occurrence of flaky tests in Android.

We voluntarily ran your GUI tests 12 times and found that some tests pass or fail non-deterministically, which characterizes them as flaky tests [1]. Below we list each flaky test we found, and its number of failures.

We ran these tests on a generic Android Emulator (AVD) with Android API version 28.

If you confirm this behavior, our suggestion is to add the @FlakyTest annotation on these tests. See https://developer.android.com/reference/androidx/test/filters/FlakyTest

If you wish for a repair proposal, please let us know.

We also attached the stack trace of the failed executions.

[1] https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359

Graciously,
Denini, Leopoldo and Marcelo.

@shaker-project shaker-project changed the title We found 2 tests flaky We found 2 flaky tests Nov 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant