Skip to content

chore: flaky e2e #11018

chore: flaky e2e

chore: flaky e2e #11018

Triggered via pull request December 17, 2024 08:23
Status Success
Total duration 38m 42s
Artifacts 19

e2e.yml

on: pull_request
Cypress / Component Testing
4m 32s
Cypress / Component Testing
Matrix: playwright
Playwright E2E Tests matrix result
0s
Playwright E2E Tests matrix result
Fit to window
Zoom out
Zoom in

Annotations

3 errors, 58 warnings, and 36 notices
[webkit] › tests/core/hint/hint.pw.spec.ts:71:13 › TuiHint › true mode hint with delay: projects/demo-playwright/tests/core/hint/hint.pw.spec.ts#L90
1) [webkit] › tests/core/hint/hint.pw.spec.ts:71:13 › TuiHint › true mode hint with delay ──────── Error: expect(page).toHaveScreenshot(expected) 84957 pixels (ratio 0.15 of all image pixels) are different. Expected: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/snapshots/tests/core/hint/hint.pw.spec.ts-snapshots/03-hint-mode-true-tuiHintShowDelay-1000-wait-500-webkit-darwin.png Received: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-hint-hint.pw-TuiHint-true-mode-hint-with-delay-webkit/03-hint-mode-true-tuiHintShowDelay-1000-wait-500-actual.png Diff: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-hint-hint.pw-TuiHint-true-mode-hint-with-delay-webkit/03-hint-mode-true-tuiHintShowDelay-1000-wait-500-diff.png Call log: - expect.toHaveScreenshot(03-hint-mode-true-tuiHintShowDelay-1000-wait-500.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 84957 pixels (ratio 0.15 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 84957 pixels (ratio 0.15 of all image pixels) are different. 88 | await page.waitForTimeout(500); 89 | > 90 | await expect(page).toHaveScreenshot( | ^ 91 | `03-hint-mode-${mode}-tuiHintShowDelay-1000-wait-500.png`, 92 | ); 93 | at /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/core/hint/hint.pw.spec.ts:90:32
[webkit] › tests/core/data-list/data-list.pw.spec.ts:176:9 › DataList › Options with long text: projects/demo-playwright/tests/core/data-list/data-list.pw.spec.ts#L187
1) [webkit] › tests/core/data-list/data-list.pw.spec.ts:176:9 › DataList › Options with long text Error: Timed out 5000ms waiting for expect(page).toHaveScreenshot(expected) Failed to take two consecutive stable screenshots. Previous: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-data-list-data--8393e-List-Options-with-long-text-webkit/10-data-list-previous.png Received: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-data-list-data--8393e-List-Options-with-long-text-webkit/10-data-list-actual.png Diff: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-data-list-data--8393e-List-Options-with-long-text-webkit/10-data-list-diff.png Call log: - expect.toHaveScreenshot(10-data-list.png) with timeout 5000ms - generating new stable screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 11810 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - Timeout 5000ms exceeded. 185 | await documentationPagePO.prepareBeforeScreenshot(); 186 | > 187 | await expect(page).toHaveScreenshot('10-data-list.png'); | ^ 188 | }); 189 | }); 190 | at /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/core/data-list/data-list.pw.spec.ts:187:28
[webkit] › tests/legacy/input-range/input-range.pw.spec.ts:52:13 › InputRange › Keyboard interactions › pressing Arrow Up increases LEFT value when LEFT text input is focused: projects/demo-playwright/tests/legacy/input-range/input-range.pw.spec.ts#L62
1) [webkit] › tests/legacy/input-range/input-range.pw.spec.ts:52:13 › InputRange › Keyboard interactions › pressing Arrow Up increases LEFT value when LEFT text input is focused Error: Timed out 5000ms waiting for expect(locator).toHaveScreenshot(expected) Locator: locator('#demo-content') Timeout 5000ms exceeded. Call log: - expect.toHaveScreenshot(06-input-range.png) with timeout 5000ms - generating new stable screenshot expectation - waiting for locator('#demo-content') - locator resolved to <div id="demo-content" _ngcontent-ng-c2476019924="">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - waiting 100ms before taking screenshot - waiting for locator('#demo-content') - Timeout 5000ms exceeded. 60 | await page.keyboard.down('ArrowUp'); 61 | > 62 | await expect(example).toHaveScreenshot('06-input-range.png'); | ^ 63 | }); 64 | 65 | test('pressing Arrow Up increases RIGHT value when RIGHT text input is focused', async ({ at /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/legacy/input-range/input-range.pw.spec.ts:62:35
Build demo
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Cypress / Component Testing
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 8 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 2 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 7 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 1 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 4 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 9 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 6 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / ubuntu-latest / 5 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / macos-latest / 1 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 1 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 1 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 1 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 1 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 2 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 2 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 2 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 2 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 2 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 4 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 4 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 4 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 4 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 4 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / ubuntu-latest / 3 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Playwright / macos-latest / 6 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 6 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 6 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 6 of 9
jpeg-turbo 3.1.0 is already installed and up-to-date. To reinstall 3.1.0, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 6 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 5 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 5 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 5 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 5 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 5 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 7 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 7 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 7 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 7 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 7 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 9 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 9 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 9 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 9 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 9 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 8 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 8 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 8 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 8 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 8 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright / macos-latest / 3 of 9
pkgconf 2.3.0_1 is already installed and up-to-date. To reinstall 2.3.0_1, run: brew reinstall pkgconf
Playwright / macos-latest / 3 of 9
cairo 1.18.2 is already installed and up-to-date. To reinstall 1.18.2, run: brew reinstall cairo
Playwright / macos-latest / 3 of 9
libpng 1.6.44 is already installed and up-to-date. To reinstall 1.6.44, run: brew reinstall libpng
Playwright / macos-latest / 3 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date. To reinstall 3.0.4, run: brew reinstall jpeg-turbo
Playwright / macos-latest / 3 of 9
giflib 5.2.2 is already installed and up-to-date. To reinstall 5.2.2, run: brew reinstall giflib
Playwright E2E Tests matrix result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
E2E result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
🎭 Playwright Run Summary
109 passed (1.3m)
🎭 Playwright Run Summary
109 passed (1.5m)
🎭 Playwright Run Summary
110 passed (1.8m)
🎭 Playwright Run Summary
110 passed (1.6m)
🎭 Playwright Run Summary
109 passed (1.8m)
🎭 Playwright Run Summary
109 passed (1.6m)
🎭 Playwright Run Summary
110 passed (1.3m)
🎭 Playwright Run Summary
110 passed (1.4m)
🎭 Playwright Run Summary
110 passed (2.1m)
🎭 Playwright Run Summary
110 passed (1.9m)
🎭 Playwright Run Summary
109 passed (1.6m)
🎭 Playwright Run Summary
109 passed (1.7m)
🎭 Playwright Run Summary
109 passed (2.0m)
🎭 Playwright Run Summary
109 passed (1.7m)
🎭 Playwright Run Summary
110 passed (2.5m)
🎭 Playwright Run Summary
110 passed (2.8m)
🎭 Playwright Run Summary
8 skipped 102 passed (1.3m)
🎭 Playwright Run Summary
8 skipped 102 passed (1.5m)
🎭 Playwright Run Summary
1 flaky [webkit] › tests/core/hint/hint.pw.spec.ts:71:13 › TuiHint › true mode hint with delay ───────── 44 skipped 65 passed (1.6m)
🎭 Playwright Run Summary
1 flaky [webkit] › tests/core/data-list/data-list.pw.spec.ts:176:9 › DataList › Options with long text ─ 44 skipped 65 passed (2.0m)
🎭 Playwright Run Summary
110 passed (3.3m)
🎭 Playwright Run Summary
110 passed (2.7m)
🎭 Playwright Run Summary
110 passed (7.0m)
🎭 Playwright Run Summary
110 passed (8.5m)
🎭 Playwright Run Summary
18 skipped 91 passed (2.3m)
🎭 Playwright Run Summary
18 skipped 91 passed (2.3m)
🎭 Playwright Run Summary
110 passed (4.5m)
🎭 Playwright Run Summary
110 passed (4.0m)
🎭 Playwright Run Summary
5 skipped 104 passed (2.7m)
🎭 Playwright Run Summary
5 skipped 104 passed (2.1m)
🎭 Playwright Run Summary
10 skipped 99 passed (1.9m)
🎭 Playwright Run Summary
10 skipped 99 passed (1.5m)
🎭 Playwright Run Summary
1 flaky [webkit] › tests/legacy/input-range/input-range.pw.spec.ts:52:13 › InputRange › Keyboard interactions › pressing Arrow Up increases LEFT value when LEFT text input is focused 108 passed (2.3m)
🎭 Playwright Run Summary
109 passed (2.5m)
🎭 Playwright Run Summary
110 passed (13.9m)
🎭 Playwright Run Summary
110 passed (10.0m)

Artifacts

Produced during runtime
Name Size
cy_baseline_d3cc323d448ea8cf2c2976d1dd205af4836a7a84 Expired
113 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_1 Expired
259 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_2 Expired
301 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_3 Expired
1.46 MB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_4 Expired
530 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_5 Expired
829 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_6 Expired
432 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_7 Expired
351 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_8 Expired
361 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_9 Expired
386 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_1 Expired
232 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_2 Expired
528 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_3 Expired
1.42 MB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_4 Expired
528 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_5 Expired
797 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_6 Expired
392 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_7 Expired
310 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_8 Expired
336 KB
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_9 Expired
309 KB