chore: flaky e2e #11018
e2e.yml
on: pull_request
Build demo
1m 1s
Cypress / Component Testing
4m 32s
Matrix: playwright
E2E result
1m 19s
Playwright E2E Tests matrix result
0s
Annotations
3 errors, 58 warnings, and 36 notices
[webkit] › tests/core/hint/hint.pw.spec.ts:71:13 › TuiHint › true mode hint with delay:
projects/demo-playwright/tests/core/hint/hint.pw.spec.ts#L90
1) [webkit] › tests/core/hint/hint.pw.spec.ts:71:13 › TuiHint › true mode hint with delay ────────
Error: expect(page).toHaveScreenshot(expected)
84957 pixels (ratio 0.15 of all image pixels) are different.
Expected: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/snapshots/tests/core/hint/hint.pw.spec.ts-snapshots/03-hint-mode-true-tuiHintShowDelay-1000-wait-500-webkit-darwin.png
Received: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-hint-hint.pw-TuiHint-true-mode-hint-with-delay-webkit/03-hint-mode-true-tuiHintShowDelay-1000-wait-500-actual.png
Diff: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-hint-hint.pw-TuiHint-true-mode-hint-with-delay-webkit/03-hint-mode-true-tuiHintShowDelay-1000-wait-500-diff.png
Call log:
- expect.toHaveScreenshot(03-hint-mode-true-tuiHintShowDelay-1000-wait-500.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 84957 pixels (ratio 0.15 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 84957 pixels (ratio 0.15 of all image pixels) are different.
88 | await page.waitForTimeout(500);
89 |
> 90 | await expect(page).toHaveScreenshot(
| ^
91 | `03-hint-mode-${mode}-tuiHintShowDelay-1000-wait-500.png`,
92 | );
93 |
at /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/core/hint/hint.pw.spec.ts:90:32
|
[webkit] › tests/core/data-list/data-list.pw.spec.ts:176:9 › DataList › Options with long text:
projects/demo-playwright/tests/core/data-list/data-list.pw.spec.ts#L187
1) [webkit] › tests/core/data-list/data-list.pw.spec.ts:176:9 › DataList › Options with long text
Error: Timed out 5000ms waiting for expect(page).toHaveScreenshot(expected)
Failed to take two consecutive stable screenshots.
Previous: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-data-list-data--8393e-List-Options-with-long-text-webkit/10-data-list-previous.png
Received: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-data-list-data--8393e-List-Options-with-long-text-webkit/10-data-list-actual.png
Diff: /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-core-data-list-data--8393e-List-Options-with-long-text-webkit/10-data-list-diff.png
Call log:
- expect.toHaveScreenshot(10-data-list.png) with timeout 5000ms
- generating new stable screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 11810 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- Timeout 5000ms exceeded.
185 | await documentationPagePO.prepareBeforeScreenshot();
186 |
> 187 | await expect(page).toHaveScreenshot('10-data-list.png');
| ^
188 | });
189 | });
190 |
at /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/core/data-list/data-list.pw.spec.ts:187:28
|
[webkit] › tests/legacy/input-range/input-range.pw.spec.ts:52:13 › InputRange › Keyboard interactions › pressing Arrow Up increases LEFT value when LEFT text input is focused:
projects/demo-playwright/tests/legacy/input-range/input-range.pw.spec.ts#L62
1) [webkit] › tests/legacy/input-range/input-range.pw.spec.ts:52:13 › InputRange › Keyboard interactions › pressing Arrow Up increases LEFT value when LEFT text input is focused
Error: Timed out 5000ms waiting for expect(locator).toHaveScreenshot(expected)
Locator: locator('#demo-content')
Timeout 5000ms exceeded.
Call log:
- expect.toHaveScreenshot(06-input-range.png) with timeout 5000ms
- generating new stable screenshot expectation
- waiting for locator('#demo-content')
- locator resolved to <div id="demo-content" _ngcontent-ng-c2476019924="">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- waiting 100ms before taking screenshot
- waiting for locator('#demo-content')
- Timeout 5000ms exceeded.
60 | await page.keyboard.down('ArrowUp');
61 |
> 62 | await expect(example).toHaveScreenshot('06-input-range.png');
| ^
63 | });
64 |
65 | test('pressing Arrow Up increases RIGHT value when RIGHT text input is focused', async ({
at /Users/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/legacy/input-range/input-range.pw.spec.ts:62:35
|
Build demo
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Cypress / Component Testing
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 8 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 2 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 7 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 1 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 4 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 9 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 6 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / ubuntu-latest / 5 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / macos-latest / 1 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 1 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 1 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 1 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 1 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 2 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 2 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 2 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 2 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 2 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 4 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 4 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 4 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 4 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 4 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / ubuntu-latest / 3 of 9
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Playwright / macos-latest / 6 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 6 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 6 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 6 of 9
jpeg-turbo 3.1.0 is already installed and up-to-date.
To reinstall 3.1.0, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 6 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 5 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 5 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 5 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 5 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 5 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 7 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 7 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 7 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 7 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 7 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 9 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 9 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 9 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 9 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 9 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 8 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 8 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 8 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 8 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 8 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright / macos-latest / 3 of 9
pkgconf 2.3.0_1 is already installed and up-to-date.
To reinstall 2.3.0_1, run:
brew reinstall pkgconf
|
Playwright / macos-latest / 3 of 9
cairo 1.18.2 is already installed and up-to-date.
To reinstall 1.18.2, run:
brew reinstall cairo
|
Playwright / macos-latest / 3 of 9
libpng 1.6.44 is already installed and up-to-date.
To reinstall 1.6.44, run:
brew reinstall libpng
|
Playwright / macos-latest / 3 of 9
jpeg-turbo 3.0.4 is already installed and up-to-date.
To reinstall 3.0.4, run:
brew reinstall jpeg-turbo
|
Playwright / macos-latest / 3 of 9
giflib 5.2.2 is already installed and up-to-date.
To reinstall 5.2.2, run:
brew reinstall giflib
|
Playwright E2E Tests matrix result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
E2E result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
🎭 Playwright Run Summary
109 passed (1.3m)
|
🎭 Playwright Run Summary
109 passed (1.5m)
|
🎭 Playwright Run Summary
110 passed (1.8m)
|
🎭 Playwright Run Summary
110 passed (1.6m)
|
🎭 Playwright Run Summary
109 passed (1.8m)
|
🎭 Playwright Run Summary
109 passed (1.6m)
|
🎭 Playwright Run Summary
110 passed (1.3m)
|
🎭 Playwright Run Summary
110 passed (1.4m)
|
🎭 Playwright Run Summary
110 passed (2.1m)
|
🎭 Playwright Run Summary
110 passed (1.9m)
|
🎭 Playwright Run Summary
109 passed (1.6m)
|
🎭 Playwright Run Summary
109 passed (1.7m)
|
🎭 Playwright Run Summary
109 passed (2.0m)
|
🎭 Playwright Run Summary
109 passed (1.7m)
|
🎭 Playwright Run Summary
110 passed (2.5m)
|
🎭 Playwright Run Summary
110 passed (2.8m)
|
🎭 Playwright Run Summary
8 skipped
102 passed (1.3m)
|
🎭 Playwright Run Summary
8 skipped
102 passed (1.5m)
|
🎭 Playwright Run Summary
1 flaky
[webkit] › tests/core/hint/hint.pw.spec.ts:71:13 › TuiHint › true mode hint with delay ─────────
44 skipped
65 passed (1.6m)
|
🎭 Playwright Run Summary
1 flaky
[webkit] › tests/core/data-list/data-list.pw.spec.ts:176:9 › DataList › Options with long text ─
44 skipped
65 passed (2.0m)
|
🎭 Playwright Run Summary
110 passed (3.3m)
|
🎭 Playwright Run Summary
110 passed (2.7m)
|
🎭 Playwright Run Summary
110 passed (7.0m)
|
🎭 Playwright Run Summary
110 passed (8.5m)
|
🎭 Playwright Run Summary
18 skipped
91 passed (2.3m)
|
🎭 Playwright Run Summary
18 skipped
91 passed (2.3m)
|
🎭 Playwright Run Summary
110 passed (4.5m)
|
🎭 Playwright Run Summary
110 passed (4.0m)
|
🎭 Playwright Run Summary
5 skipped
104 passed (2.7m)
|
🎭 Playwright Run Summary
5 skipped
104 passed (2.1m)
|
🎭 Playwright Run Summary
10 skipped
99 passed (1.9m)
|
🎭 Playwright Run Summary
10 skipped
99 passed (1.5m)
|
🎭 Playwright Run Summary
1 flaky
[webkit] › tests/legacy/input-range/input-range.pw.spec.ts:52:13 › InputRange › Keyboard interactions › pressing Arrow Up increases LEFT value when LEFT text input is focused
108 passed (2.3m)
|
🎭 Playwright Run Summary
109 passed (2.5m)
|
🎭 Playwright Run Summary
110 passed (13.9m)
|
🎭 Playwright Run Summary
110 passed (10.0m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
cy_baseline_d3cc323d448ea8cf2c2976d1dd205af4836a7a84
Expired
|
113 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_1
Expired
|
259 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_2
Expired
|
301 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_3
Expired
|
1.46 MB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_4
Expired
|
530 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_5
Expired
|
829 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_6
Expired
|
432 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_7
Expired
|
351 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_8
Expired
|
361 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-Linux_9
Expired
|
386 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_1
Expired
|
232 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_2
Expired
|
528 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_3
Expired
|
1.42 MB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_4
Expired
|
528 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_5
Expired
|
797 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_6
Expired
|
392 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_7
Expired
|
310 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_8
Expired
|
336 KB |
|
playwright-blob-artifacts--d3cc323d448ea8cf2c2976d1dd205af4836a7a84-12369063775-10001-macOS_9
Expired
|
309 KB |
|