ci: any playwright test should fail on any uncaught SSR error #950
Annotations
7 errors and 16 notices
[chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position:
projects/demo-playwright/tests/kit/input-slider/input-slider.spec.ts#L54
1) [chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position
Error: Screenshot comparison failed:
288 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/snapshots/tests/kit/input-slider/input-slider.spec.ts-snapshots/2-0-arrow-up-checks-4-chromium-linux.png
Received: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-kit-input-slider-input-slider-InputSlide-0d3f3-Down-change-textInput-value-and-slider-position-chromium/2-0-arrow-up-checks-4-actual.png
Diff: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-kit-input-slider-input-slider-InputSlide-0d3f3-Down-change-textInput-value-and-slider-position-chromium/2-0-arrow-up-checks-4-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#right-label [automation-id="tui-doc-example"]')
- locator resolved to <div _ngcontent-ng-c891291879="" automation-id="tui-d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 288 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#right-label [automation-id="tui-doc-example"]')
- locator resolved to <div _ngcontent-ng-c891291879="" automation-id="tui-d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 288 pixels (ratio 0.01 of all image pixels) are different.
52 | await expect(inputSlider.textfield).toHaveValue(`${i}`);
53 | await expect(inputSlider.slider).toHaveValue(`${i}`);
> 54 | await expect(example).toHaveScreenshot(`2-0-arrow-up-checks-${i}.png`);
| ^
55 | }
56 |
57 | for (let i = 9; i >= 0; i--) {
at /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/kit/input-slider/input-slider.spec.ts:54:39
|
[chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position:
projects/demo-playwright/tests/kit/input-slider/input-slider.spec.ts#L54
1) [chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
321 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/snapshots/tests/kit/input-slider/input-slider.spec.ts-snapshots/2-0-arrow-up-checks-5-chromium-linux.png
Received: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-kit-input-slider-input-slider-InputSlide-0d3f3-Down-change-textInput-value-and-slider-position-chromium-retry1/2-0-arrow-up-checks-5-actual.png
Diff: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-kit-input-slider-input-slider-InputSlide-0d3f3-Down-change-textInput-value-and-slider-position-chromium-retry1/2-0-arrow-up-checks-5-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#right-label [automation-id="tui-doc-example"]')
- locator resolved to <div _ngcontent-ng-c891291879="" automation-id="tui-d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 321 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#right-label [automation-id="tui-doc-example"]')
- locator resolved to <div _ngcontent-ng-c891291879="" automation-id="tui-d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 321 pixels (ratio 0.01 of all image pixels) are different.
52 | await expect(inputSlider.textfield).toHaveValue(`${i}`);
53 | await expect(inputSlider.slider).toHaveValue(`${i}`);
> 54 | await expect(example).toHaveScreenshot(`2-0-arrow-up-checks-${i}.png`);
| ^
55 | }
56 |
57 | for (let i = 9; i >= 0; i--) {
at /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/kit/input-slider/input-slider.spec.ts:54:39
|
[chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position:
projects/demo-playwright/tests/kit/input-slider/input-slider.spec.ts#L54
1) [chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
288 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/snapshots/tests/kit/input-slider/input-slider.spec.ts-snapshots/2-0-arrow-up-checks-4-chromium-linux.png
Received: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-kit-input-slider-input-slider-InputSlide-0d3f3-Down-change-textInput-value-and-slider-position-chromium-retry2/2-0-arrow-up-checks-4-actual.png
Diff: /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests-results/tests-kit-input-slider-input-slider-InputSlide-0d3f3-Down-change-textInput-value-and-slider-position-chromium-retry2/2-0-arrow-up-checks-4-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#right-label [automation-id="tui-doc-example"]')
- locator resolved to <div _ngcontent-ng-c891291879="" automation-id="tui-d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 288 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#right-label [automation-id="tui-doc-example"]')
- locator resolved to <div _ngcontent-ng-c891291879="" automation-id="tui-d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 288 pixels (ratio 0.01 of all image pixels) are different.
52 | await expect(inputSlider.textfield).toHaveValue(`${i}`);
53 | await expect(inputSlider.slider).toHaveValue(`${i}`);
> 54 | await expect(example).toHaveScreenshot(`2-0-arrow-up-checks-${i}.png`);
| ^
55 | }
56 |
57 | for (let i = 9; i >= 0; i--) {
at /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/tests/kit/input-slider/input-slider.spec.ts:54:39
|
playwright / (7 of 8)
Process completed with exit code 1.
|
[chromium] › tests/demo/demo.spec.ts:10:13 › Demo › /components/tiles:
projects/demo-playwright/tests/demo/demo.spec.ts#L1
1) [chromium] › tests/demo/demo.spec.ts:10:13 › Demo › /components/tiles ─────────────────────────
Test timeout of 30000ms exceeded.
|
[chromium] › tests/demo/demo.spec.ts:10:13 › Demo › /components/tiles:
projects/demo-playwright/utils/page-objects/documentation-api-page.po.ts#L29
1) [chromium] › tests/demo/demo.spec.ts:10:13 › Demo › /components/tiles ─────────────────────────
Error: Test timeout of 30000ms exceeded.
at utils/page-objects/documentation-api-page.po.ts:29
27 | new Promise(resolve => {
28 | req.response()
> 29 | .then(response => resolve(response?.finished()))
| ^
30 | .catch(() => resolve(undefined));
31 | }),
32 | ),
at /home/runner/work/taiga-ui/taiga-ui/projects/demo-playwright/utils/page-objects/documentation-api-page.po.ts:29:65
|
E2E result
Process completed with exit code 1.
|
🎭 Playwright Run Summary
110 passed (2.2m)
|
🎭 Playwright Run Summary
110 passed (1.5m)
|
🎭 Playwright Run Summary
109 passed (2.6m)
|
🎭 Playwright Run Summary
109 passed (1.7m)
|
🎭 Playwright Run Summary
109 passed (2.5m)
|
🎭 Playwright Run Summary
109 passed (1.5m)
|
🎭 Playwright Run Summary
109 passed (2.3m)
|
🎭 Playwright Run Summary
1 failed
[chromium] › tests/kit/input-slider/input-slider.spec.ts:40:13 › InputSlider › examples page › pressing ArrowUp/ArrowDown change textInput value and slider position
108 passed (1.6m)
|
🎭 Playwright Run Summary
110 passed (2.3m)
|
🎭 Playwright Run Summary
110 passed (3.1m)
|
🎭 Playwright Run Summary
110 passed (1.8m)
|
🎭 Playwright Run Summary
110 passed (2.7m)
|
🎭 Playwright Run Summary
109 passed (2.0m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › tests/demo/demo.spec.ts:10:13 › Demo › /components/tiles ──────────────────────────
108 passed (3.0m)
|
🎭 Playwright Run Summary
110 passed (7.6m)
|
🎭 Playwright Run Summary
110 passed (9.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-e2e-artifacts--52f1140077f2c6e4aff6ac04aaf06c8033ecd091-8469331011-7081_7
Expired
|
14.7 KB |
|