ci: workflow updates #23
validate.yml
on: push
Annotations
10 errors, 1 warning, and 1 notice
[chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
1) [chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ────
Error: Screenshot comparison failed:
99 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-chromium-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-chromium/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-chromium/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 219 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 120 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 99 pixels (ratio 0.01 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
1) [chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
37900 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-chromium-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-chromium-retry1/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-chromium-retry1/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 99 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 38050 pixels (ratio 0.05 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 37900 pixels (ratio 0.05 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
1) [chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
37900 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-chromium-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-chromium-retry2/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-chromium-retry2/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 99 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 38050 pixels (ratio 0.05 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 37900 pixels (ratio 0.05 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
2) [firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ─────
Error: Screenshot comparison failed:
147 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-firefox-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-firefox/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-firefox/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 147 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 147 pixels (ratio 0.01 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
2) [firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ─────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
147 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-firefox-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-firefox-retry1/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-firefox-retry1/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 147 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 147 pixels (ratio 0.01 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
2) [firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ─────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
147 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-firefox-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-firefox-retry2/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-firefox-retry2/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 147 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 147 pixels (ratio 0.01 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
3) [webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ──────
Error: Screenshot comparison failed:
37976 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-webkit-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-webkit/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-webkit/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 938 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 1043 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 38138 pixels (ratio 0.05 of all image pixels) are different.
- waiting 500ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 37976 pixels (ratio 0.05 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
3) [webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ──────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
112 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-webkit-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-webkit-retry1/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-webkit-retry1/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 112 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 112 pixels (ratio 0.01 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
[webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes:
e2e/tests/pages/index.test.ts#L34
3) [webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ──────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
37976 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/snapshots/tests/pages/index.test.ts-snapshots/index-page-should-not-have-visible-changes-1-webkit-linux.png
Received: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-webkit-retry2/index-page-should-not-have-visible-changes-1-actual.png
Diff: /home/runner/work/frischmuth-frontend/frischmuth-frontend/test-results/tests-pages-index-index-page-should-not-have-visible-changes-webkit-retry2/index-page-should-not-have-visible-changes-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 938 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 1043 pixels (ratio 0.01 of all image pixels) are different.
- waiting 250ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 38138 pixels (ratio 0.05 of all image pixels) are different.
- waiting 500ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 37976 pixels (ratio 0.05 of all image pixels) are different.
32 | await indexPage.goto();
33 |
> 34 | await expect(indexPage.page).toHaveScreenshot();
| ^
35 | }
36 | });
37 | });
at /home/runner/work/frischmuth-frontend/frischmuth-frontend/e2e/tests/pages/index.test.ts:34:33
|
Validate (20.x, ubuntu-latest)
Process completed with exit code 1.
|
Validate (20.x, ubuntu-latest)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
🎭 Playwright Run Summary
3 failed
[chromium] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ─────
[firefox] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ──────
[webkit] › tests/pages/index.test.ts:29:2 › index page › should not have visible changes ───────
3 skipped
96 passed (1.5m)
|