Skip to content
iOS end-to-end nightly tests

iOS end-to-end nightly tests #18

Sign in to view logs

iOS end-to-end nightly tests

iOS end-to-end nightly tests #18

Triggered via schedule August 25, 2024 00:01
@buggmagnetbuggmagnet
⁠ 423bd57
main
Status Failure
Total duration 12m 49s
Artifacts 5

ios-end-to-end-tests-nightly.yml

on: schedule
reuse-e2e-workflow  /  Set up outputs directory
4s
reuse-e2e-workflow / Set up outputs directory
reuse-e2e-workflow  /  Define test suites matrix
5s
reuse-e2e-workflow / Define test suites matrix
reuse-e2e-workflow  /  Build for end to end testing
2m 46s
reuse-e2e-workflow / Build for end to end testing
Matrix: reuse-e2e-workflow / Run tests
reuse-e2e-workflow  /  Clean up outputs directory
5s
reuse-e2e-workflow / Clean up outputs directory
reuse-e2e-workflow  /  Notify team on failure(if PR related)
0s
reuse-e2e-workflow / Notify team on failure(if PR related)
Fit to window
Zoom out
Zoom in

Annotations

24 errors and 6 warnings
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Pages/LoginPage.swift#L67
testDeleteAccount, XCTAssertTrue failed - Fail icon shown
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testLogin, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Pages/LoginPage.swift#L57
testLoginToAccountWithTooManyDevices, XCTAssertEqual failed: ("XCTWaiterResult(rawValue: 2)") is not equal to ("XCTWaiterResult(rawValue: 1)") - Success icon shown
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Pages/LoginPage.swift#L67
testLoginWithIncorrectAccountNumber, XCTAssertTrue failed - Fail icon shown
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L104
testLogOut, XCTAssertNil failed: "requestError" - Create account error is nil
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testTimeLeft, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (AccountTests)
Process completed with exit code 65.
reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/FirewallAPIClient.swift#L105
testAPIConnectionViaBridges, failed - Failed to remove firewall rules - unexpected server response
reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAPIReachableWhenBlocked, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAppStillFunctioningWhenAPIDown, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (ConnectivityTests)
Process completed with exit code 65.
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAddSingleLocationToCustomList, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testCreateCustomListPersistAfterAppRestarts, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testDeleteCustomList, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testEditCustomListLocations, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests)
Process completed with exit code 65.
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAdBlockingViaDNS, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAppConnection, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testConnectionRetryLogic, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testCustomDNS, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testWireGuardOverTCPAutomatically, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testWireGuardOverTCPManually, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testWireGuardPortSettings, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests)
Process completed with exit code 65.
reuse-e2e-workflow / Build for end to end testing
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/[email protected]. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
reuse-e2e-workflow / Build for end to end testing
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/[email protected]. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

Artifacts

Produced during runtime
Name Size
MullvadVPNUITests_AccountTests-test-results Expired
121 MB
MullvadVPNUITests_ConnectivityTests-test-results Expired
56.1 MB
MullvadVPNUITests_CustomListsTests-test-results Expired
52.8 MB
MullvadVPNUITests_RelayTests-test-results Expired
76.6 MB
MullvadVPNUITests_SettingsTests-test-results Expired
111 KB