Skip to content

Add E2E tests for silent authentication #302

Add E2E tests for silent authentication

Add E2E tests for silent authentication #302

Triggered via pull request October 11, 2024 15:16
Status Failure
Total duration 10m 4s
Artifacts 2

e2e_pr_full.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 4 warnings, and 1 notice
[chromium] › auth.spec.ts:42:3 › local - Authentication flow verification @smoke › Verify sign in with existing user: src/e2e/specs/auth.spec.ts#L60
1) [chromium] › auth.spec.ts:42:3 › local - Authentication flow verification @smoke › Verify sign in with existing user Error: Timed out 2000ms waiting for expect(locator).toBeVisible() Locator: getByRole('tab', { name: 'Fixed' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 2000ms - waiting for getByRole('tab', { name: 'Fixed' }) 58 | 59 | // assert successful login > 60 | await expect(dashboardPage.fixedTab).toBeVisible(); | ^ 61 | await expect(dashboardPage.actionNeededTab).toBeVisible(); 62 | 63 | await testInfo.attach( at /home/runner/work/blurts-server/blurts-server/src/e2e/specs/auth.spec.ts:60:42
[chromium] › auth.spec.ts:42:3 › local - Authentication flow verification @smoke › Verify sign in with existing user: src/e2e/specs/auth.spec.ts#L60
1) [chromium] › auth.spec.ts:42:3 › local - Authentication flow verification @smoke › Verify sign in with existing user Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 2000ms waiting for expect(locator).toBeVisible() Locator: getByRole('tab', { name: 'Fixed' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 2000ms - waiting for getByRole('tab', { name: 'Fixed' }) 58 | 59 | // assert successful login > 60 | await expect(dashboardPage.fixedTab).toBeVisible(); | ^ 61 | await expect(dashboardPage.actionNeededTab).toBeVisible(); 62 | 63 | await testInfo.attach( at /home/runner/work/blurts-server/blurts-server/src/e2e/specs/auth.spec.ts:60:42
[chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/specs/auth.spec.ts#L1
2) [chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Test timeout of 60000ms exceeded.
[chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/pages/authPage.ts#L102
2) [chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Error: page.waitForURL: Test timeout of 60000ms exceeded. =========================== logs =========================== waiting for navigation to "**/oauth/**" until "load" navigated to "***/?feature_flags=PromptNoneAuthFlow&utm_source=moz-account&utm_campaign=settings-promo&utm_content=monitor-free" navigated to "https://accounts.stage.mozaws.net/authorization?client_id=edd29a80019d61a1&scope=profile+https%3A%2F%2Fidentity.mozilla.com%2Faccount%2Fsubscriptions&response_type=code&redirect_uri=***%2Fapi%2Fauth%2Fcallback%2Ffxa&access_type=offline&action=email&prompt=none&max_age=0&state=-k669tvVzbkmCsosZg-lOvnF2gCJgc1mJsOCpY0wf4c" navigated to "https://accounts.stage.mozaws.net/authorization?client_id=edd29a80019d61a1&scope=profile+https%3A%2F%2Fidentity.mozilla.com%2Faccount%2Fsubscriptions&response_type=code&redirect_uri=***%2Fapi%2Fauth%2Fcallback%2Ffxa&access_type=offline&action=email&prompt=none&max_age=0&state=-k669tvVzbkmCsosZg-lOvnF2gCJgc1mJsOCpY0wf4c" navigated to "***/user/welcome" navigated to "***/user/welcome" ============================================================ at ../pages/authPage.ts:102 100 | ); 101 | // FxA can take a while to load on stage: > 102 | await this.page.waitForURL("**/oauth/**"); | ^ 103 | } 104 | } 105 | at AuthPage.initSilentAuth (/home/runner/work/blurts-server/blurts-server/src/e2e/pages/authPage.ts:102:21) at /home/runner/work/blurts-server/blurts-server/src/e2e/specs/auth.spec.ts:89:5
[chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/specs/auth.spec.ts#L1
2) [chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 60000ms exceeded.
[chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/pages/authPage.ts#L102
2) [chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForURL: Test timeout of 60000ms exceeded. =========================== logs =========================== waiting for navigation to "**/oauth/**" until "load" navigated to "***/?feature_flags=PromptNoneAuthFlow&utm_source=moz-account&utm_campaign=settings-promo&utm_content=monitor-free" navigated to "https://accounts.stage.mozaws.net/authorization?client_id=edd29a80019d61a1&scope=profile+https%3A%2F%2Fidentity.mozilla.com%2Faccount%2Fsubscriptions&response_type=code&redirect_uri=***%2Fapi%2Fauth%2Fcallback%2Ffxa&access_type=offline&action=email&prompt=none&max_age=0&state=fgbM8OxacIj3qNawSXic88sAO-dI0_ZWJZGXHtmJyFI" navigated to "https://accounts.stage.mozaws.net/authorization?client_id=edd29a80019d61a1&scope=profile+https%3A%2F%2Fidentity.mozilla.com%2Faccount%2Fsubscriptions&response_type=code&redirect_uri=***%2Fapi%2Fauth%2Fcallback%2Ffxa&access_type=offline&action=email&prompt=none&max_age=0&state=fgbM8OxacIj3qNawSXic88sAO-dI0_ZWJZGXHtmJyFI" navigated to "***/user/dashboard" navigated to "***/user/dashboard" navigated to "***/user/dashboard/action-needed" ============================================================ at ../pages/authPage.ts:102 100 | ); 101 | // FxA can take a while to load on stage: > 102 | await this.page.waitForURL("**/oauth/**"); | ^ 103 | } 104 | } 105 | at AuthPage.initSilentAuth (/home/runner/work/blurts-server/blurts-server/src/e2e/pages/authPage.ts:102:21) at /home/runner/work/blurts-server/blurts-server/src/e2e/specs/auth.spec.ts:89:5
[firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/specs/auth.spec.ts#L1
3) [firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Test timeout of 60000ms exceeded.
[firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/pages/authPage.ts#L102
3) [firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Error: page.waitForURL: Test timeout of 60000ms exceeded. =========================== logs =========================== waiting for navigation to "**/oauth/**" until "load" navigated to "***/?feature_flags=PromptNoneAuthFlow&utm_source=moz-account&utm_campaign=settings-promo&utm_content=monitor-free" navigated to "https://accounts.stage.mozaws.net/authorization?client_id=edd29a80019d61a1&scope=profile+https%3A%2F%2Fidentity.mozilla.com%2Faccount%2Fsubscriptions&response_type=code&redirect_uri=***%2Fapi%2Fauth%2Fcallback%2Ffxa&access_type=offline&action=email&prompt=none&max_age=0&state=l1PG2CByxHABT5jpB56JvKWGfFBCSu4x8Miq593zSdo" navigated to "https://accounts.stage.mozaws.net/authorization?client_id=edd29a80019d61a1&scope=profile+https%3A%2F%2Fidentity.mozilla.com%2Faccount%2Fsubscriptions&response_type=code&redirect_uri=***%2Fapi%2Fauth%2Fcallback%2Ffxa&access_type=offline&action=email&prompt=none&max_age=0&state=l1PG2CByxHABT5jpB56JvKWGfFBCSu4x8Miq593zSdo" navigated to "***/user/dashboard" navigated to "***/user/dashboard" navigated to "***/user/dashboard/action-needed" ============================================================ at ../pages/authPage.ts:102 100 | ); 101 | // FxA can take a while to load on stage: > 102 | await this.page.waitForURL("**/oauth/**"); | ^ 103 | } 104 | } 105 | at AuthPage.initSilentAuth (/home/runner/work/blurts-server/blurts-server/src/e2e/pages/authPage.ts:102:21) at /home/runner/work/blurts-server/blurts-server/src/e2e/specs/auth.spec.ts:89:5
[firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/specs/auth.spec.ts#L1
3) [firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 60000ms exceeded.
[firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user: src/e2e/pages/authPage.ts#L34
3) [firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForURL: Test timeout of 60000ms exceeded. =========================== logs =========================== waiting for navigation to "https://accounts.stage.mozaws.net/settings" until "load" navigated to "https://accounts.stage.mozaws.net/settings" "networkidle" event fired ============================================================ at ../pages/authPage.ts:34 32 | async continue({ waitForURL = "**/*" }) { 33 | await this.continueButton.click(); > 34 | await this.page.waitForURL(waitForURL); | ^ 35 | } 36 | 37 | async enterVerificationCode(code: string) { at AuthPage.continue (/home/runner/work/blurts-server/blurts-server/src/e2e/pages/authPage.ts:34:21) at AuthPage.signInToFxA (/home/runner/work/blurts-server/blurts-server/src/e2e/pages/authPage.ts:94:5) at /home/runner/work/blurts-server/blurts-server/src/e2e/specs/auth.spec.ts:83:5
Slow Test: [chromium] › dashboard/dashboard-breaches-scan.spec.ts#L1
[chromium] › dashboard/dashboard-breaches-scan.spec.ts took 37.6s
Slow Test: [firefox] › dashboard/dashboard-breaches-scan.spec.ts#L1
[firefox] › dashboard/dashboard-breaches-scan.spec.ts took 34.6s
Slow Test: [firefox] › dashboard/dashboard-overview-card.spec.ts#L1
[firefox] › dashboard/dashboard-overview-card.spec.ts took 19.1s
Slow Test: [firefox] › landing/landing-new-account.spec.ts#L1
[firefox] › landing/landing-new-account.spec.ts took 16.4s
🎭 Playwright Run Summary
6 failed [chromium] › auth.spec.ts:42:3 › local - Authentication flow verification @smoke › Verify sign in with existing user [chromium] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user [firefox] › auth.spec.ts:72:3 › local - Authentication flow verification @smoke › Verify successful silent authentication with existing user [firefox] › landing/landing-content.spec.ts:186:3 › local - Verify the Landing Page content › Verify the "Get free scan" corresponding email fields [firefox] › landing/landing-existing-account.spec.ts:13:3 › local - Verify the Landing Page Functionality - existing account › Verify "Get free scan" buttons functionality with an existing account [firefox] › landing/landing-existing-account.spec.ts:51:3 › local - Verify the Landing Page Functionality - existing account › Verify the "Start free monitoring" button UI and functionality with an existing account 1 flaky [chromium] › auth.spec.ts:104:3 › local - Authentication flow verification @smoke › Verify failed silent authentication with existing user 14 skipped 69 passed (8.6m)

Artifacts

Produced during runtime
Name Size
playwright-report Expired
14.7 MB
test-results Expired
14.1 MB