Add a setting to configure the default log level for the Log Console … #5
galata.yml
on: push
Visual Regression Tests
39m 10s
Matrix: Visual Regression Documentation
Annotations
14 errors and 2 notices
|
[documentation] › test/documentation/workspaces.test.ts:38:7 › Workspaces sidebar › Workspaces context menu:
core/galata/test/documentation/workspaces.test.ts#L43
3) [documentation] › test/documentation/workspaces.test.ts:38:7 › Workspaces sidebar › Workspaces context menu
Error: locator.waitFor: Test timeout of 90000ms exceeded.
Call log:
- waiting for getByRole('treeitem', { name: 'analysis-space' }) to be visible
41 | `.jp-DirListing-item span:has-text("${testWorkspace}")`
42 | );
> 43 | await page.getByRole('treeitem', { name: workspaceName }).waitFor();
| ^
44 |
45 | await galata.Mock.mockRunners(page, new Map(), 'sessions');
46 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/workspaces.test.ts:43:63
|
|
[documentation] › test/documentation/workspaces.test.ts:38:7 › Workspaces sidebar › Workspaces context menu:
core/galata/test/documentation/workspaces.test.ts#L0
3) [documentation] › test/documentation/workspaces.test.ts:38:7 › Workspaces sidebar › Workspaces context menu
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:116:7 › General › Right Sidebar:
core/galata/test/documentation/general.test.ts#L147
2) [documentation] › test/documentation/general.test.ts:116:7 › General › Right Sidebar ──────────
Error: expect(Buffer).toMatchSnapshot(expected)
21 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/interface-right-common-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Right-Sidebar-documentation/interface-right-common-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Right-Sidebar-documentation/interface-right-common-diff.png
145 | clip: { y: 32, x: 997, width: 283, height: 400 }
146 | })
> 147 | ).toMatchSnapshot('interface_right_common.png');
| ^
148 |
149 | // Expect the 'Raw NbConvert Format' field to be displayed only on raw cells
150 | await expect(
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:147:7
|
|
[documentation] › test/documentation/debugger.test.ts:100:7 › Debugger › Stop on breakpoint:
core/galata/test/documentation/debugger.test.ts#L121
1) [documentation] › test/documentation/debugger.test.ts:100:7 › Debugger › Stop on breakpoint ───
Error: expect(Buffer).toMatchSnapshot(expected)
366 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts-snapshots/debugger-stop-on-breakpoint-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugger-Debugger-Stop-on-breakpoint-documentation/debugger-stop-on-breakpoint-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugger-Debugger-Stop-on-breakpoint-documentation/debugger-stop-on-breakpoint-diff.png
119 | clip: { y: 100, x: 300, width: 300, height: 80 }
120 | })
> 121 | ).toMatchSnapshot('debugger_stop_on_breakpoint.png');
| ^
122 |
123 | await page.click('jp-button[title^=Continue]');
124 | });
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts:121:7
|
|
[jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:392:5 › should display cells below on scrolling after inserting a cell on top:
galata/test/jupyterlab/windowed-notebook.test.ts#L0
6) [jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:392:5 › should display cells below on scrolling after inserting a cell on top
Test timeout of 60000ms exceeded.
|
|
[jupyterlab] › test/jupyterlab/notebook-toolbar.test.ts:223:7 › Reactive toolbar › Items in popup toolbar should have the same order:
galata/test/jupyterlab/notebook-toolbar.test.ts#L230
5) [jupyterlab] › test/jupyterlab/notebook-toolbar.test.ts:223:7 › Reactive toolbar › Items in popup toolbar should have the same order
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-NotebookPanel-toolbar').locator('.jp-Toolbar-responsive-opener')
- locator resolved to <div data-no-focus-on-click="true" data-jp-item-name="toolbar-popup-opener" class="lm-Widget jp-ToolbarButton jp-Toolbar-responsive-opener jp-Toolbar-item lm-mod-hidden">…</div>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action
- waiting 100ms
107 × waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action
- waiting 500ms
228 | await page.sidebar.setWidth(520);
229 |
> 230 | await toolbar.locator('.jp-Toolbar-responsive-opener').click();
| ^
231 |
232 | // A 'visible' selector is added because there is another response popup element
233 | // when running in playwright (don't know where it come from, it is an empty
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/notebook-toolbar.test.ts:230:60
|
|
[jupyterlab] › test/jupyterlab/notebook-toolbar.test.ts:223:7 › Reactive toolbar › Items in popup toolbar should have the same order:
galata/test/jupyterlab/notebook-toolbar.test.ts#L0
5) [jupyterlab] › test/jupyterlab/notebook-toolbar.test.ts:223:7 › Reactive toolbar › Items in popup toolbar should have the same order
Test timeout of 60000ms exceeded.
|
|
[jupyterlab] › test/jupyterlab/notebook-scroll-no-windowing.test.ts:181:7 › Notebook scroll on execution (no windowing) › should scroll when advancing if top is only marginally visible:
galata/test/jupyterlab/notebook-scroll-no-windowing.test.ts#L203
4) [jupyterlab] › test/jupyterlab/notebook-scroll-no-windowing.test.ts:181:7 › Notebook scroll on execution (no windowing) › should scroll when advancing if top is only marginally visible
Error: Timed out 5000ms waiting for expect(locator).toBeInViewport()
Locator: getByRole('main').locator('[role="tabpanel"][id="id-8c6e3e13-e37a-4e14-a727-e471149bf5cd"]').locator('.jp-NotebookPanel-notebook').first().locator('.jp-Cell[data-windowed-list-index="2"]')
Expected: in viewport
Received: viewport ratio 0.009747706353664398
Call log:
- expect.toBeInViewport with timeout 5000ms
- waiting for getByRole('main').locator('[role="tabpanel"][id="id-8c6e3e13-e37a-4e14-a727-e471149bf5cd"]').locator('.jp-NotebookPanel-notebook').first().locator('.jp-Cell[data-windowed-list-index="2"]')
9 × locator resolved to <div tabindex="0" data-windowed-list-index="2" aria-label="Code Cell Content with Output" class="lm-Widget jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-active jp-mod-selected">…</div>
- unexpected value "viewport ratio 0.009747706353664398"
201 |
202 | // After running the second cell, the third cell should be revealed, in at least 10%
> 203 | await expect(thirdCell!).toBeInViewport({ ratio: 0.1 });
| ^
204 |
205 | // The third cell should now occupy about half of the notebook viewport
206 | expect(await notebookViewportRatio(notebook!, thirdCell!)).toBeGreaterThan(
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/notebook-scroll-no-windowing.test.ts:203:30
|
|
[jupyterlab] › test/jupyterlab/notebook-run.test.ts:66:7 › Notebook Run › Check cell output 1:
galata/src/galata.ts#L971
3) [jupyterlab] › test/jupyterlab/notebook-run.test.ts:66:7 › Notebook Run › Check cell output 1 ─
Error: apiResponse.json: Response has been disposed
at src/galata.ts:971
969 | break;
970 | }
> 971 | const data = await response.json();
| ^
972 | const id = type === 'terminals' ? data.name : data.id;
973 | runners.set(id, data);
974 | // Update kernels
at /home/runner/work/jupyterlab/jupyterlab/galata/src/galata.ts:971:41
|
|
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:278:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter:
galata/src/helpers/notebook.ts#L1269
2) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:278:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter
Error: locator.evaluate: Test timeout of 60000ms exceeded.
at src/helpers/notebook.ts:1269
1267 | // Wait until the CodeMirror highlighting is stable
1268 | // over 10 consecutive animation frames.
> 1269 | await cell.evaluate((cell: HTMLElement) => {
| ^
1270 | let _resolve: () => void;
1271 | const promise = new Promise<void>(resolve => {
1272 | _resolve = resolve;
at NotebookHelper.setCell (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:1269:18)
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:25:5
|
|
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:278:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter:
galata/test/jupyterlab/inline-completer.test.ts#L23
2) [jupyterlab] › test/jupyterlab/inline-completer.test.ts:278:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter
Test timeout of 60000ms exceeded while running "beforeEach" hook.
21 |
22 | test.describe('Inline Completer', () => {
> 23 | test.beforeEach(async ({ page }) => {
| ^
24 | await page.notebook.createNew(fileName);
25 | await page.notebook.setCell(0, 'code', 'suggestion_1 = 1');
26 | await page.notebook.addCell(
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/inline-completer.test.ts:23:8
|
|
[jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel:
galata/src/utils.ts#L311
1) [jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.isChecked: Target page, context or browser has been closed
at src/utils.ts:311
309 | export function isInSimpleMode(page: Page): Promise<boolean> {
310 | const toggle = page.getByRole('switch', { name: 'Simple' });
> 311 | return toggle.isChecked();
| ^
312 | }
313 |
at Object.isInSimpleMode (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:311:17)
at ActivityHelper.isTabActive (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/activity.ts:46:21)
at fn (/home/runner/work/jupyterlab/jupyterlab/galata/src/fixtures.ts:354:33)
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:183:33)
|
|
[jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel:
galata/test/jupyterlab/completer.test.ts#L0
1) [jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
|
[jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel:
galata/src/jupyterlabpage.ts#L717
1) [jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel
Error: page.evaluate: Execution context was destroyed, most likely because of a navigation.
at src/jupyterlabpage.ts:717
715 | protected waitForAppStarted = async (): Promise<void> => {
716 | return this.waitForCondition(() =>
> 717 | this.page.evaluate(async () => {
| ^
718 | if (typeof window.jupyterapp === 'object') {
719 | // Wait for plugins to be loaded
720 | await window.jupyterapp.started;
at fn (/home/runner/work/jupyterlab/jupyterlab/galata/src/jupyterlabpage.ts:717:17)
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:183:33)
|
|
🎭 Playwright Run Summary
3 flaky
[documentation] › test/documentation/debugger.test.ts:100:7 › Debugger › Stop on breakpoint ────
[documentation] › test/documentation/general.test.ts:116:7 › General › Right Sidebar ───────────
[documentation] › test/documentation/workspaces.test.ts:38:7 › Workspaces sidebar › Workspaces context menu
60 passed (5.3m)
|
|
🎭 Playwright Run Summary
1 failed
[jupyterlab] › test/jupyterlab/completer.test.ts:58:9 › Completer › Notebook › Show documentation panel
6 flaky
[jupyterlab] › test/jupyterlab/inline-completer.test.ts:278:9 › Inline Completer › Ghost text › Empty space is retained to avoid jitter
[jupyterlab] › test/jupyterlab/notebook-run.test.ts:66:7 › Notebook Run › Check cell output 1 ──
[jupyterlab] › test/jupyterlab/notebook-scroll-no-windowing.test.ts:181:7 › Notebook scroll on execution (no windowing) › should scroll when advancing if top is only marginally visible
[jupyterlab] › test/jupyterlab/notebook-toolbar.test.ts:223:7 › Reactive toolbar › Items in popup toolbar should have the same order
[jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:392:5 › should display cells below on scrolling after inserting a cell on top
[jupyterlab] › test/jupyterlab/workspace.test.ts:62:7 › Workspace › should open a file from `tree` url if workspace is not empty
503 passed (31.2m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
jupyterlab-documentation-report
Expired
|
2.22 MB |
sha256:4cb71946864c531d0f80f675e09b7e370927bfdd70af87bba87cfd1f78346eec
|
|
|
jupyterlab-documentation-test-assets
Expired
|
1.28 MB |
sha256:397ef7642b32fd455188ea6e9612023e1bc5127f8d29ea8451d71aab67ffe651
|
|
|
jupyterlab-galata-report
Expired
|
8.76 MB |
sha256:87cb186de04e384bef39b19ebe5f38761dba0247d512f9c598446da9c6bb1f0a
|
|
|
jupyterlab-galata-test-assets
Expired
|
4.89 MB |
sha256:88cba8ac2d6d9bcb5236b1aa230134b5c19e725b9a48e9645490afdce3b08c2b
|
|