Update comments in demo notebooks #305
ui_notebooks_test.yaml
on: pull_request
verify-3_widget_example
9m 23s
Annotations
7 errors and 1 notice
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook:
ui-tests/tests/widget_notebook_example.test.ts#L63
1) tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
Error: Screenshot comparison failed:
1691 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts-snapshots/widgets-cell-0-linux.png
Received: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-0-actual.png
Diff: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-0-diff.png
61 |
62 | if (captures[i]) {
> 63 | expect.soft(captures[i]).toMatchSnapshot(image, { threshold: 0.7}); // Compare pre-existing capture
| ^
64 | continue;
65 | }
66 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:63:34
|
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook:
ui-tests/tests/widget_notebook_example.test.ts#L63
1) tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
Error: Screenshot comparison failed:
Expected an image 844px by 231px, received 844px by 232px. 4635 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts-snapshots/widgets-cell-2-linux.png
Received: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-2-actual.png
Diff: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-2-diff.png
61 |
62 | if (captures[i]) {
> 63 | expect.soft(captures[i]).toMatchSnapshot(image, { threshold: 0.7}); // Compare pre-existing capture
| ^
64 | continue;
65 | }
66 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:63:34
|
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook:
ui-tests/tests/widget_notebook_example.test.ts#L63
1) tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
Error: Screenshot comparison failed:
103 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts-snapshots/widgets-cell-3-linux.png
Received: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-3-actual.png
Diff: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-3-diff.png
61 |
62 | if (captures[i]) {
> 63 | expect.soft(captures[i]).toMatchSnapshot(image, { threshold: 0.7}); // Compare pre-existing capture
| ^
64 | continue;
65 | }
66 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:63:34
|
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook:
ui-tests/tests/widget_notebook_example.test.ts#L63
1) tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
Error: Screenshot comparison failed:
132 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts-snapshots/widgets-cell-4-linux.png
Received: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-4-actual.png
Diff: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-4-diff.png
61 |
62 | if (captures[i]) {
> 63 | expect.soft(captures[i]).toMatchSnapshot(image, { threshold: 0.7}); // Compare pre-existing capture
| ^
64 | continue;
65 | }
66 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:63:34
|
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook:
ui-tests/tests/widget_notebook_example.test.ts#L63
1) tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
Error: Screenshot comparison failed:
Expected an image 908px by 91px, received 908px by 85px. 3612 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts-snapshots/widgets-cell-5-linux.png
Received: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-5-actual.png
Diff: /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/test-results/tests-widget_notebook_exam-c3288-ll-outputs-and-test-widgets/widgets-cell-5-diff.png
61 |
62 | if (captures[i]) {
> 63 | expect.soft(captures[i]).toMatchSnapshot(image, { threshold: 0.7}); // Compare pre-existing capture
| ^
64 | continue;
65 | }
66 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:63:34
|
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook:
ui-tests/tests/widget_notebook_example.test.ts#L197
1) tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
Error: expect(received).toContain(expected) // indexOf
Expected substring: "(<CodeFlareClusterStatus.UNKNOWN: 6>, False)"
Received string: " 🚀 CodeFlare Cluster Status 🚀··············································································································
╭───────────────────────────────────────────────────────────────────────────────╮·
│ Name │·
│ widgettest-1 Inactive ❌ │·
│ │·
│ URI: ray://widgettest-1-head-svc.ui-test-namespace.svc:10001 │·
│ │·
│ Dashboard🔗 │·
│ │·
╰───────────────────────────────────────────────────────────────────────────────╯··
[9]:(<CodeFlareClusterStatus.STARTING: 2>, False)"
195 |
196 | if (expectedMessage) {
> 197 | expect(newOutput).toContain(expectedMessage);
| ^
198 | }
199 |
200 | return lastCellOutput;
at runPreviousCell (/home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:197:23)
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/widget_notebook_example.test.ts:168:5
|
verify-3_widget_example
Process completed with exit code 1.
|
🎭 Playwright Run Summary
1 failed
tests/widget_notebook_example.test.ts:28:7 › Visual Regression › Run notebook, capture cell outputs, and test widgets
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
ipywidgets-test-assets
|
6.34 MB |
|
ipywidgets-test-report
|
6.54 MB |
|