Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

only show failed issues #15

Merged
merged 9 commits into from
Oct 16, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions .github/workflows/playwright-only-failed.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
name: Playwright Test Report - only failed tests

on:
workflow_run:
workflows: ['CI']
types:
- completed
push:
jobs:
report:
name: Workflow test
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@v2
- name: Check dirs
run: ls
- name: Test reporter
uses: ./
with:
name: Workflow Report
path: playwright-report.xml
reporter: java-junit
show-html-notice: true
list-tests: 'failed'
list-suites: 'failed'
fail-on-error: false
17 changes: 0 additions & 17 deletions __tests__/__outputs__/jest-test-results.md
Original file line number Diff line number Diff line change
Expand Up @@ -405,28 +405,11 @@
|packages/pretty-format/src/__tests__/ReactElement.test.ts|3✅|||64ms|
### ❌ <a id="user-content-r0s75" href="#r0s75">e2e/__tests__/jestChangedFiles.test.ts</a>
```
✅ gets hg SCM roots and dedupes them
✅ gets git SCM roots and dedupes them
✅ gets mixed git and hg SCM roots and dedupes them
✅ gets changed files for git
✅ monitors only root paths for git
✅ does not find changes in files with no diff, for git
✅ handles a bad revision for "changedSince", for git
❌ gets changed files for hg
Error: abort: empty revision range
✅ monitors only root paths for hg
✅ handles a bad revision for "changedSince", for hg
```
### ❌ <a id="user-content-r0s98" href="#r0s98">e2e/__tests__/onlyChanged.test.ts</a>
```
✅ run for "onlyChanged" and "changedSince"
✅ run only changed files
✅ report test coverage for only changed files
✅ report test coverage of source on test file change under only changed files
✅ do not pickup non-tested files when reporting coverage on only changed files
✅ collect test coverage when using onlyChanged
✅ onlyChanged in config is overwritten by --all or testPathPattern
❌ gets changed files for hg
Error: expect(received).toMatch(expected)
✅ path on Windows is case-insensitive
```
97 changes: 97 additions & 0 deletions __tests__/__outputs__/playwright-output-default.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,97 @@
![Tests failed](https://img.shields.io/badge/tests-36%20passed%2C%204%20failed%2C%2020%20skipped-critical)
## ❌ <a id="user-content-r0" href="#r0">fixtures/external/java/playwright-report.xml</a>
**60** tests were completed in **59s** with **36** passed, **4** failed and **20** skipped.
|Test suite|Passed|Failed|Skipped|Time|
|:---|---:|---:|---:|---:|
|[auth.setup.ts](#r0s0)|6✅|||7s|
|[tests/analyze/load-video.spec.ts](#r0s1)|||3⚪|0ms|
|[tests/analyze/seamless-video-playback.spec.ts](#r0s2)|||9⚪|12ms|
|[tests/app.spec.ts](#r0s3)|||1⚪|0ms|
|[tests/grid.spec.ts](#r0s4)|18✅|4❌|3⚪|116s|
|[tests/onboarding.spec.ts](#r0s5)|||4⚪|0ms|
|[tests/statsEngine.spec.ts](#r0s6)|12✅|||36s|
### ✅ <a id="user-content-r0s0" href="#r0s0">auth.setup.ts</a>
```
✅ authenticate as classic admin
✅ authenticate as basketball admin
✅ authenticate as wrestling admin
✅ authenticate as onboarding admin 1
✅ authenticate as onboarding admin 3
✅ authenticate as coachAdmin
```
### ✅ <a id="user-content-r0s1" href="#r0s1">tests/analyze/load-video.spec.ts</a>
```
⚪ record "Time to Video" when loading directly via URL › using manual timings
⚪ record "Time to Video" when loading directly via URL › using Performance API mark
⚪ record "Time to Video" when loading directly via URL › using Performance API measurement
```
### ✅ <a id="user-content-r0s2" href="#r0s2">tests/analyze/seamless-video-playback.spec.ts</a>
```
⚪ during looping playback › when clip repeats, it starts at the beginning
⚪ during sequential playback ("Play All Clips" mode) › when one clip plays through to the next, overlapping video is skipped
⚪ in 'Play All Clips' mode, clip plays from beginning › when clicked on in navigation module
⚪ in 'Play All Clips' mode, clip plays from beginning › with next clip button
⚪ in 'Play All Clips' mode, clip plays from beginning › with previous clip button
⚪ in 'Loop Clips' mode, clip plays from beginning › when clicked on in navigation module
⚪ in 'Loop Clips' mode, clip plays from beginning › with next clip button
⚪ in 'Loop Clips' mode, clip plays from beginning › with previous clip button
⚪ rewind functions normally
```
### ✅ <a id="user-content-r0s3" href="#r0s3">tests/app.spec.ts</a>
```
⚪ App › logs in and loads page
```
### ❌ <a id="user-content-r0s4" href="#r0s4">tests/grid.spec.ts</a>
```
✅ Grid › Mobile Web › Athlete › should not be able to edit data
✅ Grid › Mobile Web › Admin or Coach › should be able to edit data
✅ Grid › Field Sets › should update displayed grid columns after editing
⚪ Grid › Field Sets › should update displayed clip preview fields after editing
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Scout team Points
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Opponent Rebounds
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Steals
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Rebounds
✅ Grid › Basketball Navigation Module › should display clips for opportunities in Period when filtered by Period
✅ Grid › Basketball Navigation Module › should display clips for opportunities that end in a turnover when filtered by Turnovers
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by 3FG Attempts
❌ Grid › Column Sorting › AmFb Column Sets › should display correct data when sorting by OFF FORM column
[chrome] › tests/grid.spec.ts:202:11 › Grid › Column Sorting › AmFb Column Sets › should display correct data when sorting by OFF FORM column › Sort grid by OFF FORM in ascending order
⚪ Grid › Column Sorting › Wrestling Column Sets › should display correct data when sorting by Period column
⚪ Grid › Quick Editor › should be able to edit data from quick editor as an admin or coach
❌ Grid › Data Entry › should open select dropdown options when pressing Spacebar in grid cell
[chrome] › tests/grid.spec.ts:254:9 › Grid › Data Entry › should open select dropdown options when pressing Spacebar in grid cell › double click into column OFF FORM clip number 3
❌ Grid › Data Entry › should be able to use keyboard to navigate horizontal grid and enter data
[chrome] › tests/grid.spec.ts:261:9 › Grid › Data Entry › should be able to use keyboard to navigate horizontal grid and enter data › double click into column OFF FORM clip number 3
❌ Grid › Data Entry › should be able to use keyboard to navigate vertical grid and enter data
[chrome] › tests/grid.spec.ts:277:9 › Grid › Data Entry › should be able to use keyboard to navigate vertical grid and enter data › Select BUNCH from column OFF FORM list
✅ Grid › Data Entry › should display error state for input with invalid data
✅ Grid › Data Entry › confirm auto-fill works correctly
✅ Grid › Tagged data › Wrestling › should display correct wrestler names tagged from Assist
✅ Grid › Tagged data › Wrestling › should display correct score and points tagged from Assist
✅ Grid › Tagged data › Wrestling › should display correct Period tagged from Assist
✅ Grid › Tagged data › Wrestling › should display correct Key Moments tagged from Assist
✅ Grid › Tagged data › Wrestling › should edit cells using the team roster
✅ Grid › Tagged data › Wrestling › should change key moment type and update grid data
```
### ✅ <a id="user-content-r0s5" href="#r0s5">tests/onboarding.spec.ts</a>
```
⚪ Grid › Onboarding › Field Visibility › should successfully display field visibility onboarding prompt
⚪ Grid › Onboarding › Field Visibility › Grid Hotkey Tooltip › should successfully display grid hotkey onboarding prompt
⚪ Grid › Onboarding › Field Visibility › Reorder Field Sets › should successfully display field reorder onboarding prompt
⚪ Grid › Onboarding › Field Visibility › Quick Edit › should successfully display quick edit onboarding prompt
```
### ✅ <a id="user-content-r0s6" href="#r0s6">tests/statsEngine.spec.ts</a>
```
✅ Mock stats engine for speed › Filter by Offense in Phase card
✅ Mock stats engine for speed › Filter by defense in phase card
✅ Mock stats engine for speed › Key stats card stats appear as expected when opponent is selected
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - FG percentage for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - 2FG Makes for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - 2FG Attempts for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - 3FG Makes for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - 3FG Attempts for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - Off. Rebounds for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - Def. Rebounds for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - Assists for Team in Context
✅ Mock stats engine for speed › Selecting a Key Stats filter updates both the Navigation Module and Insights Module cards - Steal for Team in Context
```
21 changes: 0 additions & 21 deletions __tests__/__outputs__/playwright-output-failed.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,33 +6,12 @@
|[tests/grid.spec.ts](#r0s0)|18✅|4❌|3⚪|116s|
### ❌ <a id="user-content-r0s0" href="#r0s0">tests/grid.spec.ts</a>
```
✅ Grid › Mobile Web › Athlete › should not be able to edit data
✅ Grid › Mobile Web › Admin or Coach › should be able to edit data
✅ Grid › Field Sets › should update displayed grid columns after editing
⚪ Grid › Field Sets › should update displayed clip preview fields after editing
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Scout team Points
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Opponent Rebounds
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Steals
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by Rebounds
✅ Grid › Basketball Navigation Module › should display clips for opportunities in Period when filtered by Period
✅ Grid › Basketball Navigation Module › should display clips for opportunities that end in a turnover when filtered by Turnovers
✅ Grid › Basketball Navigation Module › should display correct moment data when filtered by 3FG Attempts
❌ Grid › Column Sorting › AmFb Column Sets › should display correct data when sorting by OFF FORM column
[chrome] › tests/grid.spec.ts:202:11 › Grid › Column Sorting › AmFb Column Sets › should display correct data when sorting by OFF FORM column › Sort grid by OFF FORM in ascending order
⚪ Grid › Column Sorting › Wrestling Column Sets › should display correct data when sorting by Period column
⚪ Grid › Quick Editor › should be able to edit data from quick editor as an admin or coach
❌ Grid › Data Entry › should open select dropdown options when pressing Spacebar in grid cell
[chrome] › tests/grid.spec.ts:254:9 › Grid › Data Entry › should open select dropdown options when pressing Spacebar in grid cell › double click into column OFF FORM clip number 3
❌ Grid › Data Entry › should be able to use keyboard to navigate horizontal grid and enter data
[chrome] › tests/grid.spec.ts:261:9 › Grid › Data Entry › should be able to use keyboard to navigate horizontal grid and enter data › double click into column OFF FORM clip number 3
❌ Grid › Data Entry › should be able to use keyboard to navigate vertical grid and enter data
[chrome] › tests/grid.spec.ts:277:9 › Grid › Data Entry › should be able to use keyboard to navigate vertical grid and enter data › Select BUNCH from column OFF FORM list
✅ Grid › Data Entry › should display error state for input with invalid data
✅ Grid › Data Entry › confirm auto-fill works correctly
✅ Grid › Tagged data › Wrestling › should display correct wrestler names tagged from Assist
✅ Grid › Tagged data › Wrestling › should display correct score and points tagged from Assist
✅ Grid › Tagged data › Wrestling › should display correct Period tagged from Assist
✅ Grid › Tagged data › Wrestling › should display correct Key Moments tagged from Assist
✅ Grid › Tagged data › Wrestling › should edit cells using the team roster
✅ Grid › Tagged data › Wrestling › should change key moment type and update grid data
```
Loading
Loading