Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Summarize Rocket-E2E results from Remote Desktop #165

Open
MathieuLamiot opened this issue Nov 3, 2024 · 1 comment
Open

Summarize Rocket-E2E results from Remote Desktop #165

MathieuLamiot opened this issue Nov 3, 2024 · 1 comment
Assignees

Comments

@MathieuLamiot
Copy link
Contributor

MathieuLamiot commented Nov 3, 2024

Context
We now have many test results from Rocket-E2E from Remote Destkop: https://wp-media.slack.com/archives/C05NH7JU4S2/p1729513024781269

Expected outcome

Create an excel (or google sheet) file with:

  • One column per test in the test plan
  • One line per test report
    For each report/test, mark it as OK/KO.

From there, identify:

  • Tests that are always passing
  • Tests that are always failing
  • Flaky tests

For failing/flaky tests, check if there is already a GH issue or create it. Then reference it in the Excel file.

Warning: Note that some fixes were applied between the first and last reports, so let's take that into account. For instance, tests failing in the first reports because of WP Rocket not being properly uninstalled should not be considerd flaky because they have been fixed in the meantime, etc.

@MathieuLamiot
Copy link
Contributor Author

I created first obvious issues: #166 #167 #168

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants