Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add WMAS Test Suite to Test262 Runners section in README #4335

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

louaybassbouss
Copy link

Integrates Test262 ECMAScript tests into the WMAS Test Suite, built on Web Platform Tests (WPT). Ensures Test262 results are compatible with the WPT format.

Integrates Test262 ECMAScript tests into the WMAS Test Suite, built on WPT. Ensures Test262 results are compatible with the WPT format.
@louaybassbouss louaybassbouss requested a review from a team as a code owner November 27, 2024 15:58
@Ms2ger
Copy link
Contributor

Ms2ger commented Nov 28, 2024

Can I have a pointer to something that explains how this runs test262 tests?

@louaybassbouss
Copy link
Author

hello @Ms2ger apologies for late reply I missed notification to this message. Here are some details to the steps how we integrate the Test262 ECMAScript tests and how you can test them:

  • Web Media API Test Suite: this is the main GitHub Repo of the CTA WAVE WMAS Test Suite. It integrates tests from different sources WPT (Mainly Web Media API Tests), Test262 and Khronos WebGL.
    • One goal is to run tests on embedded devices like TVs and Set-Top-Boxes and in a unified test suite optimised for these kind of devices with limited interaction and performance capabilities in an automatic way.
    • Another goal is to provide test results and test reports in a unified format compatible with the WPT Format.
    • How we integrate Tests from the various Test Suites is basically done via an import script, here is an example for WMAS2023 Version.
  • Lets focus on Test262 ECMAScript tests:
    • After we import the Test262 ECMAScript tests (see import script), we generate HTML wrapper for each single ECMAScript. Example: generated ECMAScript tests for WMAS2023 are available in this folder
    • You can deploy and run the WMAS Test Suite locally as documented in README. But you can use the online WMAS Test Suite for example for WMAS2023 you can use this link: https://webapitests2023.ctawave.org/_wave/index.html. This is designed to run on TV devices, but you can also run it in Desktop Browsers as well. Here are some instructions how to run it in Desktop Browser:
      1. Open: https://webapitests2023.ctawave.org/_wave/index.html (tab1)
      2. Click Configure Session. This will open a new Tab (tab2).

        You can also scan the QR code and configure the session from a mobile device. This is helpful if the Test running on a TV.

      3. In the new tab (tab2), deselect all the APIs by selecting none and only select ecmascript. Then click on Start Session.
      4. Now the tests will run in tab1 and you can monitor the progress of the session in tab2.
      5. You can download the test results in JSON Format at any time on the progress page. An HTML report will be generated when the test session is completed.

Let me know if you have additional questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants