Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move Various and TestResultsTests into UnitTests #442

Open
Garados007 opened this issue Mar 20, 2023 · 0 comments
Open

Move Various and TestResultsTests into UnitTests #442

Garados007 opened this issue Mar 20, 2023 · 0 comments

Comments

@Garados007
Copy link
Member

The test experiment UnitTests allows to better structure the tests and do instrumentation at the same time. Moving the Various and TestResultsTests test experiments into UnitTests allows us to get a coverage report of higher quality as if we instrument each test experiment. Doing this we also need less boilerplate code for test setup and we need less steps in the CI pipeline which also results in faster test execution.

I would only move these two test experiments into UnitTests as the other ones do test a different aspect that is difficult to do in UnitTests:

  • DebugModeTests tests if the debugger works with igortests. Doing this in UnitTests needs nested RunTests execution.
  • Tracing does basic tracing tests which is a requirement for UnitTests. If Tracing fails the execution of UnitTests is unreliable.
  • VeryTinyTestEnvironment does test the basic setup and assertions. This is a requirement for all other test experiments.
  • IMUnitTests is similar to UnitTests but tests inside an independent module. It has all the setup similar to UnitTests done.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant