[RFE] Ability to execute tests in order

[jmle]

Some tests that come from windup require other tests to be executed before them, mostly tagging tests. If a tagging process has been executed previously, the hasTags condition will succeed; otherwise it will fail.

At the moment tests are not executed in order, so it would be good to have an option at the root level of the tests file to execute that particular set of tests in order.

[konveyor-ci-bot]

This issue is currently awaiting triage.
If contributors determine this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.
The triage/accepted label can be added by org members.

[shawn-hurley]

I don't love the idea of a test not being idempotent; what would it take to make the tests self-contained? (If it needs tags, does it run the tagging rules?)

[jmle]

@shawn-hurley Basically create some tags artificially in this case. I agree that idempotent tests are ideal, but running a test suite in a certain order isn't that uncommon of a practice. IIRC some windup tests depended on this.

[shawn-hurley]

I would like to understand the use case better, as I can only think of the tagging rules needing to be run before running rule under test. What are some other reasons?

[jmle]

I would like to understand the use case better, as I can only think of the tagging rules needing to be run before running rule under test. What are some other reasons?

At the moment this is the only use case I can think of.

Edit: just to clarify, this would be an option added to the test suite in case it had to be run in order, nothing more. The default would be run in any order.