Failing JUnit5 assumptions outside of stage are handled as successful test case

[abika]

Hi,

the changes done by #1625 seem to have an unwanted effect: If a JUnit5 assumption outside of a given()/when()/then() stage is failing, this results in a scenario case with "status": "SUCCESS" in the JSON report and no indication of a skipped test or exception is visible.
Therefore in the HTML report the test scenario is shown as successful and the steps are not completely visible (because the test run stops at the assumption exception).

I would expect that in this case the test result would be "ABORTED" as well (and errorMessage and stackTrace should be recorded).

[l-1squared]

Hi, sorry for reacting rather late, missed you in my email feed.

Could you clarify a bit what you mean to make analysis eaiser for me?
So did you place the assumption in a scenario / Junit5 before method or elsewhere?

[abika]

Hi, the wrong behavior can (only) be observed if a JUnit5 assumption is failing directly in the test method :

  @Test
  void assumption_test() {
    Assumptions.abort();

    given().some_state();
    when().some_action();
    then().some_outcome();
  }

This is results in a JSON file containing "status": "SUCCESS" and containing no errorMessage and stackTrace fields, and no steps.