ci: Rerun pytest tests in case of failures #3769
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Julien Jerphanion <[email protected]>
|
As it may be very convenient to not restart failed tests manually, I don't think it's always due to network issues in our case. I guess this PR is opened due to the multiple recent tests failures that we are encountering, but in my opinion, we should rather investigate the root cause (as it seems to abort IIRC or terminate unexpectedly) and rerunning tests automatically after failure will prevent us from doing that thoroughly. |
|
This could be done on the main branch once the PR has been merged though (I don't know if there is an easy way to do that). |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Sporadic test failures due to reasons we cannot control (e.g. network) make an entire workflow fail.
This workflow need to be rerun manually, which takes extra time (up to 40 minutes) and distracts from work.
This proposes to automatically rerun test if they fail up to 3 times thanks to
pytest-rerunfailures.