Skip to content

Conversation

ricardobranco777
Copy link
Contributor

@ricardobranco777 ricardobranco777 commented Aug 28, 2025

This script is a post-processing fail-hook for BATS tests. It fetches previous cloned BATS jobs to check whether we can tag a job as passed by doing a set intersection of all failed jobs.

Related ticket: https://progress.opensuse.org/issues/186786

TODO

Example runs:

$ openqa-bats-review -n https://openqa.suse.de/tests/18971940
INFO: Processing clone chain: 18971940 -> 18971789 -> 18969737
INFO: Job 18971940 has no .tap.txt logs, skipping
INFO: No common failures across clone chain. Tagging as PASSED.
$ openqa-bats-review -n https://openqa.suse.de/tests/18971796
INFO: Processing clone chain: 18971796 -> 18971172 -> 18969587
INFO: Job 18969587 has no .tap.txt logs, skipping
INFO: No common failures across clone chain. Tagging as PASSED.
$ openqa-bats-review -n https://openqa.opensuse.org/tests/5277036
INFO: Processing clone chain: 5277036 -> 5276893
INFO: No common failures across clone chain. Tagging as PASSED.
$ openqa-bats-review -n https://openqa.opensuse.org/tests/5278048
INFO: Processing clone chain: 5278048 -> 5277036 -> 5276893
INFO: No common failures across clone chain. Tagging as PASSED
$ openqa-bats-review -n https://openqa.suse.de/tests/19007064
INFO: Processing clone chain: 19007064 -> 19006783 -> 19006702 -> 19006031 -> 19001173
INFO: Job 19006783 has no TAP logs, skipping
INFO: Job 19006702 has no TAP logs, skipping
INFO: No common failures across clone chain. Tagging as PASSED.
$ openqa-bats-review -n https://openqa.suse.de/tests/19014878
INFO: Processing clone chain: 19014878 -> 19014581 -> 19014531 -> 19012771
INFO: Common failures found across clone chain: buildah-buildah-user.tap.txt:bud-implicit-no-history
$ openqa-bats-review -n https://openqa.suse.de/tests/19014900
INFO: Processing clone chain: 19014900 -> 19014592 -> 19014540 -> 19012854
ERROR: Common failures found across clone chain: buildah-buildah-user.tap.txt:bud-implicit-no-history

Copy link
Contributor

@d3flex d3flex left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also I would like to ask you to laborate on the docstrings.e

Copy link
Contributor

@perlpunk perlpunk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A unit test would be nice

@ricardobranco777 ricardobranco777 force-pushed the bats branch 2 times, most recently from cce6fae to bcc2b26 Compare August 29, 2025 16:05
@ricardobranco777 ricardobranco777 force-pushed the bats branch 6 times, most recently from e39e617 to c1cd1ef Compare August 31, 2025 19:25
@ricardobranco777 ricardobranco777 force-pushed the bats branch 7 times, most recently from 6aa27ce to 61233b8 Compare September 2, 2025 19:13
This script fetches previous cloned BATS jobs to check whether we can
tag a job as passed by doing a set intersection of all failed jobs.

Related ticket: https://progress.opensuse.org/issues/186786
@ricardobranco777 ricardobranco777 marked this pull request as ready for review September 4, 2025 08:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants