Add coverage support to verify command

[dudicoco]

Hi,

The opa test command has a --coverage flag which outputs the tests coverage.

Can this be added to conftest verify?

It would be great if it would be possible to make it exit with exit code 1 if coverage is not 100.

Thanks

[jpreese]

Not opposed to the idea of returning a non-zero error code based on coverage, but would lean more towards something along the lines of:

conftest verify ... --coverage=80

Where 80 represents the minimum percentage

NOTE: OPA binary exposes --coverage to enable coverage output (which also disables tracing) and also exposes a --threshold flag to set it. May be worth using this approach to keep synergy with the OPA binary.

[dudicoco]

@jpreese I did write in my first post that the opa test command has a --coverage flag, perhaps you missed it. :)

When do you think this feature could be added to conftest as well?

[jpreese]

Yep! I saw it, just leaving a note that they split coverage and threshold into two different flags, rather than just a single one.

At the moment, I don't have a timeline just whenever someone opens a pull request 😄

[dudicoco]

Thanks @jpreese.

Not a big deal, for now i'm using the opa binary for unit tests + coverage check.

[delamart]

Opa doesn't have the parse_config or parse_config_file functions so I can't do coverage when I use thoses.