Sonobuoy e2e nigthly tests

[maci3jka]

This pr introduces Sonobuoy end-to-end test for canonical Kubernetes.

[bschimke95]

Going in the right direction - a couple of comments

[bschimke95]

Please add the pull_request tag to the workflow, so that we can see that the test actually runs and passes (to be removed before merging).

[maci3jka]

Please add the pull_request tag to the workflow, so that we can see that the test actually runs and passes (to be removed before merging).
here's build
https://github.com/canonical/k8s-snap/actions/runs/11218620215/job/31182795421?pr=715

[bschimke95]

I see that the test is marked as succeeded but the sonobouy test failed:

17:00:17       e2e   global   complete   failed   Passed:  0, Failed:  0, Remaining:402
17:00:17 Sonobuoy has completed. Use `sonobuoy retrieve` to get results.
sonobuoy_e2e.tar.gz
Plugin: e2e
Status: failed
Total: 6607
Passed: 398
Failed: 8
Skipped: 6201

Failed tests:
 [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]
 [sig-network] HostPort validates that there is no conflict between pods with same hostPort but different hostIP and protocol [LinuxOnly] [Conformance]
 [sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
 [sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]
 [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]
 [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]
 [sig-network] Services should serve endpoints on same port and different protocols [Conformance]
 [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]

The Ci job should fail if the underlying test fails. No one will look at the reports if the do not fail.

[bschimke95]

LGTM, please remove the pull_request marker now, then we can merge this.
Great work!

[maci3jka]

on moonray only two test failed https://github.com/canonical/k8s-snap/actions/runs/11323063651/job/31484966495?pr=715

[bschimke95]

As written in MM: those tests fail for a reason (non-multinode cluster).
Please resolve this issue before removing it from the pull request run.

[bschimke95]

going in the right direction

[bschimke95]

LGTM, final nit then we can merge this.

[bschimke95]

Once the tests pass ofc.

[louiseschmidtgen]

Thanks for adding the test @maci3jka , please have a look at my comments.