bug: flake in test/e2e/apibinding TestAPIBindingCRDs due to client cache being modified

[gman0]

Describe the bug

test/e2e/apibinding TestAPIBindingCRDs failed with panic: cache *v1alpha1.LogicalCluster modified

Logs: build-log.txt

Steps To Reproduce

N/A

Expected Behaviour

We shouldn't overwrite objects in client cache.

Additional Context

No response