K8SPXC-1594 group kind concurrency through MAX_CONCURRENT_RECONCILES

[gkech]

CHANGE DESCRIPTION

Problem:
Short explanation of the problem.

Cause:
Short explanation of the root cause of the issue if applicable.

Solution:
Short explanation of the solution we are providing with this PR.

CHECKLIST

Jira

• Is the Jira ticket created and referenced properly?
• Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
• Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

• Is an E2E test/test case added for the new feature/change?
• Are unit tests added where appropriate?
• Are OpenShift compare files changed for E2E tests (compare/*-oc.yml)?

Config/Logging/Testability

• Are all needed new/changed options added to default YAML files?
• Are all needed new/changed options added to the Helm Chart?
• Did we add proper logging messages for operator actions?
• Did we ensure compatibility with the previous version or cluster upgrade process?
• Does the change support oldest and newest supported PXC version?
• Does the change support oldest and newest supported Kubernetes version?

[JNKPercona]

Test Name	Result	Time
affinity-8-0	passed	00:06:14
auto-tuning-8-0	passed	00:19:14
cross-site-8-0	passed	00:35:15
custom-users-8-0	failure	00:09:12
demand-backup-cloud-8-0	passed	00:57:25
demand-backup-encrypted-with-tls-8-0	passed	00:45:45
demand-backup-8-0	passed	00:41:00
demand-backup-flow-control-8-0	passed	00:10:59
demand-backup-parallel-8-0	passed	00:09:11
demand-backup-without-passwords-8-0	passed	00:15:20
haproxy-5-7	passed	00:14:52
haproxy-8-0	passed	00:14:15
init-deploy-5-7	passed	00:17:09
init-deploy-8-0	passed	00:17:32
limits-8-0	passed	00:12:09
monitoring-2-0-8-0	passed	00:22:46
monitoring-pmm3-8-0	passed	00:18:20
one-pod-5-7	passed	00:14:50
one-pod-8-0	passed	00:13:57
pitr-8-0	passed	00:43:19
pitr-gap-errors-8-0	passed	00:57:12
proxy-protocol-8-0	passed	00:09:40
proxysql-sidecar-res-limits-8-0	passed	00:08:21
pvc-resize-5-7	passed	00:15:21
pvc-resize-8-0	passed	00:16:15
recreate-8-0	passed	00:16:50
restore-to-encrypted-cluster-8-0	passed	00:26:00
scaling-proxysql-8-0	passed	00:08:24
scaling-8-0	passed	00:10:54
scheduled-backup-5-7	passed	01:04:58
scheduled-backup-8-0	passed	01:01:33
security-context-8-0	passed	00:25:39
smart-update1-8-0	passed	00:33:28
smart-update2-8-0	passed	00:38:45
storage-8-0	passed	00:10:33
tls-issue-cert-manager-ref-8-0	passed	00:08:48
tls-issue-cert-manager-8-0	passed	00:11:28
tls-issue-self-8-0	passed	00:13:20
upgrade-consistency-8-0	passed	00:10:44
upgrade-haproxy-5-7	passed	00:24:38
upgrade-haproxy-8-0	passed	00:25:00
upgrade-proxysql-5-7	passed	00:13:55
upgrade-proxysql-8-0	failure	00:36:23
users-5-7	passed	00:24:46
users-8-0	passed	00:26:46
validation-hook-8-0	passed	00:01:42

Summary	Value
Tests Run	46/46
Job Duration	03:19:38
Total Test Time	17:20:30

commit: 1e2eac2
image: perconalab/percona-xtradb-cluster-operator:PR-2228-1e2eac2d