K8SPXC-1327: Make jemalloc the default memory allocator #2002
+91
−5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
https://perconadev.atlassian.net/browse/K8SPXC-1327 Problem: By default, standard libc allocator is used by PXC. It is often desirable to use jemalloc instead. To do so, use has to configure LD_PRELOAD environment variable. The only way to do this is through k8s secret. Solution: Extended PodSpec object with MySqlAllocator property. If it is empty, omitted or set to 'jemalloc', LD_PRELOAD env variable pointing to jemalloc library will be exported. Otherwise the default allocator will be used.
kamil-holubicki
requested review from
egegunes,
gkech,
hors,
nmarukovich and
pooknull
as code owners
|
|
kamil-holubicki
requested review from
egegunes
and removed request for
egegunes
hors
reviewed
Mar 14, 2025
deploy/cr.yaml
Outdated
| size: 3 | ||
| image: perconalab/percona-xtradb-cluster-operator:main-pxc8.0 | ||
| autoRecovery: true | ||
| # mySqlAllocator: jemalloc |
Collaborator
There was a problem hiding this comment.
In cr we have a commented option with a default value. In our doc, we will add all possible values. Also, you can add them in CRD. It is possible to add validation on CRD level.
Contributor
Author
There was a problem hiding this comment.
In cr we have a commented option with a default value. In our doc, we will add all possible values.
Done
Also, you can add them in CRD. It is possible to add validation on CRD level.
I'm not sure I understand where and what to add.
Contributor
There was a problem hiding this comment.
validation rules are defined using comments called kubebuilder markers: https://book.kubebuilder.io/reference/markers/crd-validation
for example:
- MySQLAllocator string `json:"mysqlAllocator,omitempty"`
+
+ // +kubebuilder:validation:Required
+ // +kubebuilder:validation:Enum={jemalloc,tcmalloc}
+ // +kubebuilder:default=jemalloc
+ MySQLAllocator string `json:"mysqlAllocator,omitempty"`afterwards you need to regenerate manifests: make generate manifests VERSION=main (do this after merging main and fixing conflicts)
https://perconadev.atlassian.net/browse/K8SPXC-1327 Logic simplified. LD_PRELOAD is set always via appc.Env.
egegunes
reviewed
Mar 25, 2025
egegunes
previously approved these changes
Mar 28, 2025
gkech
reviewed
Mar 28, 2025
https://perconadev.atlassian.net/browse/K8SPXC-1327 Addressed review comments.
kamil-holubicki
force-pushed
the
K8SPXC-1327
branch
from
94ebe85 to
9b9576e
Compare
gkech
previously approved these changes
Mar 31, 2025
https://perconadev.atlassian.net/browse/K8SPXC-1628 Extended solution for K8SPXC-1327 to allow usage of tcmalloc.
egegunes
requested changes
Nov 4, 2025
| }...) | ||
| } | ||
|
|
||
| if cr.CompareVersionWith("1.18.0") >= 0 { |
Contributor
There was a problem hiding this comment.
we need to change this version to 1.19.0 since 1.18.0 is already released
Collaborator
commit: 4292959 |
Contributor
|
please also have a look on the unit tests cause they are failing due to the proposed changes. 🙏🏽 |
Contributor
|
I'll address comments and fix tests |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
https://perconadev.atlassian.net/browse/K8SPXC-1327
Problem:
By default, standard libc allocator is used by PXC. It is often desirable to use jemalloc instead. To do so, use has to configure LD_PRELOAD environment variable. The only way to do this is through k8s secret.
Solution:
Extended PodSpec object with MySqlAllocator property. If it is empty, omitted or set to 'jemalloc', LD_PRELOAD env variable pointing to jemalloc library will be exported.
Otherwise the default allocator will be used.
CHANGE DESCRIPTION
Problem:
Short explanation of the problem.
Cause:
Short explanation of the root cause of the issue if applicable.
Solution:
Short explanation of the solution we are providing with this PR.
CHECKLIST
Jira
Needs Doc) and QA (Needs QA)?Tests
compare/*-oc.yml)?Config/Logging/Testability