Skip to content

Backups can't be stored to a set prefix in a storage location #1991

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wonko opened this issue Mar 10, 2025 · 1 comment
Open

Backups can't be stored to a set prefix in a storage location #1991

wonko opened this issue Mar 10, 2025 · 1 comment

Comments

@wonko
Copy link

wonko commented Mar 10, 2025

Proposal

Documentation states the following (at https://docs.percona.com/percona-operator-for-mysql/pxc/backup-tutorial.html#configure-backup-storage):

Also you can use the storages..s3.prefix option to specify the path (a sub-folder) to the backups inside the S3 bucket. If prefix is not set, backups are stored in the root directory.

However, looking at the CRD definition, there is no prefix under backup.storages.NAME.s3. (see https://docs.percona.com/percona-operator-for-mysql/pxc/operator.html#backupstoragesstorage-names3credentialssecret and below)

Supporting a prefix for all backups makes sense. Sometimes, backup buckets are shared between various systems, as they are provided with specific replication, access and restrictions. It makes no sense to start creating a bucket for each and every database backup, duplicating this for even every PITR and normal backup which is configured. It would even make sense to also add the prefix at the pitr and schedule definition, which would allow structures like bucketname-here/storage-prefix-here-could-be-db-name/backup-or-pitr-prefix-here/object to exist.

Access to certain folders within the backup location can easily be handled with policies (and should) by the infra/ops/sre/...

Use-Case

More efficient re-use and handling of buckets and backups contained within.

Is this a feature you are interested in implementing yourself?

No

Anything else?

No response

@mlec1
Copy link

mlec1 commented Mar 28, 2025

Hi,

the prefix doesn't exist but you can specify bucketname-here/storage-prefix-here-could-be-db-name/backup-or-pitr-prefix-here in the backup.storages.NAME.s3.bucket and it will store your backups in the folder you want.
We are using it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants