Veleor Azure AKS Cluster Backup: PV and PVC Restoration Across Region

[dhayalan85]

I am currently working on backing up an Azure AKS cluster deployed in the UK South region. My intention is to perform a complete backup of the cluster, including all persistent volumes (PV) and persistent volume claims (PVC). Additionally, I have another AKS cluster running in the Southeast Asia region, and I would like to restore the data from the UK South region to southeastasia. While restoring through velero I am getting error snapshot not available destination region.

Could you please provide guidance on whether it is possible to execute this backup and restore process without any data loss?

[dhayalan85]

Any update on this?

[kaovilai]

@mayankagg9722 Any recommendations?

[dhayalan85]

@mayankagg9722 We are in the process of planning to restore data from one region to another and would greatly appreciate your insights on how to effectively perform this restoration using Velero.

Could you please provide guidance on the necessary steps or best practices for executing this task?

[mayankagg9722]

Hello @dhayalan85, We currently only support cross region restore (CRR) to only paired azure regions. As UK South is paired with UK West, currently restore to Southeast Asia will not be supported. Regions of choice capability is not yet supported for AKS Backup.

https://learn.microsoft.com/en-us/azure/backup/azure-kubernetes-service-cluster-backup-support-matrix#other-limitations-for-vaulted-backup-and-cross-region-restore

[dhayalan85]

@mayankagg9722 Thank you very much for your reply. I just wanted to clarify my understanding regarding the backup restrictions. From what I gather, the restrictions apply to Azure backup and not to Velero. Am I right in this understanding?

[anshulahuja98]

You either need to use the FSBackup solution or the CSI datamover solution of velero to enable this use case.
Using those approaches the data of the volumes is copied by kopia to a storage account and then you can restore from such backups in the target cluster in target region.

I am assuming you are using either Azure Plugin based snapshots or CSI snapshots which underlying is Azure Disk Snapshot etc.
Those resources are only scoped to 1 region. By using kopia you copy the data of the disks to a central location from which you can hydrate to any region of your choice.

https://velero.io/docs/main/file-system-backup/
https://velero.io/docs/main/csi-snapshot-data-movement/

[dhayalan85]

@anshulahuja98 I have shared all the logs and backup and restore details through email. Could you please provide any advice or insights on how I can resolve this? Your help and support would be greatly appreciated.

[anshulahuja98]

you have shared the Backup describe command which is not enough to make any interpretation.
Please use these for generating debug bundle for backup/restore.
https://velero.io/docs/main/troubleshooting/

You can also use the velero-users slack channel where other users can help you for basic setup problems.

Currently I don't see enough details in this discussion to suggest any fix.

[dhayalan85]

@anshulahuja98 Thank you for your assistance thus far. Before proceeding further, I would like to confirm whether it is possible to restore data from the UK South region to the Southeast Asia region. Your expertise and confirmation on this matter would be greatly appreciated.

[anshulahuja98]

Yes in my opinion it should work.

[dhayalan85]

@anshulahuja98 Sure. I will check and get back to you as soon as possible.