Does kokkos fft support single node multi-gpu rc and cr 3d fft?

[llodds]

Single process but multiple gpus using memory copy. Target for both AMD and NVIDIA gpus. Thanks.

[yasahi-hpc]

We do not support that yet
Do you consider cufftXt capability?
I guess we can support that through Kokkos partition_space

[llodds]

Yes we do use cufftxt now targeting on Nvidia GPU only but looking for a portable solution now.

[yasahi-hpc]

Sure
Do you have a minimum working example that includes what you would like to achieve?
I can try to prototype based on that

[llodds]

https://github.com/llodds/HPC_demos/blob/master/cufft_rc_mgpu/test_cufft_rc_mgpu.cu#L6

Here it is. I have stripped away the physics part. It's pure forward and inverse multi-GPU fft testing. Thanks.

[yasahi-hpc]

Thanks
I will give it a try

[yasahi-hpc]

I found that this capability is difficult to support
We need an uniform interface for all backends but only CUDA and HIP backends offer this capability
If you are targeting only NVIDIA and AMD GPUs, probably you can rely on hipfft which supports NVIDIA and AMD GPUs

If you need fully portable solution, we will offer the fully distributed APIs on top of MPI in one or two months

[llodds]

Thanks for the info!