GPU memory is occupied but cannot proceed

[r2race]

GPU is fully occupied, as shown in the figure below,：

But training cannot proceed and is stuck at 1/1：

The code can proceed on cpu, but it's too slow，how can I solve this problem

[Becerril42]

I'm not an expert in GPUs and Python, but doesn't the 0% below GPU-Util indicate that no GPU is being used? Are you using Windows or Linux? For Tensorflow 2.11 and above, Python can detect the GPU, but is unable to use it