How to finetune Internvl3.0 on NVIDIA GeForce RTX 3090 with fp16?

Thanks for your great work.
I only have 8 * NVIDIA GeForce RTX 3090（8*24G）GPU. It seems that 3090 only support fp16. Can I finetune Internvl 3.0 on it and how?
I have modified shell script `torchrun --bf16 False --fp16 True`, but it not works. I got `dtypes mismatch` error.