Stuck on initializing deepspeed distributed: GLOBAL_RANK

[SunHongyang10]

Thank you for this wonderful job.

I meet a problem when I train the model.

The training stuck on initializing deepspeed distributed: GLOBAL_RANK, I didn’t find a solution. Have you met this problem before?

[leonpohl]

Same issue here