Inquiry about checkpointing

[yipingji]

Hi,

I am trying to implement checkpointing into my codebase. At the stage of saving checkpoint, the job just gets stuck and created an empty folder under save directory.

[tsunghsienlee]

@yipingji , are you using the checkpoint solution provided in https://github.com/facebookresearch/optimizers/tree/main/distributed_shampoo#checkpointing-support?

[yipingji]

yes

[tsunghsienlee]

Hi @yipingji ,

Just want to let you know we have @wz337 and @jialun-zhang looking into this. Likely we will have a standard PyTorch checkpoint solution soon.