Save ppo_params along with env_cfg, and load ppo_params automatically when feeding checkpoint path and setting play_only

[dementrock]

UX would be improved if:

• ppo_params were automatically saved as json
• load them when feeding checkpoint path and setting play_only
• Also auto set num_timesteps to 0 when play_only

[annika-nv]

+1 this would be very helpful!

[kevinzakka]

Thanks @dementrock!

Will address these.

[karthyyy]

@kevinzakka ,

Whether it's implemented ? Saw a similar request in

google/brax#438

But the solution is not working for me.

Regards
Karthik

[btaba]

Hi @karthyyy did you open a related issue in brax RE google/brax@8526f9a? We'll eventually bubble up the new model saving/loading API in the training script in playground