RL training

[hgybrave]

Hi,
Have you tried using the files from this project for RL training?
I've seen other projects using isaacsim for RL training that require building the model on isaaclab, but this project doesn't have model files. Therefore, I'd like to ask how to use this project for RL training in a custom environment.

Thanks！

[haoyuma2002814]

Hi,

I am assuming you are talking about using OceanSim in isaac lab context.

What do you mean by "model" for RL training? Do you mean the config files in the training script?

OceanSim provides methods for underwater sensor simulation in Isaac Sim, which emphasizes the real-time visualizations, synthetic data, and ROS\middleware, which contrasts to environment parallellism in lab.

To adapt this to the lab context, fundamental method behind the sensor simulation can be transferred but API is different between lab and sim. So expanding our sensor simulation to isaac lab only posts engineering work.

If you are not using sensor's modality in RL training, this repo direclty builds upon isaac lab that may solve your problem.

Feel free to post more questions if you are confused or I interpreted wrongly.

Thank you.