DDPO?

[rteehas]

I've been building off of the TRL implementations of DDPO, e.g. in examples/scripts/ddpo.py or trl/trainer/ddpo_config.py, but it seems like they've all been removed recently. Why and where can I find them?

[qgallouedec]

Yes, indeed, we removed it because usage was very low. I recommend either using an old version of TRL that contains DDPO (TRL 0.22), or even better, creating your own repository with the implementation taken from TRL to maintain it