Skip to content

Navigation Menu

Appearance settings

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

vwxyzjn / cleanrl Public

Notifications You must be signed in to change notification settings
Fork 784
Star 7.3k

Code
Issues 54
Pull requests 26
Discussions
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security
Insights

Adding MPO and DMPO#392

Open

Jogima-cyber wants to merge 27 commits intovwxyzjn:mastervwxyzjn/cleanrl:masterfrom

Jogima-cyber:masterJogima-cyber/cleanrl:masterCopy head branch name to clipboard

Conversation Commits27 (27)Checks Files changed

Open

Adding MPO and DMPO#392
Jogima-cyber wants to merge 27 commits intovwxyzjn:masterfrom
Jogima-cyber:master

Commits

Commits on May 23, 2023

Adding MPO with TD(n) critic target and MPO with TD(n) critic target and distributional critic. Adding partial doc for the first algorithm.
Jogima-cyber
committed
Solving pre-commit issues for mpo_tdn_continuous_action.py
Jogima-cyber
committed
Solving pre-commit issues for mpo_tdn_continuous_action.py
Jogima-cyber
committed
Solving pre-commit issues for mpo_tdn_continuous_action.py and dmpo_continuous_action.py
Jogima-cyber
committed
Solving pre-commit issues for mpo_tdn_continuous_action.py and dmpo_continuous_action.py
Jogima-cyber
committed
Solving pre-commit issues for mpo_tdn_continuous_action.py and dmpo_continuous_action.py
Jogima-cyber
committed

Commits on May 24, 2023

Adding a missed implementation detail to mpo_tdn_continuous_action.py: critic targets are averaged across several actions sampled from the target policy. Should be added to dmpo too; TBD.
Jogima-cyber
committed
Soving some pre-commit issues
Jogima-cyber
committed
Solving minor bug.
Jogima-cyber
committed
Minor bugs.
Jogima-cyber
committed
Minor bugs.
Jogima-cyber
committed
Other implementation detail missed: 1. critic loss is scaled with 0.5 2. q values for policy improvement are taken from the target qf.
Jogima-cyber
committed
Bug and pre-commit issue
Jogima-cyber
committed

Commits on May 26, 2023

Adding several implementation detail.
Jogima-cyber
committed
Solving pre-commit issues
Jogima-cyber
committed
Solving pre-commit issues
Jogima-cyber
committed

Commits on May 27, 2023

Solving new differences and repairing DMPO.
Jogima-cyber
committed
Solving pre-commit issues.
Jogima-cyber
committed
Solving pre-commit issues.
Jogima-cyber
committed

Commits on May 29, 2023

Small changes.
Jogima-cyber
committed
Pre-commit issues
Jogima-cyber
committed
Adding environment interaction network.
Jogima-cyber
committed
Env actor update should be with target actor, not online actor
Jogima-cyber
committed

Commits on Jun 19, 2023

Downgrading gym so that it matches with the gym version used in cleanRL
Jogima-cyber
committed
Solving bugs related to latest commit
Jogima-cyber
committed
Solving bugs related to latest commit
Jogima-cyber
committed
Solving bugs related to latest commit
Jogima-cyber
committed

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.