[HANDS-ON BUG] mlagents-learn: command not found

[nnilayy]

Describe the bug

The current Unit-5 and Bonus-Unit-1 notebooks, using the ML-Agents library, fail at the training step when executing the mlagents-learn command, indicating the mlagents-learn command is not found.

Notebooks' Links
(1)Unit-5: https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/notebooks/unit5/unit5.ipynb
(2)Bonus-Unit-1: https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/notebooks/bonus-unit1/bonus-unit1.ipynb
(3)Bonus_Unit-1: https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/notebooks/bonus-unit1/bonus_unit1.ipynb

Material

• Did you use Google Colab? Yes

If not:

• Your Operating system (OS)
• Version of your OS

Reason

This error is due to a compatibility issue between ML-Agents Python requirements and Colab's Latest Python version.

The ML-Agents library currently supports Python versions from Python 3.10.1 to Python 3.10.12, as specified in the setup files (ml-agents/ml-agents/setup.py and ml-agents-env/ml-agents/setup.py after cloning).

However, the latest Python version in Colab is Python 3.11.11, which is not supported by the library.

This version mismatch causes the installation step to fail silently, leading to the subsequent errors when the mlagents-learn or related commands are executed.

Fix

This can be solved by creating a new venv in Colab with a Python version that is supported by the with the ML-Agents library.

I have submitted a pull request to resolve this issue and have updated the documentation to reflect this change. Additionally, the notebook instructions have been updated to guide users on how to adjust the Python version if related issue arises in the future.