Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock. #1315

Open
c0g opened this issue Aug 20, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@c0g
Copy link

c0g commented Aug 20, 2024

Describe the bug

Running jax and clearml in the same process, I get

/home/tom/miniforge3/envs/tomrl/lib/python3.10/site-packages/clearml/utilities/process/mp.py:629: RuntimeWarning:

os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.

I haven't yet got it to run far enough to see if there's indeed a deadlock. Curious if anyone has seen this before.

@c0g c0g added the bug Something isn't working label Aug 20, 2024
@jkhenning
Copy link
Member

Hi @c0g,

You can try setting sdk.development.report_use_subprocess: false in your clearml.conf file and see if it helps

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants