Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NAS encounters the issue about network slow, that causes the migrate task failure, however, network is normal. #143

Open
LiuWhale opened this issue Oct 29, 2024 · 8 comments

Comments

@LiuWhale
Copy link

LiuWhale commented Oct 29, 2024

System

Linux 4.4.302+ #69057 SMP Fri Jan 12 17:02:59 CST 2024 x86_64 GNU/Linux synology_apollolake_918+

Docker version

  • Docker version 20.10.23, build 876964a

Python version

  • 3.11.5

wandb version

  • 0.18.5
docker run --rm -d -e LICENSE=mylicense -p 6009:8080  --name wandb-local wandb/local

Image
Image
Image

@LiuWhale LiuWhale changed the title NAS eccounter the issue about network slow, that causes the migrate task failure, however, network is normal. NAS eccounters the issue about network slow, that causes the migrate task failure, however, network is normal. Oct 29, 2024
@luisbergua
Copy link

Hey @LiuWhale, thanks for writing in! Would you mind sharing which version are you running currently? I would recommend ensuring that you're running the latest version (see here, 0.61.0). If this still fails, could you please try running the steps here and seeing if that causes any issues? By following those you shouldn't face any issue, and can apply the license in the UI so curious to know if this would work for you.

@wandb wandb deleted a comment from exalate-issue-sync bot Oct 29, 2024
@wandb wandb deleted a comment from exalate-issue-sync bot Oct 29, 2024
@LiuWhale
Copy link
Author

Hey @LiuWhale, thanks for writing in! Would you mind sharing which version are you running currently? I would recommend ensuring that you're running the latest version (see here, 0.61.0). If this still fails, could you please try running the steps here and seeing if that causes any issues? By following those you shouldn't face any issue, and can apply the license in the UI so curious to know if this would work for you.

I tried with wandb command, but an issue is shown as below, that's why run server manually.
Image

@LiuWhale
Copy link
Author

When I try with wandb docker-run command, new issue is showed up.
Image

@LiuWhale LiuWhale changed the title NAS eccounters the issue about network slow, that causes the migrate task failure, however, network is normal. NAS encounters the issue about network slow, that causes the migrate task failure, however, network is normal. Oct 30, 2024
@luisbergua
Copy link

Thanks for sharing this @LiuWhale! Would you mind sharing what version are you using? Also, I see the image was created 2 weeks ago, so I would recommend removing it and the container and trying again in a fresh environment with the wandb server start command. It might be that there's something wrong with your current image

@LiuWhale
Copy link
Author

LiuWhale commented Oct 30, 2024

Image
The wandb image is latest version, same as docker hub’s one. The digest code is same too.

Thanks for sharing this @LiuWhale! Would you mind sharing what version are you using? Also, I see the image was created 2 weeks ago, so I would recommend removing it and the container and trying again in a fresh environment with the wandb server start command. It might be that there's something wrong with your current image

@LiuWhale
Copy link
Author

I’m considering about the influence of system, the image is running well on Ubuntu, after all.

@luisbergua
Copy link

Hi @LiuWhale, thanks for confirming this! Yes that could be affecting, I would recommend trying in a fresh environment from scratch (and maybe a different machine). Please let me know if you still see the issue after doing that!

@luisbergua
Copy link

Hey Liu, closing this for now but feel free to re-open if you need any other assistance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants