Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] Create new release for vllm compatibility #141

Closed
2 of 3 tasks
keith opened this issue Dec 17, 2024 · 3 comments
Closed
2 of 3 tasks

[Question] Create new release for vllm compatibility #141

keith opened this issue Dec 17, 2024 · 3 comments
Assignees
Labels
question Further information is requested

Comments

@keith
Copy link

keith commented Dec 17, 2024

Required prerequisites

  • I have read the documentation https://nvitop.readthedocs.io.
  • I have searched the Issue Tracker that this hasn't already been reported. (comment there if it has.)
  • I have tried the latest version of nvitop in a new isolated virtual environment.

Questions

Because of conflicting dependency issues with the latest nvitop release (1.3.1), you cannot install the latest vllm in the same virtualenv with nvitop:

$ pip3 install vllm==0.6.4 nvitop
ERROR: Cannot install nvitop==0.10.0, nvitop==0.10.1, nvitop==0.10.2, nvitop==0.11.0, nvitop==0.9.0, nvitop==1.0.0, nvitop==1.1.1, nvitop==1.1.2, nvitop==1.2.0, nvitop==1.3.0, nvitop==1.3.1, nvitop==1.3.2 and vllm==0.6.4 because these package versions have conflicting dependencies.

The conflict is caused by:
    vllm 0.6.4 depends on nvidia-ml-py>=12.560.30
    nvitop 1.3.2 depends on nvidia-ml-py<12.536.0a0 and >=11.450.51
    vllm 0.6.4 depends on nvidia-ml-py>=12.560.30
    nvitop 1.3.1 depends on nvidia-ml-py<12.536.0a0 and >=11.450.51
    vllm 0.6.4 depends on nvidia-ml-py>=12.560.30
    nvitop 1.3.0 depends on nvidia-ml-py<12.536.0a0 and >=11.450.51
    vllm 0.6.4 depends on nvidia-ml-py>=12.560.30
...

This is fixed @ HEAD so it would be great if there was a new pypi release with this version bump fix!

@keith keith added the question Further information is requested label Dec 17, 2024
@XuehaiPan
Copy link
Owner

Thanks for raising this. I will create a version bump for this.

you cannot install the latest vllm in the same virtualenv with nvitop

Also, I'd suggest to install nvitop using pipx or uvx instead of install it in your virtual environment:

pipx run nvitop
# or
uvx nvitop

You can add alias in your shell rc:

alias nvitop='pipx run nvitop'
# or
alias nvitop='uvx nvitop'

@XuehaiPan
Copy link
Owner

A new release is made.

@keith
Copy link
Author

keith commented Dec 29, 2024

thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants