Skip to content

[CI] [WheelNext] Build variant wheels #11531

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jul 4, 2025
Merged

Conversation

hcho3
Copy link
Collaborator

@hcho3 hcho3 commented Jun 26, 2025

WheelNext is a proposal to improve Python wheels to better support specialized hardware and reduce the size of individual wheels. In particular, we are keen to adopt the Wheel Variant proposal. Also see the presentation.

Use the prototype in https://github.com/wheelnext/pep_xxx_wheel_variants to build a variant wheel. A variant wheel is just like a regular wheel, but with extra variant metadata like nvidia :: cuda :: 12.

@hcho3 hcho3 marked this pull request as ready for review June 27, 2025 18:09
python -m pip install -v \
git+https://github.com/wheelnext/pep_xxx_wheel_variants.git@f3b287090f8a6f510b0e1723896e1c7e638f6bff#subdirectory=pep_xxx_wheel_variants
pip config set --site global.index-url https://variants-index.wheelnext.dev/
variantlib make-variant -f python-package/dist/xgboost-*.whl \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please provide some comments on what this line does? Skimming the pipeline, this follows a CUDA build, I don't see any potential variant here since there's no CPU build and NCCL is still installed.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is an initial stage, where we build a single variant for the CUDA build. In the future, I plan to build the CPU variant and other variants.

@hcho3 hcho3 merged commit 231e4dd into dmlc:master Jul 4, 2025
63 of 64 checks passed
@hcho3 hcho3 deleted the build_variant_wheels branch July 4, 2025 00:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants