Skip to content

Add Nebius AI Cloud support #443

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jan 23, 2025
Merged

Conversation

SalikovAlex
Copy link
Contributor

@SalikovAlex SalikovAlex commented Jan 21, 2025

Add Nebius AI Cloud support

Copy link
Member

@jacobtomlinson jacobtomlinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking the time to work on this. I haven't heard of Nebius before, but it looks interesting.

This PR needs documentation, but other than that it looks good.

We don't have the capacity to maintain many different backends so I would ask that if we merge this that you can handle triaging bugs and making future PRs @SalikovAlex. If this is merged and then not maintained we will eventually to remove it again.

@@ -17,6 +17,7 @@
"hetzner": ["hcloud>=1.10.0"],
"ibm": ["ibm_code_engine_sdk>=3.1.0"],
"openstack": ["openstacksdk>=3.3.0"],
"nebius": ["nebius @ git+https://github.com/nebius/pysdk"],
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there any road to getting this properly published on PyPI. Just pointing to the tip of main on GitHub is an uncomfortable place to be.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will fix it as soon as Nebius publishes lib on PiPy.

Copy link
Member

@jacobtomlinson jacobtomlinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok great thanks. Happy to merge once docs are added.

Introduce new documentation for Nebius integration, detailing authentication setup and configuration options. This includes updates to the index file and a new Nebius-specific guide covering cluster setup and Dask-related settings.
Updated the installation guide to include the Nebius provider option for `dask-cloudprovider`. This ensures users are aware of all supported cloud platforms.
Copy link
Member

@jacobtomlinson jacobtomlinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great thanks!

@jacobtomlinson jacobtomlinson merged commit 6d1614f into dask:main Jan 23, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants