-
Notifications
You must be signed in to change notification settings - Fork 954
draft blog for DEH new features #3230
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
wdyt of publishing it under hf.co/dell instead? (community blog, then promote to main section) |
jeffboudier
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In addition to the review suggestions, I suggest renaming the blog post file for a more seo-friendly stub
alvarobartt
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for taking the time @pagezyhf, I've included some suggestions and comments, I'd like to re-review again so feel free to ping me 🤗
deh-2025.md
Outdated
|
|
||
| Dell Enterprise Hub started with containers built on top of Hugging Face **Text Generation Inference (TGI)**. Today, it can also choose engines like **vLLM** or **SGLang** based on the model and platform, and it generates deployment snippets with sensible default parameters. You pick the model and Dell platform; Dell Enterprise Hub picks a runtime and configuration that work well out of the box. | ||
|
|
||
| Looking ahead, Dell Enterprise Hub will become more opinionated about the default configuration parameters included in each deployment snippet, with presets for different use cases. You will still be able to override any of these values in the generated command if you want to experiment, but the goal is that teams get strong results on day one by simply copying the snippet into their Dell environment. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| Looking ahead, Dell Enterprise Hub will become more opinionated about the default configuration parameters included in each deployment snippet, with presets for different use cases. You will still be able to override any of these values in the generated command if you want to experiment, but the goal is that teams get strong results on day one by simply copying the snippet into their Dell environment. | |
| Looking ahead, Dell Enterprise Hub will become more opinionated about the default configuration parameters included in each deployment snippet, with presets for different use cases. You will still be able to leverage the containers with your own parameters, but the goal is that teams get strong results on day one by simply copying and pasting the snippet into their Dell Platforms. |
deh-2025.md
Outdated
|
|
||
| ## Lifecycle: decoupling containers and versioning | ||
|
|
||
| The last big theme in this update is how Dell Enterprise Hub handles the lifecycle of containers and model weights over time. Enterprises need to patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub is moving to a **decoupled container architecture with explicit versioning**. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| The last big theme in this update is how Dell Enterprise Hub handles the lifecycle of containers and model weights over time. Enterprises need to patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub is moving to a **decoupled container architecture with explicit versioning**. | |
| The last big update is how Dell Enterprise Hub handles the lifecycle of containers and model weights over time. Enterprises need to patch base images, upgrade inference engines, rotate models and archive older assets, often under strict compliance requirements. To make that easier, Dell Enterprise Hub is moving to a **decoupled container architecture with explicit versioning on the underlying engine**. |
deh-2025.md
Outdated
|
|
||
| These changes are another step toward making Dell Enterprise Hub the easiest way to run open models and applications on Dell infrastructure, fully on-premise and under your control. | ||
|
|
||
| We are continuing to expand support for new modalities and new Dell platforms, to refine default configurations around real-world goodput, and to deepen the integration between the Model Catalog, Application Catalog, Hugging Face Hub and programmatic tools. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
IMO the last sentence is a bit confusing, but couldn't come up with a better wording around that one either :/
| We are continuing to expand support for new modalities and new Dell platforms, to refine default configurations around real-world goodput, and to deepen the integration between the Model Catalog, Application Catalog, Hugging Face Hub and programmatic tools. | |
| We are continuing to expand support for new modalities and new Dell Platforms, to refine default configurations around real-world goodput, and to deepen the integration between the Model Catalog, Application Catalog, Hugging Face Hub and programmatic tools. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why is that a capital P?
|
FYI @pagezyhf this seems to be Bala's handle https://huggingface.co/iambala |
|
@julien-c if they're not enterprise they can't publish articles under their org name, no? |
Co-authored-by: Jeff Boudier <[email protected]>
Co-authored-by: Jeff Boudier <[email protected]> Co-authored-by: Alvaro Bartolome <[email protected]>
|
@pagezyhf 'enterprise' or 'team' |
|
Hey @burtenshaw , they're not Team nor Enterprise https://huggingface.co/DellTechnologies. They plan to, but I don't know where the conversation stands right now. |
The guest author user for this blog should be https://huggingface.co/balaatdell |
@jeffboudier @alvarobartt @ehcalabres @juanjucm for visibility
Hey team, this is a draft I'd like to review with you before sharing with Dell.
target date for publication: 17th December (next Wednesday)
To do before publishing the blogpost: