HAMi Deployment + Example

[omrishiv]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

Support deploying HAMi and have documentation + examples on usage with Neuron

Describe the solution you would like

HAMi has supported AWS Neuron accelerators with a release planned for v2.7. It would be great to illustrate its usage as a complement to GPU partitioning techniques like MIG. We should have:

1. Infrastructure components that support deploying HAMi
2. An infrastructure deployment that makes HAMi available out of the box
3. An explanation of what HAMi is on the website
4. Examples showing training and/or inference and why you would want to use it.

1 and 2 are available here with a PR to follow. We need 3 and 4

Describe alternatives you have considered

Additional context

[ronaldngounou]

/assign ronaldngounou

[ronaldngounou]

I started reading on HAMi

For 1 and 2: I have to rewrite what you already have on the PR.

For 3, where would be the best place to add that content on the repo?

For 4: I still need to read more and research.