Compatibility of Hybrid Mode with External GPU via Oculink

[johnnytshi]

Hi,

I would like to know if the hybrid mode can work with an external GPU. Specifically, I am looking into compatibility with the AI 300 chip and an external GPU connected via oculink.

So NPU + iGPU +dGPU

Any information or guidance on this would be greatly appreciated.

Thanks!

[johnnytshi]

from brief research, I geather i can use Onnx, and use VitisAIExecutionProvider to run part of the model on the NPU, and part of the model on iGPU, and rest on dGPU

would that work?

If so, how does one go about finding out which part runs on which hardware to maximize performance?

[kovtcharov]

Hi @johnnytshi, i'm unsure to be honest, I'm following up with the team to find any info on this.