Skip to content

I want to use two GPUs by starting a process, one for model A and the other for model B. Is there a viable way? #6928

Answered by loadams
Wallejd asked this question in Q&A
Discussion options

You must be logged in to vote

@Wallejd - I recommend opening an issue with your question, we tend to respond there sooner. But to do what you want, you would need to invoke two different Deepspeed commands, one that is only using GPU0 running modelA and one that uses GPU1 with modelB. There is no way to do this with a single command to handle 2 models, each on their own GPU.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by loadams
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants