Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add MIG Device support #21

Open
zamog opened this issue Dec 15, 2021 · 2 comments
Open

Add MIG Device support #21

zamog opened this issue Dec 15, 2021 · 2 comments
Assignees
@k82cn

Comments

@zamog
Copy link

zamog commented Dec 15, 2021 •
edited
Loading

Adding support for MIG devices - the pull request is still WIP - only to review general idea
#20
@k82cn
Copy link
Member

k82cn commented Dec 15, 2021

@zamog , that's great! would you help to share more background for this enhancement?

@zamog
Copy link
Author

zamog commented Dec 28, 2021

Background:
Multi-Instance GPUs (MIG) allows partitioning GPUs into multiple instances. We saw a significant performance increase when MIG was enabled compared to running a few jobs on the same physical GPU.
More info on Nvidia site

Notes:

  1. NVIDIA_VISIBLE_DEVICES changed to use UUID.
  2. The memory units must be changed to HundredMB or Gig to support the new GPUs (40/80 Gig)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@k82cn k82cn

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@k82cn @zamog