[DMP 2024]: Fractional GPU Utilisation

[MohitNSamagra]

Ticket Contents

Description

Create a framework-agnostic Linux package with an exposed interface that allows the utilization of a fraction of a GPU, similar to how cgroups works. This package will enable users to efficiently allocate and manage GPU resources for their applications.

https://docs.run.ai/v2.15/Researcher/Walkthroughs/walkthrough-fractions/

Goals & Mid-Point Milestone

Goals

-Framework-Agnostic Linux Package:
-Develop a Linux package with an exposed interface for managing GPU resources.
- Implement functionality to allocate and control a fraction of a GPU for application usage.

• Plugin for Docker Compose:
  • Create a plugin for Docker Compose that integrates with the framework-agnostic Linux package.
  • Enable users to specify GPU resource requirements for their Docker Compose services.
• Plugin for Kubernetes (K8S):
  • Develop a plugin for Kubernetes that utilizes the framework-agnostic Linux package.
  • Allow users to specify GPU resource limits and requests in Kubernetes pods.

Setup/Installation

No response

Expected Outcome

• A framework-agnostic Linux package that provides an interface for managing GPU resources.
• A Docker Compose plugin enabling users to specify GPU resource requirements for their services.
• A Kubernetes plugin allowing users to specify GPU resource limits and requests for pods.

Acceptance Criteria

• The Linux package interface allows users to allocate and control a fraction of a GPU.
• The Docker Compose plugin seamlessly integrates with the Linux package, enabling GPU resource specification.
• The Kubernetes plugin effectively utilizes the Linux package for managing GPU resources in pods.
• Extensive testing is conducted to ensure compatibility and reliability across different environments.

Implementation Details

• Develop the framework-agnostic Linux package with a clear and intuitive interface for GPU resource management.
• Implement the Docker Compose plugin to communicate with the Linux package and translate resource specifications.
• Create the Kubernetes plugin to interact with the Linux package and enforce GPU resource limits and requests in pods.

Mockups/Wireframes

No response

Product Name

BharatSahAIyak

Organisation Name

SamagraX

Domain

Open Source Library

Tech Skills Needed

Docker

Mentor(s)

@ChakshuGautam

Category

AI