Seonglae ChoMulti-Instance GPU
Physically partitions resources such as VRAM, SM, L2 Cache, NVDEC/NVENC within the GPU chip
Supported gpus
- Max Number of Instances
Supported GPUs — NVIDIA Multi-Instance GPU User Guide
MIG is supported on GPUs starting with the NVIDIA Ampere generation (that is, GPUs with compute capability >= 8.0). The following
table provides a list of supported GPUs:
https://docs.nvidia.com/datacenter/tesla/mig-user-guide/supported-gpus.html