https://lesitedefrancois.be/en/tags/multi-tenancy/Recent content in Multi-Tenancy on Le Site de FrançoisHugo -- gohugo.ioen© 2026 Françoishttps://lesitedefrancois.be/en/ai/mig/Mon, 01 Jan 0001 00:00:00 +0000https://lesitedefrancois.be/en/ai/mig/<p><strong>MIG (Multi-Instance GPU)</strong> is an NVIDIA <strong>GPU</strong> partitioning mode on datacenter accelerators (e.g. <strong>A100</strong>, <strong>H100</strong>) that splits one physical card into up to seven <strong>GPU instances (GIs)</strong>, each with isolated <strong>streaming multiprocessors</strong>, memory bandwidth, and <strong>HBM</strong> capacity. The objective is <strong>higher utilization</strong> in multi-tenant environments: several smaller models or dev/test workloads share one expensive GPU without time-slicing contention as severe as full-card sharing. Each MIG instance appears to the OS and <strong>CUDA</strong> as a separate GPU with fixed resources; workloads cannot oversubscribe another instance’s memory. MIG suits <strong>inference</strong> and modest training more often than massive single-job training that needs the entire GPU and <strong>NVLink</strong> domain.</p>