Image classification throughput — images classified per second per GPU. · ResNet-50 · image classification · MLPerf v4.1/v5.0 · on-demand pricing
| GPU | Scenario | samp/s per GPU | |
|---|---|---|---|
| NVIDIA H200-SXM-141GB | Offline | 96,662 samp/s | |
| NVIDIA H100-SXM-80GB | Offline | 89,080 samp/s | |
| NVIDIA H200-SXM-141GB | Server | 84,153 samp/s | |
| NVIDIA H100-SXM-80GB | Server | 79,274 samp/s |
| Provider | GPU | Scenario | Price | samp/$ | |
|---|---|---|---|---|---|
| RunPod | NVIDIA H100-SXM-80GB | Offline | $2.99/GPU·hr 1d ago | 107,253,512 | |
| RunPod | NVIDIA H100-SXM-80GB | Server | $2.99/GPU·hr 1d ago | 95,447,122 | |
| Crusoe | NVIDIA H100-SXM-80GB | Offline | $3.90/GPU·hr 1d ago | 82,227,692 | |
| Crusoe | NVIDIA H200-SXM-141GB | Offline | $4.29/GPU·hr 1d ago | 81,115,385 | |
| RunPod | NVIDIA H200-SXM-141GB | Offline | $4.31/GPU·hr 1d ago | 80,738,979 | |
| Lambda Labs | NVIDIA H100-SXM-80GB | Offline | $3.99/GPU·hr 1d ago | 80,372,932 | |
| Crusoe | NVIDIA H100-SXM-80GB | Server | $3.90/GPU·hr 1d ago | 73,176,127 | |
| Lambda Labs | NVIDIA H100-SXM-80GB | Server | $3.99/GPU·hr 1d ago | 71,525,538 | |
| Crusoe | NVIDIA H200-SXM-141GB | Server | $4.29/GPU·hr 1d ago | 70,617,533 | |
| RunPod | NVIDIA H200-SXM-141GB | Server | $4.31/GPU·hr 1d ago | 70,289,841 | |
| CoreWeave | NVIDIA H200-SXM-141GB | Offline | $6.31/GPU·hr 1d ago | 55,148,177 | |
| CoreWeave | NVIDIA H100-SXM-80GB | Offline | $6.16/GPU·hr 1d ago | 52,059,740 | |
| CoreWeave | NVIDIA H200-SXM-141GB | Server | $6.31/GPU·hr 1d ago | 48,010,969 | |
| CoreWeave | NVIDIA H100-SXM-80GB | Server | $6.16/GPU·hr 1d ago | 46,329,041 | |
| OCI | NVIDIA H200-SXM-141GB | Offline | $10.00/GPU·hr today | 34,798,500 | |
| Azure (eastus2) | NVIDIA H200-SXM-141GB | Offline | $10.60/GPU·hr today | 32,828,774 | |
| GCP (us-central1) | NVIDIA H200-SXM-141GB | Offline | $10.60/GPU·hr today | 32,826,099 | |
| OCI | NVIDIA H200-SXM-141GB | Server | $10.00/GPU·hr today | 30,294,922 | |
| OCI | NVIDIA H100-SXM-80GB | Offline | $10.75/GPU·hr today | 29,831,442 | |
| GCP (us-central1) | NVIDIA H100-SXM-80GB | Offline | $11.06/GPU·hr today | 28,992,022 | |
| Azure (eastus2) | NVIDIA H200-SXM-141GB | Server | $10.60/GPU·hr today | 28,580,115 | |
| GCP (us-central1) | NVIDIA H200-SXM-141GB | Server | $10.60/GPU·hr today | 28,577,787 | |
| OCI | NVIDIA H100-SXM-80GB | Server | $10.75/GPU·hr today | 26,547,618 | |
| AWS (us-east-1) | NVIDIA H100-SXM-80GB | Offline | $12.29/GPU·hr today | 26,093,409 | |
| Azure (eastus2) | NVIDIA H100-SXM-80GB | Offline | $12.29/GPU·hr today | 26,093,409 | |
| Azure (eastus) | NVIDIA H100-SXM-80GB | Offline | $12.29/GPU·hr today | 26,093,409 | |
| GCP (us-central1) | NVIDIA H100-SXM-80GB | Server | $11.06/GPU·hr today | 25,800,601 | |
| AWS (us-east-1) | NVIDIA H100-SXM-80GB | Server | $12.29/GPU·hr today | 23,221,066 | |
| Azure (eastus2) | NVIDIA H100-SXM-80GB | Server | $12.29/GPU·hr today | 23,221,066 | |
| Azure (eastus) | NVIDIA H100-SXM-80GB | Server | $12.29/GPU·hr today | 23,221,066 |