Image classification throughput — images classified per second per GPU. · ResNet-50 · image classification · v4.1 / v5.0 / v5.1 / v6.0 / v6.1 · on-demand pricing
| GPU | Scenario | samp/s per GPU | |
|---|---|---|---|
| NVIDIA H200-SXM-141GB | Offline | 96,662 samp/s | |
| NVIDIA H100-SXM-80GB | Offline | 89,080 samp/s | |
| NVIDIA H200-SXM-141GB | Server | 84,153 samp/s | |
| NVIDIA H100-SXM-80GB | Server | 79,274 samp/s | |
| NVIDIA H100-PCIe-80GB | Offline | 56,484 samp/s | |
| NVIDIA H100-PCIe-80GB | Server | 51,632 samp/s | |
| NVIDIA L40S | Offline | 43,215 samp/s | |
| NVIDIA L40S | Server | 42,506 samp/s |
| Provider | GPU | Scenario | Price | samp/$ | |
|---|---|---|---|---|---|
| Lambda Labs | NVIDIA H200-SXM-141GB | Offline | $2.29/GPU·hr 48m ago | 151,958,515 | |
| Lambda Labs | NVIDIA H200-SXM-141GB | Server | $2.29/GPU·hr 48m ago | 132,292,234 | |
| Hyperstack | NVIDIA H200-SXM-141GB | Offline | $2.79/GPU·hr 48m ago | 124,725,806 | |
| Latitude.sh | NVIDIA H100-PCIe-80GB | Offline | $1.68/GPU·hr 48m ago | 121,037,143 | |
| Hyperstack | NVIDIA H100-SXM-80GB | Offline | $2.72/GPU·hr 48m ago | 117,900,000 | |
| Latitude.sh | NVIDIA H100-PCIe-80GB | Server | $1.68/GPU·hr 48m ago | 110,640,530 | |
| Hyperstack | NVIDIA H200-SXM-141GB | Server | $2.79/GPU·hr 48m ago | 108,583,948 | |
| Hyperstack | NVIDIA H100-SXM-80GB | Server | $2.72/GPU·hr 48m ago | 104,921,653 | |
| Crusoe | NVIDIA H100-PCIe-80GB | Offline | $2.00/GPU·hr 48m ago | 101,671,200 | |
| Vultr | NVIDIA L40S | Offline | $1.54/GPU·hr 48m ago | 101,140,586 | |
| Vultr | NVIDIA L40S | Server | $1.54/GPU·hr 48m ago | 99,480,726 | |
| DigitalOcean | NVIDIA L40S | Offline | $1.57/GPU·hr 48m ago | 99,092,006 | |
| DigitalOcean | NVIDIA L40S | Server | $1.57/GPU·hr 48m ago | 97,465,767 | |
| Crusoe | NVIDIA H100-PCIe-80GB | Server | $2.00/GPU·hr 48m ago | 92,938,046 | |
| RunPod | NVIDIA H100-SXM-80GB | Offline | $3.99/GPU·hr 48m ago | 80,372,932 | |
| Lambda Labs | NVIDIA H100-SXM-80GB | Offline | $3.99/GPU·hr 48m ago | 80,372,932 | |
| DigitalOcean | NVIDIA H200-SXM-141GB | Offline | $4.47/GPU·hr 48m ago | 77,848,993 | |
| DigitalOcean | NVIDIA H100-SXM-80GB | Offline | $4.41/GPU·hr 48m ago | 72,718,367 | |
| RunPod | NVIDIA H100-SXM-80GB | Server | $3.99/GPU·hr 48m ago | 71,525,538 | |
| Lambda Labs | NVIDIA H100-SXM-80GB | Server | $3.99/GPU·hr 48m ago | 71,525,538 | |
| Crusoe | NVIDIA H100-SXM-80GB | Offline | $4.50/GPU·hr 48m ago | 71,264,000 | |
| Nebius | NVIDIA H100-SXM-80GB | Offline | $4.50/GPU·hr 48m ago | 71,264,000 | |
| DigitalOcean | NVIDIA H200-SXM-141GB | Server | $4.47/GPU·hr 48m ago | 67,773,874 | |
| RunPod | NVIDIA H200-SXM-141GB | Offline | $5.29/GPU·hr 48m ago | 65,781,664 | |
| DigitalOcean | NVIDIA H100-SXM-80GB | Server | $4.41/GPU·hr 48m ago | 64,713,582 | |
| Crusoe | NVIDIA H200-SXM-141GB | Offline | $5.40/GPU·hr 48m ago | 64,441,667 | |
| Nebius | NVIDIA H200-SXM-141GB | Offline | $5.40/GPU·hr 48m ago | 64,441,667 | |
| Crusoe | NVIDIA H100-SXM-80GB | Server | $4.50/GPU·hr 48m ago | 63,419,310 | |
| Nebius | NVIDIA H100-SXM-80GB | Server | $4.50/GPU·hr 48m ago | 63,419,310 | |
| RunPod | NVIDIA H200-SXM-141GB | Server | $5.29/GPU·hr 48m ago | 57,268,283 | |
| Crusoe | NVIDIA H200-SXM-141GB | Server | $5.40/GPU·hr 48m ago | 56,101,707 | |
| Nebius | NVIDIA H200-SXM-141GB | Server | $5.40/GPU·hr 48m ago | 56,101,707 | |
| CoreWeave | NVIDIA H200-SXM-141GB | Offline | $6.31/GPU·hr 48m ago | 55,148,177 | |
| CoreWeave | NVIDIA H100-SXM-80GB | Offline | $6.16/GPU·hr 48m ago | 52,059,740 | |
| CoreWeave | NVIDIA H200-SXM-141GB | Server | $6.31/GPU·hr 48m ago | 48,010,969 | |
| CoreWeave | NVIDIA H100-SXM-80GB | Server | $6.16/GPU·hr 48m ago | 46,329,041 | |
| OCI | NVIDIA H200-SXM-141GB | Offline | $10.00/GPU·hr 48m ago | 34,798,500 | |
| Azure (eastus2) | NVIDIA H200-SXM-141GB | Offline | $10.60/GPU·hr 48m ago | 32,828,774 | |
| GCP (us-central1) | NVIDIA H200-SXM-141GB | Offline | $10.84/GPU·hr 48m ago | 32,087,168 | |
| OCI | NVIDIA H200-SXM-141GB | Server | $10.00/GPU·hr 48m ago | 30,294,922 | |
| OCI | NVIDIA H100-SXM-80GB | Offline | $10.75/GPU·hr 48m ago | 29,831,442 | |
| Azure (eastus2) | NVIDIA H200-SXM-141GB | Server | $10.60/GPU·hr 48m ago | 28,580,115 | |
| GCP (us-central1) | NVIDIA H200-SXM-141GB | Server | $10.84/GPU·hr 48m ago | 27,934,487 | |
| GCP (us-central1) | NVIDIA H100-SXM-80GB | Offline | $11.53/GPU·hr 48m ago | 27,821,118 | |
| OCI | NVIDIA H100-SXM-80GB | Server | $10.75/GPU·hr 48m ago | 26,547,618 | |
| AWS (us-east-1) | NVIDIA H100-SXM-80GB | Offline | $12.29/GPU·hr 48m ago | 26,093,409 | |
| Azure (eastus) | NVIDIA H100-SXM-80GB | Offline | $12.29/GPU·hr 48m ago | 26,093,409 | |
| Azure (eastus2) | NVIDIA H100-SXM-80GB | Offline | $12.29/GPU·hr 48m ago | 26,093,409 | |
| GCP (us-central1) | NVIDIA H100-SXM-80GB | Server | $11.53/GPU·hr 48m ago | 24,758,589 | |
| AWS (us-east-1) | NVIDIA H100-SXM-80GB | Server | $12.29/GPU·hr 48m ago | 23,221,066 | |
| Azure (eastus) | NVIDIA H100-SXM-80GB | Server | $12.29/GPU·hr 48m ago | 23,221,066 | |
| Azure (eastus2) | NVIDIA H100-SXM-80GB | Server | $12.29/GPU·hr 48m ago | 23,221,066 |