On-demand pricing · us-east-1 / eastus / us-central1 · 2026-05-21
| GPU | AWS | Azure | GCP | CoreWeave | Lambda Labs | RunPod | Crusoe | OCI |
|---|---|---|---|---|---|---|---|---|
| A100 40GB | $4.10 today | $3.40 today | $3.67 today | $1.99 1d ago | ||||
| A100 80GB | $5.12 today | $4.10 today | $5.07 today | $2.70 1d ago | $2.79 1d ago | $1.79 1d ago | $1.95 1d ago | $4.00 today |
| H100 | $12.29 today | $12.29 today | $11.06 today | $6.16 1d ago | $3.99 1d ago | $2.99 1d ago | $3.90 1d ago | $10.75 today |
| H200 SXM | Coming Soon | $10.60 today | $10.60 today | $6.31 1d ago | $4.31 1d ago | $4.29 1d ago | $10.00 today | |
| H200 NVL | $10.60 today | |||||||
| B200 | Coming Soon | Coming Soon | $8.05 today | $8.60 1d ago | $6.69 1d ago | $5.49 1d ago | Coming Soon | $14.00 today |
| MI300X | $6.00 today | Coming Soon | $3.45 1d ago | $6.00 today | ||||
| MI325X |
| Workload | Model | Scenario | Systems | Metric Range |
|---|---|---|---|---|
| llm | gptj | Offline | 1 | 21,335 – 21,335 tok/s |
| llm | llama2-70b | Offline | 42 | 4,068 – 98,858 tok/s |
| llm | llama2-70b | Server | 42 | 3,884 – 98,443 tok/s |
| llm | llama2-70b-interactive | Offline | 13 | 30,990 – 98,858 tok/s |
| llm | llama2-70b-interactive | Server | 13 | 12,979 – 62,266 tok/s |
| llm | mixtral-8x7b | Offline | 26 | 7,718 – 128,795 tok/s |
| llm | mixtral-8x7b | Server | 26 | 7,183 – 129,047 tok/s |
| medical | 3d-unet | Offline | 27 | 7 – 55 samp/s |
| nlp | bert | Offline | 17 | 8,779 – 73,791 samp/s |
| nlp | bert | Server | 17 | 4,503 – 58,929 samp/s |
| recommendation | dlrm-v2 | Offline | 14 | 51,031 – 643,756 samp/s |
| recommendation | dlrm-v2 | Server | 14 | 50,469 – 585,208 samp/s |
| vision | resnet50 | Offline | 21 | 95,104 – 773,300 samp/s |
| vision | resnet50 | Server | 21 | 77,012 – 673,220 samp/s |
| vision | retinanet | Offline | 26 | 1,923 – 15,200 samp/s |
| vision | retinanet | Server | 26 | 1,731 – 14,589 samp/s |
| vision | stable-diffusion-xl | Offline | 30 | 2 – 30 samp/s |
| vision | stable-diffusion-xl | Server | 30 | 2 – 29 samp/s |
| Workload | GPU | Count | Provider |
|---|---|---|---|
| llm | NVIDIA B200-SXM-180GB | ×8 | CoreWeave |
| llm | NVIDIA B200-SXM-180GB | ×8 | GCP (us-central1) |
| llm | NVIDIA B200-SXM-180GB | ×8 | Lambda Labs |
| llm | NVIDIA B200-SXM-180GB | ×1 | OCI |
| llm | NVIDIA B200-SXM-180GB | ×1 | RunPod |
| llm | NVIDIA H100-SXM-80GB | ×8 | AWS (us-east-1) |
| llm | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus) |
| llm | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus2) |
| llm | NVIDIA H100-SXM-80GB | ×8 | CoreWeave |
| llm | NVIDIA H100-SXM-80GB | ×1 | Crusoe |
| llm | NVIDIA H100-SXM-80GB | ×8 | GCP (us-central1) |
| llm | NVIDIA H100-SXM-80GB | ×8 | Lambda Labs |
| llm | NVIDIA H100-SXM-80GB | ×1 | OCI |
| llm | NVIDIA H100-SXM-80GB | ×1 | RunPod |
| llm | NVIDIA H200-NVL-141GB | ×8 | AWS (us-east-1) |
| llm | NVIDIA H200-SXM-141GB | ×8 | Azure (eastus2) |
| llm | NVIDIA H200-SXM-141GB | ×8 | CoreWeave |
| llm | NVIDIA H200-SXM-141GB | ×1 | Crusoe |
| llm | NVIDIA H200-SXM-141GB | ×8 | GCP (us-central1) |
| llm | NVIDIA H200-SXM-141GB | ×1 | OCI |
| llm | NVIDIA H200-SXM-141GB | ×1 | RunPod |
| medical | NVIDIA H100-SXM-80GB | ×8 | AWS (us-east-1) |
| medical | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus) |
| medical | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus2) |
| medical | NVIDIA H100-SXM-80GB | ×8 | CoreWeave |
| medical | NVIDIA H100-SXM-80GB | ×1 | Crusoe |
| medical | NVIDIA H100-SXM-80GB | ×8 | GCP (us-central1) |
| medical | NVIDIA H100-SXM-80GB | ×8 | Lambda Labs |
| medical | NVIDIA H100-SXM-80GB | ×1 | OCI |
| medical | NVIDIA H100-SXM-80GB | ×1 | RunPod |
| medical | NVIDIA H200-NVL-141GB | ×8 | AWS (us-east-1) |
| medical | NVIDIA H200-SXM-141GB | ×8 | Azure (eastus2) |
| medical | NVIDIA H200-SXM-141GB | ×8 | CoreWeave |
| medical | NVIDIA H200-SXM-141GB | ×1 | Crusoe |
| medical | NVIDIA H200-SXM-141GB | ×8 | GCP (us-central1) |
| medical | NVIDIA H200-SXM-141GB | ×1 | OCI |
| medical | NVIDIA H200-SXM-141GB | ×1 | RunPod |
| nlp | NVIDIA H100-SXM-80GB | ×8 | AWS (us-east-1) |
| nlp | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus) |
| nlp | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus2) |
| nlp | NVIDIA H100-SXM-80GB | ×8 | CoreWeave |
| nlp | NVIDIA H100-SXM-80GB | ×1 | Crusoe |
| nlp | NVIDIA H100-SXM-80GB | ×8 | GCP (us-central1) |
| nlp | NVIDIA H100-SXM-80GB | ×8 | Lambda Labs |
| nlp | NVIDIA H100-SXM-80GB | ×1 | OCI |
| nlp | NVIDIA H100-SXM-80GB | ×1 | RunPod |
| nlp | NVIDIA H200-SXM-141GB | ×8 | Azure (eastus2) |
| nlp | NVIDIA H200-SXM-141GB | ×8 | CoreWeave |
| nlp | NVIDIA H200-SXM-141GB | ×1 | Crusoe |
| nlp | NVIDIA H200-SXM-141GB | ×8 | GCP (us-central1) |
| nlp | NVIDIA H200-SXM-141GB | ×1 | OCI |
| nlp | NVIDIA H200-SXM-141GB | ×1 | RunPod |
| recommendation | NVIDIA H100-SXM-80GB | ×8 | AWS (us-east-1) |
| recommendation | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus) |
| recommendation | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus2) |
| recommendation | NVIDIA H100-SXM-80GB | ×8 | CoreWeave |
| recommendation | NVIDIA H100-SXM-80GB | ×1 | Crusoe |
| recommendation | NVIDIA H100-SXM-80GB | ×8 | GCP (us-central1) |
| recommendation | NVIDIA H100-SXM-80GB | ×8 | Lambda Labs |
| recommendation | NVIDIA H100-SXM-80GB | ×1 | OCI |
| recommendation | NVIDIA H100-SXM-80GB | ×1 | RunPod |
| recommendation | NVIDIA H200-SXM-141GB | ×8 | Azure (eastus2) |
| recommendation | NVIDIA H200-SXM-141GB | ×8 | CoreWeave |
| recommendation | NVIDIA H200-SXM-141GB | ×1 | Crusoe |
| recommendation | NVIDIA H200-SXM-141GB | ×8 | GCP (us-central1) |
| recommendation | NVIDIA H200-SXM-141GB | ×1 | OCI |
| recommendation | NVIDIA H200-SXM-141GB | ×1 | RunPod |
| vision | NVIDIA B200-SXM-180GB | ×8 | CoreWeave |
| vision | NVIDIA B200-SXM-180GB | ×8 | GCP (us-central1) |
| vision | NVIDIA B200-SXM-180GB | ×8 | Lambda Labs |
| vision | NVIDIA B200-SXM-180GB | ×1 | OCI |
| vision | NVIDIA B200-SXM-180GB | ×1 | RunPod |
| vision | NVIDIA H100-SXM-80GB | ×8 | AWS (us-east-1) |
| vision | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus) |
| vision | NVIDIA H100-SXM-80GB | ×8 | Azure (eastus2) |
| vision | NVIDIA H100-SXM-80GB | ×8 | CoreWeave |
| vision | NVIDIA H100-SXM-80GB | ×1 | Crusoe |
| vision | NVIDIA H100-SXM-80GB | ×8 | GCP (us-central1) |
| vision | NVIDIA H100-SXM-80GB | ×8 | Lambda Labs |
| vision | NVIDIA H100-SXM-80GB | ×1 | OCI |
| vision | NVIDIA H100-SXM-80GB | ×1 | RunPod |
| vision | NVIDIA H200-NVL-141GB | ×8 | AWS (us-east-1) |
| vision | NVIDIA H200-SXM-141GB | ×8 | Azure (eastus2) |
| vision | NVIDIA H200-SXM-141GB | ×8 | CoreWeave |
| vision | NVIDIA H200-SXM-141GB | ×1 | Crusoe |
| vision | NVIDIA H200-SXM-141GB | ×8 | GCP (us-central1) |
| vision | NVIDIA H200-SXM-141GB | ×1 | OCI |
| vision | NVIDIA H200-SXM-141GB | ×1 | RunPod |
| Gap | Notes |
|---|---|
| AWS H200 SXM (p5e) | p5e.48xlarge price anomalous in API — NVL (p5en) priced, SXM not confirmed |
| AWS B200 | p6-b200.48xlarge not publicly available |
| MI300X — GPU-native clouds | Lambda Labs and RunPod MI300X pricing not yet verified |
| MI325X | AMD's MLPerf v5.0 submission hardware — no cloud provider pricing yet |
| RNN-T / speech | MLPerf v4.1 speech workload not submitted by GPU cloud providers |
| A100 MLPerf results | No closed-division A100 results in v4.1/v5.0 from ingested submitters |