GPU cloud prices
Advertised hourly prices, normalised to per GPU-hour so an 8×H100 node and a single card compare directly.
| GPU | Providers | Offers | Cheapest on-demand | Median on-demand |
|---|---|---|---|---|
| H100 SXM | 22 | 49 | $1.79 | $3.99 |
| H200 | 16 | 26 | $2.30 | $4.54 |
| L40S | 15 | 25 | $0.87 | $1.68 |
| B200 | 13 | 22 | $6 | $7.07 |
| A100 80GB | 10 | 17 | $1.22 | $3.16 |
| A100 80GB SXM | 10 | 14 | $1.30 | $2.79 |
| L4 | 9 | 22 | $0.44 | $0.904 |
| A100 40GB | 7 | 16 | $0.89 | $1.99 |
| H100 | 6 | 8 | $1.68 | $2.95 |
| H100 PCIe | 5 | 9 | $2.50 | $3.09 |
| RTX 4090 | 5 | 8 | $0.55 | $0.645 |
| A100 80GB PCIe | 4 | 14 | $1.35 | $1.79 |
| MI300X | 4 | 6 | $2.59 | $3.45 |
| GH200 | 3 | 3 | $1.99 | $2.29 |
| H100 NVL | 3 | 7 | $3.19 | $5.08 |
| RTX 5090 | 3 | 6 | $0.99 | $0.99 |
| RTX PRO 6000 | 3 | 3 | $1.89 | $2.50 |
| T4 | 3 | 3 | — | — |
| A10 | 2 | 2 | $1.29 | $1.29 |
| A10G | 2 | 4 | $1.01 | $1.42 |
| GB200 | 1 | 1 | $10.50 | $10.50 |
| L40 | 1 | 1 | $1.25 | $1.25 |
| RTX PRO 6000 Max-Q | 1 | 1 | $1.58 | $1.58 |
| Provider | GPU | GPUs | VRAM/GPU | Billing | Per GPU-hr | Instance /hr | Region | Source |
|---|---|---|---|---|---|---|---|---|
| Salad | RTX 4090 low priority |
1 | 24 GB | community | $0.16 | $0.16 | ✓ src ⓘ | |
| Salad | RTX 5090 low priority |
1 | 32 GB | community | $0.25 | $0.25 | ✓ src ⓘ | |
| Google Cloud | L4 g2-standard-4 |
1 | 24 GB | reserved 3y | $0.318 | $0.318 | us-central1 | ✓ src ⓘ |
| Vast.ai | L4 | 1 | 23 GB | community | $0.322 | $0.322 | ✓ src src2 ⓘ | |
| Salad | RTX 4090 high priority |
1 | 24 GB | community | $0.33 | $0.33 | ✓ src ⓘ | |
| RunPod | RTX 4090 | 1 | 24 GB | community | $0.34 | $0.34 | ✓ src ⓘ | |
| TensorDock | RTX 4090 | 1 | 24 GB | community | $0.35 | $0.35 | ◐ src ⓘ | |
| Google Cloud | L4 g2-standard-8 |
1 | 24 GB | reserved 3y | $0.384 | $0.384 | us-central1 | ✓ src ⓘ |
| Google Cloud | L4 g2-standard-4 |
1 | 24 GB | spot | $0.424 | $0.424 | us-central1 | ✓ src ⓘ |
| Jarvislabs | L4 | 1 | 24 GB | on demand | $0.44 | $0.44 | ✓ src ⓘ | |
| RunPod | L4 | 1 | 24 GB | community | $0.44 | $0.44 | ✓ src ⓘ | |
| Google Cloud | L4 g2-standard-4 |
1 | 24 GB | reserved 1y | $0.445 | $0.445 | us-central1 | ✓ src ⓘ |
| RunPod | L4 | 1 | 24 GB | on demand | $0.49 | $0.49 | ✓ src ⓘ | |
| Salad | RTX 5090 high priority |
1 | 32 GB | community | $0.50 | $0.50 | ✓ src ⓘ | |
| Google Cloud | L4 g2-standard-8 |
1 | 24 GB | spot | $0.512 | $0.512 | us-central1 | ✓ src ⓘ |
| Vast.ai | RTX 4090 | 1 | 24 GB | community | $0.536 | $0.536 | ✓ src src2 ⓘ | |
| Vast.ai | RTX 5090 | 1 | 32 GB | community | $0.537 | $0.537 | ✓ src src2 ⓘ | |
| Google Cloud | L4 g2-standard-8 |
1 | 24 GB | reserved 1y | $0.538 | $0.538 | us-central1 | ✓ src ⓘ |
| Genesis Cloud | RTX 4090 | 1 | 24 GB | on demand | $0.55 | $0.55 | EU-North | 2° src ⓘ |
| Modal | T4 | 1 | 16 GB | serverless per sec | $0.59 | $0.59 | ✓ src ⓘ | |
| Baseten | T4 | 1 | 16 GB | serverless per sec | $0.631 | $0.631 | ✓ src ⓘ | |
| Vast.ai | A100 40GB | 1 | 40 GB | community | $0.67 | $0.67 | ✓ src src2 ⓘ | |
| Microsoft Azure | A100 80GB PCIe | 1 | 80 GB | spot | $0.679 | $0.679 | eastus | ✓ src src2 ⓘ |
| Microsoft Azure | A100 80GB PCIe | 4 | 80 GB | spot | $0.679 | $2.72 | eastus | ✓ src src2 ⓘ |
| RunPod | L4 | 1 | 24 GB | serverless per sec | $0.69 | $0.69 | ✓ src ⓘ | |
| RunPod | RTX 5090 | 1 | 32 GB | community | $0.69 | $0.69 | ✓ src ⓘ | |
| Google Cloud | L4 g2-standard-4 |
1 | 24 GB | on demand | $0.707 | $0.707 | us-central1 | ✓ src ⓘ |
| Nebius | L40S | 1 | 48 GB | spot | $0.74 | $0.74 | ◐ src ⓘ | |
| RunPod | RTX 4090 | 1 | 24 GB | on demand | $0.74 | $0.74 | ✓ src ⓘ | |
| RunPod | L40S | 1 | 48 GB | community | $0.79 | $0.79 | ✓ src ⓘ | |
| Modal | L4 | 1 | 24 GB | serverless per sec | $0.799 | $0.799 | ✓ src ⓘ | |
| Vast.ai | L40S | 1 | 45 GB | community | $0.802 | $0.802 | ✓ src src2 ⓘ | |
| Amazon Web Services | L4 | 1 | 24 GB | on demand | $0.805 | $0.805 | us-east-1 | ✓ src ⓘ |
| Replicate | T4 | 1 | 16 GB | serverless per sec | $0.81 | $0.81 | ✓ src ⓘ | |
| Baseten | L4 | 1 | 24 GB | serverless per sec | $0.848 | $0.848 | ✓ src ⓘ | |
| Google Cloud | L4 g2-standard-8 |
1 | 24 GB | on demand | $0.854 | $0.854 | us-central1 | ✓ src ⓘ |
| Cudo Compute | L40S | 1 | 48 GB | on demand | $0.87 | $0.87 | 2° src ⓘ | |
| Jarvislabs | A100 40GB | 1 | 40 GB | on demand | $0.89 | $0.89 | ✓ src ⓘ | |
| Scaleway | L4 | 8 | 24 GB | on demand | $0.904 | $7.23 | fr-par-2 | ✓ src src2 ⓘ |
| Scaleway | L4 | 1 | 24 GB | on demand | $0.904 | $0.904 | fr-par-2 | ✓ src src2 ⓘ |
| RunPod | RTX 5090 | 1 | 32 GB | on demand | $0.99 | $0.99 | ✓ src ⓘ | |
| OVHcloud | L4 | 1 | 24 GB | on demand | $1 | $1 | US | ✓ src ⓘ |
| OVHcloud | L4 | 4 | 24 GB | on demand | $1 | $4 | US | ✓ src ⓘ |
| Amazon Web Services | A10G | 1 | 24 GB | on demand | $1.01 | $1.01 | us-east-1 | ✓ src ⓘ |
| Microsoft Azure | A100 80GB SXM 200 Gb/s HDR InfiniBand per GPU |
8 | 80 GB | spot | $1.06 | $8.44 | eastus | ✓ src src2 ⓘ |
| Hyperstack | A100 80GB PCIe PCIe |
1 | 80 GB | spot | $1.08 | $1.08 | ✓ src ⓘ | |
| RunPod | L40S | 1 | 48 GB | on demand | $1.09 | $1.09 | ✓ src ⓘ | |
| RunPod | RTX 4090 | 1 | 24 GB | serverless per sec | $1.10 | $1.10 | ✓ src ⓘ | |
| Modal | A10 | 1 | 24 GB | serverless per sec | $1.10 | $1.10 | ✓ src ⓘ | |
| Paperspace | A100 80GB | 1 | 80 GB | reserved 3y | $1.15 | $1.15 | ✓ src ⓘ | |
| Amazon Web Services | L4 | 4 | 24 GB | on demand | $1.15 | $4.60 | us-east-1 | ✓ src ⓘ |
| RunPod | A100 80GB PCIe | 1 | 80 GB | community | $1.19 | $1.19 | ✓ src ⓘ | |
| Baseten | A10G | 1 | 24 GB | serverless per sec | $1.21 | $1.21 | ✓ src ⓘ | |
| Vast.ai | A100 80GB SXM | 1 | 80 GB | community | $1.22 | $1.22 | ✓ src src2 ⓘ | |
| Genesis Cloud | A100 80GB | 1 | 80 GB | on demand | $1.22 | $1.22 | EU-North | 2° src ⓘ |
| CoreWeave | L40 | 8 | 48 GB | on demand | $1.25 | $10 | North America | ✓ src |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | reserved 3y | $1.29 | $1.29 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | reserved 3y | $1.29 | $10.29 | us-central1 | ✓ src ⓘ |
| Microsoft Azure | H100 NVL | 1 | 94 GB | spot | $1.29 | $1.29 | eastus | ✓ src src2 ⓘ |
| Lambda | A10 | 1 | 24 GB | on demand | $1.29 | $1.29 | ✓ src ⓘ | |
| Fluidstack | L40S | 1 | 48 GB | on demand | $1.30 | $1.30 | 2° src ⓘ | |
| Fluidstack | A100 80GB SXM | 1 | 80 GB | on demand | $1.30 | $1.30 | 2° src ⓘ | |
| Hyperstack | A100 80GB PCIe PCIe |
1 | 80 GB | on demand | $1.35 | $1.35 | ✓ src ⓘ | |
| Microsoft Azure | A100 80GB PCIe Standard_NC96ads_A100_v4 |
4 | 80 GB | reserved 3y | $1.36 | $5.45 | eastus | ✓ src src2 ⓘ |
| Microsoft Azure | A100 80GB PCIe Standard_NC24ads_A100_v4 |
1 | 80 GB | reserved 3y | $1.36 | $1.36 | eastus | ✓ src src2 ⓘ |
| RunPod | A100 80GB SXM | 1 | 80 GB | community | $1.39 | $1.39 | ✓ src ⓘ | |
| Hyperstack | A100 80GB PCIe NVLink NVLink bridge |
1 | 80 GB | on demand | $1.40 | $1.40 | ✓ src ⓘ | |
| Amazon Web Services | A10G | 4 | 24 GB | on demand | $1.42 | $5.67 | us-east-1 | ✓ src ⓘ |
| Jarvislabs | A100 80GB | 1 | 80 GB | on demand | $1.49 | $1.49 | ✓ src ⓘ | |
| Crusoe | L40S | 1 | 48 GB | on demand | $1.50 | $1.50 | ✓ src ⓘ | |
| Cudo Compute | A100 40GB | 1 | 40 GB | on demand | $1.50 | $1.50 | 2° src ⓘ | |
| TensorDock | H100 SXM | 8 | 80 GB | reserved 3y | $1.50 | $12 | Dallas | ✓ src ⓘ |
| TensorDock | H100 SXM | 1 | 80 GB | reserved 3y | $1.50 | $1.50 | Dallas | ✓ src ⓘ |
| Nebius | L40S | 1 | 48 GB | on demand | $1.55 | $1.55 | ◐ src ⓘ | |
| DigitalOcean | L40S | 1 | 48 GB | on demand | $1.57 | $1.57 | ✓ src | |
| RunPod | RTX 5090 | 1 | 32 GB | serverless per sec | $1.58 | $1.58 | ✓ src ⓘ | |
| Hetzner | RTX PRO 6000 Max-Q | 1 | 96 GB | on demand | $1.58 | $1.58 | FSN1/NBG1/HEL1 | ✓ src ⓘ |
| RunPod | A100 80GB SXM | 1 | 80 GB | on demand | $1.59 | $1.59 | ✓ src ⓘ | |
| RunPod | A100 80GB PCIe | 1 | 80 GB | on demand | $1.59 | $1.59 | ✓ src ⓘ | |
| Hyperstack | A100 80GB SXM PCIe |
1 | 80 GB | on demand | $1.60 | $1.60 | ✓ src ⓘ | |
| Amazon Web Services | L4 | 8 | 24 GB | on demand | $1.67 | $13.35 | us-east-1 | ✓ src ⓘ |
| Vultr | L40S | 4 | 48 GB | on demand | $1.67 | $6.68 | ✓ src src2 ⓘ | |
| Vultr | L40S | 2 | 48 GB | on demand | $1.67 | $3.34 | ✓ src src2 ⓘ | |
| Vultr | L40S | 1 | 48 GB | on demand | $1.67 | $1.67 | ✓ src src2 ⓘ | |
| Latitude.sh | H100 | 1 | 80 GB | on demand | $1.68 | $1.68 | ◐ src ⓘ | |
| Scaleway | L40S | 8 | 48 GB | on demand | $1.69 | $13.50 | fr-par-2 | ✓ src src2 ⓘ |
| Scaleway | L40S | 1 | 48 GB | on demand | $1.69 | $1.69 | fr-par-2 | ✓ src src2 ⓘ |
| RunPod | L40S | 1 | 48 GB | serverless per sec | $1.75 | $1.75 | ✓ src ⓘ | |
| Cudo Compute | H100 SXM | 1 | 80 GB | on demand | $1.79 | $1.79 | 2° src ⓘ | |
| OVHcloud | L40S | 4 | 48 GB | on demand | $1.80 | $7.20 | US | ✓ src ⓘ |
| OVHcloud | L40S | 1 | 48 GB | on demand | $1.80 | $1.80 | US | ✓ src ⓘ |
| Microsoft Azure | A100 80GB SXM Standard_ND96amsr_A100_v4 200 Gb/s HDR InfiniBand per GPU |
8 | 80 GB | reserved 3y | $1.80 | $14.42 | eastus | ✓ src src2 ⓘ |
| Amazon Web Services | L40S | 1 | 48 GB | on demand | $1.86 | $1.86 | us-east-1 | ✓ src ⓘ |
| Jarvislabs | RTX PRO 6000 | 1 | 96 GB | on demand | $1.89 | $1.89 | ✓ src ⓘ | |
| TensorDock | H100 SXM | 8 | 80 GB | reserved 1y | $1.90 | $15.20 | Dallas | ✓ src ⓘ |
| TensorDock | H100 SXM | 1 | 80 GB | reserved 1y | $1.90 | $1.90 | Dallas | ✓ src ⓘ |
| DigitalOcean | MI300X | 1 | 192 GB | reserved 1y | $1.91 | $1.91 | ◐ src ⓘ | |
| TensorDock | H100 SXM | 1 | 80 GB | spot | $1.91 | $1.91 | Dallas | ✓ src ⓘ |
| Modal | L40S | 1 | 48 GB | serverless per sec | $1.95 | $1.95 | ✓ src ⓘ | |
| Lambda | A100 40GB | 4 | 40 GB | on demand | $1.99 | $7.96 | ✓ src ⓘ | |
| Lambda | A100 40GB | 8 | 40 GB | on demand | $1.99 | $15.92 | ✓ src ⓘ | |
| Lambda | A100 40GB | 1 | 40 GB | on demand | $1.99 | $1.99 | ✓ src ⓘ | |
| RunPod | H100 PCIe | 1 | 80 GB | community | $1.99 | $1.99 | ✓ src ⓘ | |
| Together AI | H100 SXM | 1 | 80 GB | spot | $1.99 | $1.99 | ✓ src ⓘ | |
| Voltage Park | H100 SXM | 1 | 80 GB | on demand | $1.99 | $1.99 | ◐ src ⓘ | |
| Vultr | GH200 | 1 | 96 GB | on demand | $1.99 | $1.99 | ✓ src src2 ⓘ | |
| Crusoe | A100 80GB PCIe | 1 | 80 GB | on demand | $2 | $2 | ✓ src ⓘ | |
| Hyperstack | H100 PCIe PCIe |
1 | 80 GB | spot | $2 | $2 | ✓ src ⓘ | |
| Amazon Web Services | A10G | 8 | 24 GB | on demand | $2.04 | $16.29 | us-east-1 | ✓ src ⓘ |
| Modal | A100 40GB | 1 | 40 GB | serverless per sec | $2.10 | $2.10 | ✓ src ⓘ | |
| Fluidstack | H100 SXM | 1 | 80 GB | on demand | $2.10 | $2.10 | 2° src ⓘ | |
| Nebius | H100 SXM | 1 | 80 GB | spot | $2.15 | $2.15 | ✓ src ⓘ | |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | spot | $2.20 | $2.20 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | spot | $2.20 | $17.63 | us-central1 | ✓ src ⓘ |
| Paperspace | H100 SXM | 1 | 80 GB | reserved 3y | $2.24 | $2.24 | ✓ src ⓘ | |
| CoreWeave | L40S | 8 | 48 GB | on demand | $2.25 | $18 | North America | ✓ src |
| TensorDock | H100 SXM | 1 | 80 GB | on demand | $2.25 | $2.25 | Dallas | ✓ src ⓘ |
| Microsoft Azure | H100 SXM 400 Gb/s InfiniBand per GPU |
8 | 80 GB | spot | $2.27 | $18.17 | eastus | ✓ src src2 ⓘ |
| Lambda | GH200 | 1 | 96 GB | on demand | $2.29 | $2.29 | ✓ src ⓘ | |
| Crusoe | A100 80GB SXM | 1 | 80 GB | on demand | $2.30 | $2.30 | ✓ src ⓘ | |
| Fluidstack | H200 | 1 | 141 GB | on demand | $2.30 | $2.30 | 2° src ⓘ | |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | reserved 1y | $2.31 | $2.31 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | reserved 1y | $2.31 | $18.51 | us-central1 | ✓ src ⓘ |
| Microsoft Azure | A100 80GB PCIe Standard_NC24ads_A100_v4 |
1 | 80 GB | reserved 1y | $2.40 | $2.40 | eastus | ✓ src src2 ⓘ |
| Microsoft Azure | A100 80GB PCIe Standard_NC96ads_A100_v4 |
4 | 80 GB | reserved 1y | $2.40 | $9.60 | eastus | ✓ src src2 ⓘ |
| Nebius | H200 | 1 | 141 GB | spot | $2.45 | $2.45 | ✓ src ⓘ | |
| Modal | A100 80GB | 1 | 80 GB | serverless per sec | $2.50 | $2.50 | ✓ src ⓘ | |
| CoreWeave | RTX PRO 6000 | 8 | 96 GB | on demand | $2.50 | $20 | North America | ✓ src ⓘ |
| Hyperstack | H100 PCIe PCIe |
1 | 80 GB | on demand | $2.50 | $2.50 | ✓ src ⓘ | |
| DigitalOcean | MI300X | 1 | 192 GB | on demand | $2.59 | $2.59 | ✓ src ⓘ | |
| DigitalOcean | MI300X | 8 | 192 GB | on demand | $2.59 | $20.72 | ✓ src ⓘ | |
| RunPod | H100 NVL | 1 | 94 GB | community | $2.59 | $2.59 | ✓ src ⓘ | |
| Hyperstack | H100 PCIe NVLink NVLink bridge |
1 | 80 GB | on demand | $2.60 | $2.60 | ✓ src ⓘ | |
| Microsoft Azure | A100 80GB SXM Standard_ND96amsr_A100_v4 200 Gb/s HDR InfiniBand per GPU |
8 | 80 GB | reserved 1y | $2.62 | $20.97 | eastus | ✓ src src2 ⓘ |
| Amazon Web Services | L40S | 4 | 48 GB | on demand | $2.62 | $10.49 | us-east-1 | ✓ src ⓘ |
| Genesis Cloud | H100 | 1 | 80 GB | on demand | $2.68 | $2.68 | EU-North | 2° src ⓘ |
| Jarvislabs | H100 SXM | 1 | 80 GB | on demand | $2.69 | $2.69 | ✓ src ⓘ | |
| RunPod | H100 SXM | 1 | 80 GB | community | $2.69 | $2.69 | ✓ src ⓘ | |
| CoreWeave | A100 80GB | 8 | 80 GB | on demand | $2.70 | $21.60 | North America | ✓ src ⓘ |
| Vast.ai | H100 PCIe | 1 | 80 GB | community | $2.71 | $2.71 | ✓ src src2 ⓘ | |
| RunPod | A100 80GB | 1 | 80 GB | serverless per sec | $2.72 | $2.72 | ✓ src ⓘ | |
| Amazon Web Services | A100 40GB | 8 | 40 GB | on demand | $2.74 | $21.96 | us-east-1 | ✓ src ⓘ |
| Lambda | A100 80GB SXM | 8 | 80 GB | on demand | $2.79 | $22.32 | ✓ src ⓘ | |
| Vultr | A100 80GB SXM | 8 | 80 GB | on demand | $2.80 | $22.40 | ✓ src src2 ⓘ | |
| RunPod | H100 PCIe | 1 | 80 GB | on demand | $2.89 | $2.89 | ✓ src ⓘ | |
| Vast.ai | H100 NVL | 1 | 94 GB | community | $2.91 | $2.91 | ✓ src src2 ⓘ | |
| Together AI | H200 | 1 | 141 GB | spot | $2.99 | $2.99 | ✓ src ⓘ | |
| Vultr | H100 SXM | 8 | 80 GB | on demand | $2.99 | $23.92 | ✓ src src2 ⓘ | |
| Latitude.sh | RTX PRO 6000 | 8 | 96 GB | on demand | $3 | $24 | ◐ src ⓘ | |
| Google Cloud | A100 80GB a2-ultragpu-8g |
8 | 80 GB | spot | $3.04 | $24.33 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 80GB a2-ultragpu-1g |
1 | 80 GB | spot | $3.04 | $3.04 | us-central1 | ✓ src ⓘ |
| Vast.ai | H100 SXM | 1 | 80 GB | community | $3.14 | $3.14 | ✓ src src2 ⓘ | |
| OVHcloud | A100 80GB | 1 | 80 GB | on demand | $3.16 | $3.16 | EU | ✓ src src2 ⓘ |
| OVHcloud | A100 80GB | 4 | 80 GB | on demand | $3.16 | $12.63 | EU | ✓ src src2 ⓘ |
| RunPod | H100 NVL | 1 | 94 GB | on demand | $3.19 | $3.19 | ✓ src ⓘ | |
| Hyperstack | H100 SXM PCIe |
1 | 80 GB | on demand | $3.20 | $3.20 | ✓ src ⓘ | |
| OVHcloud | H100 | 1 | 80 GB | on demand | $3.21 | $3.21 | EU | ✓ src src2 ⓘ |
| OVHcloud | H100 | 4 | 80 GB | on demand | $3.21 | $12.86 | EU | ✓ src src2 ⓘ |
| DigitalOcean | H100 SXM | 1 | 80 GB | reserved 1y | $3.26 | $3.26 | ◐ src ⓘ | |
| Lambda | H100 PCIe | 1 | 80 GB | on demand | $3.29 | $3.29 | ✓ src ⓘ | |
| Scaleway | H100 PCIe | 2 | 80 GB | on demand | $3.29 | $6.58 | fr-par-2 | ✓ src src2 ⓘ |
| Scaleway | H100 PCIe | 1 | 80 GB | on demand | $3.29 | $3.29 | fr-par-2 | ✓ src src2 ⓘ |
| DigitalOcean | H200 | 1 | 141 GB | reserved 1y | $3.40 | $3.40 | ◐ src ⓘ | |
| Amazon Web Services | A100 80GB SXM | 8 | 80 GB | on demand | $3.43 | $27.45 | us-east-1 | ✓ src ⓘ |
| Crusoe | MI300X | 1 | 192 GB | on demand | $3.45 | $3.45 | ✓ src ⓘ | |
| RunPod | H100 SXM | 1 | 80 GB | on demand | $3.49 | $3.49 | ✓ src ⓘ | |
| Google Cloud | A100 80GB a2-ultragpu-1g |
1 | 80 GB | reserved 3y | $3.50 | $3.50 | us-central1 | ✓ src ⓘ |
| Oracle Cloud | L40S BM.GPU.L40S.4 |
4 | 48 GB | on demand | $3.50 | $14 | ✓ src src2 ⓘ | |
| Replicate | L40S | 8 | 48 GB | serverless per sec | $3.51 | $28.08 | ✓ src ⓘ | |
| Replicate | L40S | 1 | 48 GB | serverless per sec | $3.51 | $3.51 | ✓ src ⓘ | |
| RunPod | H200 | 1 | 141 GB | community | $3.59 | $3.59 | ✓ src ⓘ | |
| Scaleway | H100 SXM | 8 | 80 GB | on demand | $3.64 | $29.08 | fr-par-2 | ✓ src src2 ⓘ |
| Scaleway | H100 SXM | 4 | 80 GB | on demand | $3.67 | $14.66 | fr-par-2 | ✓ src src2 ⓘ |
| Microsoft Azure | A100 80GB PCIe | 4 | 80 GB | on demand | $3.67 | $14.69 | eastus | ✓ src src2 ⓘ |
| Microsoft Azure | A100 80GB PCIe | 1 | 80 GB | on demand | $3.67 | $3.67 | eastus | ✓ src src2 ⓘ |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | on demand | $3.67 | $3.67 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | on demand | $3.67 | $29.39 | us-central1 | ✓ src ⓘ |
| Vast.ai | H200 | 1 | 141 GB | community | $3.69 | $3.69 | ✓ src src2 ⓘ | |
| Amazon Web Services | L40S | 8 | 48 GB | on demand | $3.77 | $30.13 | us-east-1 | ✓ src ⓘ |
| Scaleway | H100 SXM | 2 | 80 GB | on demand | $3.80 | $7.60 | fr-par-2 | ✓ src src2 ⓘ |
| Microsoft Azure | H100 NVL Standard_NC40ads_H100_v5 |
1 | 94 GB | reserved 3y | $3.84 | $3.84 | eastus | ✓ src src2 ⓘ |
| Nebius | H100 SXM | 1 | 80 GB | on demand | $3.85 | $3.85 | ✓ src ⓘ | |
| Crusoe | H100 SXM | 1 | 80 GB | on demand | $3.90 | $3.90 | ✓ src ⓘ | |
| Modal | H100 SXM | 1 | 80 GB | serverless per sec | $3.95 | $3.95 | ✓ src ⓘ | |
| Nebius | B200 | 1 | 180 GB | spot | $3.95 | $3.95 | ✓ src ⓘ | |
| Hyperstack | H200 PCIe |
1 | 141 GB | on demand | $3.99 | $3.99 | ✓ src ⓘ | |
| Jarvislabs | H200 | 1 | 141 GB | on demand | $3.99 | $3.99 | ✓ src ⓘ | |
| Lambda | H100 SXM | 8 | 80 GB | on demand | $3.99 | $31.92 | ✓ src ⓘ | |
| Together AI | H100 SXM | 1 | 80 GB | on demand | $3.99 | $3.99 | ✓ src ⓘ | |
| Vultr | MI300X | 8 | 192 GB | on demand | $3.99 | $31.92 | ✓ src src2 ⓘ | |
| Oracle Cloud | A100 80GB SXM BM.GPU.A100-v2.8 |
8 | 80 GB | on demand | $4 | $32 | ✓ src src2 ⓘ | |
| Baseten | A100 80GB | 1 | 80 GB | serverless per sec | $4 | $4 | ✓ src ⓘ | |
| Lambda | H100 SXM | 4 | 80 GB | on demand | $4.09 | $16.36 | ✓ src ⓘ | |
| Together AI | B200 | 1 | 180 GB | spot | $4.09 | $4.09 | ✓ src ⓘ | |
| Microsoft Azure | A100 80GB SXM 200 Gb/s HDR InfiniBand per GPU |
8 | 80 GB | on demand | $4.10 | $32.77 | eastus | ✓ src src2 ⓘ |
| Lambda | H100 SXM | 2 | 80 GB | on demand | $4.19 | $8.38 | ✓ src ⓘ | |
| Google Cloud | A100 80GB a2-ultragpu-1g |
1 | 80 GB | reserved 1y | $4.20 | $4.20 | us-central1 | ✓ src ⓘ |
| Crusoe | H200 | 1 | 141 GB | on demand | $4.29 | $4.29 | ✓ src ⓘ | |
| Lambda | H100 SXM | 1 | 80 GB | on demand | $4.29 | $4.29 | ✓ src ⓘ | |
| DigitalOcean | H100 SXM | 8 | 80 GB | on demand | $4.41 | $35.28 | ✓ src ⓘ | |
| DigitalOcean | H100 SXM | 1 | 80 GB | on demand | $4.41 | $4.41 | ✓ src ⓘ | |
| DigitalOcean | H200 | 8 | 141 GB | on demand | $4.47 | $35.76 | ✓ src ⓘ | |
| DigitalOcean | H200 | 1 | 141 GB | on demand | $4.47 | $4.47 | ✓ src ⓘ | |
| Nebius | H200 | 1 | 141 GB | on demand | $4.50 | $4.50 | ✓ src ⓘ | |
| Modal | H200 | 1 | 141 GB | serverless per sec | $4.54 | $4.54 | ✓ src ⓘ | |
| RunPod | H200 | 1 | 141 GB | on demand | $4.59 | $4.59 | ✓ src ⓘ | |
| Google Cloud | H200 a3-ultragpu-8g |
8 | 141 GB | reserved 3y | $4.65 | $37.21 | us-central1 | ✓ src ⓘ |
| RunPod | H100 | 1 | 80 GB | serverless per sec | $4.79 | $4.79 | ✓ src ⓘ | |
| Google Cloud | H100 SXM a3-highgpu-8g |
8 | 80 GB | reserved 3y | $4.86 | $38.86 | us-central1 | ✓ src ⓘ |
| Google Cloud | B200 a4-highgpu-8g |
8 | 180 GB | spot | $4.95 | $39.63 | us-central1 | ✓ src ⓘ |
| Replicate | A100 80GB | 8 | 80 GB | serverless per sec | $5.04 | $40.32 | ✓ src ⓘ | |
| Replicate | A100 80GB | 1 | 80 GB | serverless per sec | $5.04 | $5.04 | ✓ src ⓘ | |
| Google Cloud | A100 80GB a2-ultragpu-8g |
8 | 80 GB | on demand | $5.07 | $40.55 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 80GB a2-ultragpu-1g |
1 | 80 GB | on demand | $5.07 | $5.07 | us-central1 | ✓ src ⓘ |
| Google Cloud | H100 SXM a3-megagpu-8g |
8 | 80 GB | reserved 3y | $5.08 | $40.65 | us-central1 | ✓ src ⓘ |
| Microsoft Azure | H100 NVL Standard_NC40ads_H100_v5 |
1 | 94 GB | reserved 1y | $5.24 | $5.24 | eastus | ✓ src src2 ⓘ |
| Microsoft Azure | H100 SXM Standard_ND96isr_H100_v5 400 Gb/s InfiniBand per GPU |
8 | 80 GB | reserved 3y | $5.40 | $43.16 | eastus | ✓ src src2 ⓘ |
| Replicate | H200 | 8 | — | serverless per sec | $5.49 | $43.92 | ✓ src ⓘ | |
| Replicate | H200 | 1 | — | serverless per sec | $5.49 | $5.49 | ✓ src ⓘ | |
| Replicate | H100 | 1 | 80 GB | serverless per sec | $5.49 | $5.49 | ✓ src ⓘ | |
| Replicate | H100 | 8 | 80 GB | serverless per sec | $5.49 | $43.92 | ✓ src ⓘ | |
| RunPod | H200 | 1 | 141 GB | serverless per sec | $5.93 | $5.93 | ✓ src ⓘ | |
| Paperspace | H100 SXM | 1 | 80 GB | on demand | $5.95 | $5.95 | ✓ src ⓘ | |
| RunPod | B200 | 1 | 180 GB | community | $5.98 | $5.98 | ✓ src ⓘ | |
| Together AI | H200 | 1 | 141 GB | on demand | $5.99 | $5.99 | ✓ src ⓘ | |
| Hyperstack | B200 PCIe |
1 | 192 GB | on demand | $6 | $6 | ✓ src ⓘ | |
| Oracle Cloud | MI300X BM.GPU.MI300X.8 |
8 | 192 GB | on demand | $6 | $48 | ✓ src src2 ⓘ | |
| OVHcloud | H200 | 8 | 141 GB | on demand | $6.03 | $48.22 | EU | ✓ src src2 ⓘ |
| CoreWeave | H100 SXM | 8 | 80 GB | on demand | $6.16 | $49.24 | North America | ✓ src ⓘ |
| Modal | B200 | 1 | 180 GB | serverless per sec | $6.25 | $6.25 | ✓ src ⓘ | |
| CoreWeave | H200 | 8 | 141 GB | on demand | $6.30 | $50.44 | North America | ✓ src ⓘ |
| Google Cloud | H200 a3-ultragpu-8g |
8 | 141 GB | spot | $6.36 | $50.87 | us-central1 | ✓ src ⓘ |
| Baseten | H100 | 1 | 80 GB | serverless per sec | $6.50 | $6.50 | ✓ src ⓘ | |
| CoreWeave | GH200 | 1 | 96 GB | on demand | $6.50 | $6.50 | North America | ✓ src |
| Google Cloud | H100 SXM a3-highgpu-8g |
8 | 80 GB | spot | $6.62 | $52.96 | us-central1 | ✓ src ⓘ |
| Lambda | B200 | 8 | 180 GB | on demand | $6.69 | $53.52 | ✓ src ⓘ | |
| Lambda | B200 | 4 | 180 GB | on demand | $6.79 | $27.16 | ✓ src ⓘ | |
| RunPod | B200 | 1 | 180 GB | on demand | $6.79 | $6.79 | ✓ src ⓘ | |
| Amazon Web Services | H100 SXM | 8 | 80 GB | on demand | $6.88 | $55.04 | us-east-1 | ✓ src ⓘ |
| Amazon Web Services | H100 SXM | 1 | 80 GB | on demand | $6.88 | $6.88 | us-east-1 | ✓ src ⓘ |
| Lambda | B200 | 2 | 180 GB | on demand | $6.89 | $13.78 | ✓ src ⓘ | |
| Microsoft Azure | H100 NVL | 1 | 94 GB | on demand | $6.98 | $6.98 | eastus | ✓ src src2 ⓘ |
| Google Cloud | H100 SXM a3-megagpu-8g |
8 | 80 GB | spot | $6.99 | $55.89 | us-central1 | ✓ src ⓘ |
| Lambda | B200 | 1 | 180 GB | on demand | $6.99 | $6.99 | ✓ src ⓘ | |
| Google Cloud | B200 a4-highgpu-8g |
8 | 180 GB | reserved 3y | $7.09 | $56.71 | us-central1 | ✓ src ⓘ |
| Nebius | B200 | 1 | 180 GB | on demand | $7.15 | $7.15 | ✓ src ⓘ | |
| Google Cloud | H200 a3-ultragpu-8g |
8 | 141 GB | reserved 1y | $7.31 | $58.47 | us-central1 | ✓ src ⓘ |
| Google Cloud | H100 SXM a3-highgpu-8g |
8 | 80 GB | reserved 1y | $7.67 | $61.38 | us-central1 | ✓ src ⓘ |
| Microsoft Azure | H100 SXM Standard_ND96isr_H100_v5 400 Gb/s InfiniBand per GPU |
8 | 80 GB | reserved 1y | $7.87 | $62.92 | eastus | ✓ src src2 ⓘ |
| Amazon Web Services | H200 | 8 | 141 GB | on demand | $7.91 | $63.30 | us-east-1 | ✓ src ⓘ |
| Google Cloud | H100 SXM a3-megagpu-8g |
8 | 80 GB | reserved 1y | $8.03 | $64.21 | us-central1 | ✓ src ⓘ |
| Together AI | B200 | 1 | 180 GB | on demand | $8.19 | $8.19 | ✓ src ⓘ | |
| Vultr | B200 | 8 | 192 GB | on demand | $8.50 | $68 | ✓ src src2 ⓘ | |
| CoreWeave | B200 | 8 | 180 GB | on demand | $8.60 | $68.80 | North America | ✓ src ⓘ |
| RunPod | B200 | 1 | 180 GB | serverless per sec | $8.64 | $8.64 | ✓ src ⓘ | |
| Vast.ai | B200 | 1 | 180 GB | community | $8.76 | $8.76 | ✓ src src2 ⓘ | |
| Baseten | B200 | 1 | 180 GB | serverless per sec | $9.98 | $9.98 | ✓ src ⓘ | |
| Oracle Cloud | H200 BM.GPU.H200.8 |
8 | 141 GB | on demand | $10 | $80 | ✓ src src2 ⓘ | |
| Oracle Cloud | H100 SXM BM.GPU.H100.8 |
8 | 80 GB | on demand | $10 | $80 | ✓ src src2 ⓘ | |
| CoreWeave | GB200 | 4 | 186 GB | on demand | $10.50 | $42 | North America | ✓ src ⓘ |
| Google Cloud | H200 a3-ultragpu-8g |
8 | 141 GB | on demand | $10.60 | $84.81 | us-central1 | ✓ src ⓘ |
| Google Cloud | H100 SXM a3-highgpu-8g |
8 | 80 GB | on demand | $11.06 | $88.49 | us-central1 | ✓ src ⓘ |
| Google Cloud | B200 a4-highgpu-8g |
8 | 180 GB | reserved 1y | $11.12 | $88.93 | us-central1 | ✓ src ⓘ |
| Google Cloud | H100 SXM a3-megagpu-8g |
8 | 80 GB | on demand | $11.68 | $93.40 | us-central1 | ✓ src ⓘ |
| Microsoft Azure | H100 SXM 400 Gb/s InfiniBand per GPU |
8 | 80 GB | on demand | $12.29 | $98.32 | eastus | ✓ src src2 ⓘ |
| Oracle Cloud | B200 BM.GPU.B200.8 |
8 | 180 GB | on demand | $14 | $112 | ✓ src src2 ⓘ | |
| Amazon Web Services | B200 | 8 | 180 GB | on demand | $14.24 | $114 | us-east-1 | ✓ src ⓘ |