A100 40GB rental prices
Advertised hourly prices, normalised to per GPU-hour so an 8×H100 node and a single card compare directly.
| GPU | Providers | Offers | Cheapest on-demand | Median on-demand |
|---|---|---|---|---|
| H100 SXM | 22 | 49 | $1.79 | $3.99 |
| H200 | 16 | 26 | $2.30 | $4.54 |
| L40S | 15 | 25 | $0.87 | $1.68 |
| B200 | 13 | 22 | $6 | $7.07 |
| A100 80GB | 10 | 17 | $1.22 | $3.16 |
| A100 80GB SXM | 10 | 14 | $1.30 | $2.79 |
| L4 | 9 | 22 | $0.44 | $0.904 |
| A100 40GB | 7 | 16 | $0.89 | $1.99 |
| H100 | 6 | 8 | $1.68 | $2.95 |
| H100 PCIe | 5 | 9 | $2.50 | $3.09 |
| RTX 4090 | 5 | 8 | $0.55 | $0.645 |
| A100 80GB PCIe | 4 | 14 | $1.35 | $1.79 |
| MI300X | 4 | 6 | $2.59 | $3.45 |
| GH200 | 3 | 3 | $1.99 | $2.29 |
| H100 NVL | 3 | 7 | $3.19 | $5.08 |
| RTX 5090 | 3 | 6 | $0.99 | $0.99 |
| RTX PRO 6000 | 3 | 3 | $1.89 | $2.50 |
| T4 | 3 | 3 | — | — |
| A10 | 2 | 2 | $1.29 | $1.29 |
| A10G | 2 | 4 | $1.01 | $1.42 |
| GB200 | 1 | 1 | $10.50 | $10.50 |
| L40 | 1 | 1 | $1.25 | $1.25 |
| RTX PRO 6000 Max-Q | 1 | 1 | $1.58 | $1.58 |
| Provider | GPU | GPUs | VRAM/GPU | Billing | Per GPU-hr | Instance /hr | Region | Source |
|---|---|---|---|---|---|---|---|---|
| Vast.ai | A100 40GB | 1 | 40 GB | community | $0.67 | $0.67 | ✓ src src2 ⓘ | |
| Jarvislabs | A100 40GB | 1 | 40 GB | on demand | $0.89 | $0.89 | ✓ src ⓘ | |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | reserved 3y | $1.29 | $1.29 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | reserved 3y | $1.29 | $10.29 | us-central1 | ✓ src ⓘ |
| Cudo Compute | A100 40GB | 1 | 40 GB | on demand | $1.50 | $1.50 | 2° src ⓘ | |
| Lambda | A100 40GB | 8 | 40 GB | on demand | $1.99 | $15.92 | ✓ src ⓘ | |
| Lambda | A100 40GB | 4 | 40 GB | on demand | $1.99 | $7.96 | ✓ src ⓘ | |
| Lambda | A100 40GB | 1 | 40 GB | on demand | $1.99 | $1.99 | ✓ src ⓘ | |
| Modal | A100 40GB | 1 | 40 GB | serverless per sec | $2.10 | $2.10 | ✓ src ⓘ | |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | spot | $2.20 | $2.20 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | spot | $2.20 | $17.63 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | reserved 1y | $2.31 | $18.51 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | reserved 1y | $2.31 | $2.31 | us-central1 | ✓ src ⓘ |
| Amazon Web Services | A100 40GB | 8 | 40 GB | on demand | $2.74 | $21.96 | us-east-1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-8g |
8 | 40 GB | on demand | $3.67 | $29.39 | us-central1 | ✓ src ⓘ |
| Google Cloud | A100 40GB a2-highgpu-1g |
1 | 40 GB | on demand | $3.67 | $3.67 | us-central1 | ✓ src ⓘ |