NVIDIA L4 instance prices: AWS vs Azure
15 instance types have NVIDIA L4 GPUs, all on AWS EC2. Per GPU, the cheapest is g6.xlarge on AWS at $0.8048 per GPU-hour on demand (1 GPU, $0.8048 per hour).
Every NVIDIA L4 option, cheapest first
| Cloud | Type | vCPUs | Memory (GiB) | GPUs | Per GPU /hr | On-demand /hr | 1-yr reserved /hr | Spot /hr |
|---|---|---|---|---|---|---|---|---|
| AWS | g6f.large | 2 | 8 | 1/8 | $1.616 | $0.202 | – | $0.058 |
| AWS | g6f.xlarge | 4 | 16 | 1/8 | $1.90 | $0.2375 | – | $0.0815 |
| AWS | g6f.2xlarge | 8 | 32 | 1/4 | $1.90 | $0.475 | – | $0.198 |
| AWS | g6.xlarge | 4 | 16 | 1 | $0.8048 | $0.8048 | $0.5239 | $0.3847 |
| AWS | g6f.4xlarge | 16 | 64 | 1/2 | $1.90 | $0.95 | – | $0.4102 |
| AWS | g6.2xlarge | 8 | 32 | 1 | $0.9776 | $0.9776 | $0.6364 | $0.7146 |
| AWS | gr6f.4xlarge | 16 | 128 | 1/2 | $2.132 | $1.066 | – | $0.2433 |
| AWS | g6.4xlarge | 16 | 64 | 1 | $1.323 | $1.323 | $0.8614 | $0.7075 |
| AWS | gr6.4xlarge | 16 | 128 | 1 | $1.539 | $1.539 | $1.002 | $0.76 |
| AWS | g6.8xlarge | 32 | 128 | 1 | $2.014 | $2.014 | $1.311 | $0.9023 |
| AWS | gr6.8xlarge | 32 | 256 | 1 | $2.446 | $2.446 | $1.593 | $1.069 |
| AWS | g6.16xlarge | 64 | 256 | 1 | $3.397 | $3.397 | $2.211 | $1.208 |
| AWS | g6.12xlarge | 48 | 192 | 4 | $1.15 | $4.602 | $2.996 | $1.735 |
| AWS | g6.24xlarge | 96 | 384 | 4 | $1.669 | $6.675 | $4.346 | $2.211 |
| AWS | g6.48xlarge | 192 | 768 | 8 | $1.669 | $13.35 | $8.691 | $1.893 |
Other GPUs
AMD alveo U250 fpga 64 gbAMD instinct MI25 16 gbAMD radeon pro V520AMD radeon pro V620 32 gbAMD radeon pro V710aws inferentiaaws INFERENTIA2aws trainiumNVIDIA A10NVIDIA A10 24 gbNVIDIA A10GNVIDIA A100NVIDIA H100NVIDIA H200NVIDIA L40SNVIDIA pcie A100 80 gbNVIDIA pcie H100 94 gbNVIDIA rtx pro 4500NVIDIA rtx pro server 6000NVIDIA T4NVIDIA T4GNVIDIA tesla K80NVIDIA tesla M60NVIDIA tesla M60 16 gbNVIDIA tesla T4 16 gbNVIDIA tesla V100NVIDIA tesla V100 16 gb
On-demand Linux prices in USD per hour, in each cloud's home region: US East (N. Virginia) for AWS, East US for Azure. Previous-generation types are left out.