A100 SXM
training · batch inference
$792/ 30 days
View GPU A100 SXM vs RTX 4090
Compare memory, node configurations, and fixed weekly and monthly cost before choosing between NVIDIA A100 SXM and NVIDIA RTX 4090.
A100 SXM provides 56 GB more VRAM per card. RTX 4090 costs $480 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.
training · batch inference
image generation · video
| Specification | A100 SXM | RTX 4090 |
|---|---|---|
| Architecture | Ampere | Ada |
| VRAM | 80 GB HBM2e | 24 GB GDDR6X |
| Host resources / card | 20 vCPU · 160 GB RAM | 16 vCPU · 128 GB RAM |
| Local NVMe / card | 2 TB | 2 TB |
| 7-day price / card | $224 | $88 |
| 30-day price / card | $792 | $312 |
| 4-GPU node / 30 days | $2,915 | $1,148 |
| Catalog quantity | 780 cards | 590 cards |