MI300X
large models · ROCm workloads
$1,272/ 30 days
View GPU MI300X vs A40
Compare memory, node configurations, and fixed weekly and monthly cost before choosing between AMD Instinct MI300X and NVIDIA A40.
MI300X provides 144 GB more VRAM per card. A40 costs $1,080 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.
large models · ROCm workloads
rendering · inference
| Specification | MI300X | A40 |
|---|---|---|
| Architecture | CDNA 3 | Ampere |
| VRAM | 192 GB HBM3 | 48 GB GDDR6 ECC |
| Host resources / card | 28 vCPU · 256 GB RAM | 12 vCPU · 96 GB RAM |
| Local NVMe / card | 3.84 TB | 1 TB |
| 7-day price / card | $360 | $54 |
| 30-day price / card | $1,272 | $192 |
| 4-GPU node / 30 days | $4,681 | $707 |
| Catalog quantity | 430 cards | 265 cards |