H200 SXM
LLM inference · fine-tuning
$1,832/ 30 days
View GPU H200 SXM vs RTX A5000
Compare memory, node configurations, and fixed weekly and monthly cost before choosing between NVIDIA H200 SXM and NVIDIA RTX A5000.
H200 SXM provides 117 GB more VRAM per card. RTX A5000 costs $1,680 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.
LLM inference · fine-tuning
development · light inference
| Specification | H200 SXM | RTX A5000 |
|---|---|---|
| Architecture | Hopper | Ampere |
| VRAM | 141 GB HBM3e | 24 GB GDDR6 ECC |
| Host resources / card | 24 vCPU · 192 GB RAM | 10 vCPU · 64 GB RAM |
| Local NVMe / card | 3.84 TB | 1 TB |
| 7-day price / card | $512 | $44 |
| 30-day price / card | $1,832 | $152 |
| 4-GPU node / 30 days | $6,742 | $559 |
| Catalog quantity | 265 cards | 190 cards |