H100 SXM
training · high-throughput inference
$1,352/ 30 days
View GPU H100 SXM vs RTX 3090
Compare memory, node configurations, and fixed weekly and monthly cost before choosing between NVIDIA H100 SXM and NVIDIA RTX 3090.
H100 SXM provides 56 GB more VRAM per card. RTX 3090 costs $1,168 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.
training · high-throughput inference
prototyping · image generation
| Specification | H100 SXM | RTX 3090 |
|---|---|---|
| Architecture | Hopper | Ampere |
| VRAM | 80 GB HBM3 | 24 GB GDDR6X |
| Host resources / card | 24 vCPU · 192 GB RAM | 12 vCPU · 96 GB RAM |
| Local NVMe / card | 3.84 TB | 1 TB |
| 7-day price / card | $380 | $52 |
| 30-day price / card | $1,352 | $184 |
| 4-GPU node / 30 days | $4,975 | $677 |
| Catalog quantity | 690 cards | 245 cards |