AGAnchorGPU

H200 SXM vs H100 SXM

H200 SXM vs H100 SXM: specs and rental cost

Compare memory, node configurations, and fixed weekly and monthly cost before choosing between NVIDIA H200 SXM and NVIDIA H100 SXM.

Decision summary

H200 SXM provides 61 GB more VRAM per card. H100 SXM costs $480 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.

NVIDIA

H200 SXM

LLM inference · fine-tuning

$1,832/ 30 days
View GPU
VS
NVIDIA

H100 SXM

training · high-throughput inference

$1,352/ 30 days
View GPU
SpecificationH200 SXMH100 SXM
ArchitectureHopperHopper
VRAM141 GB HBM3e80 GB HBM3
Host resources / card24 vCPU · 192 GB RAM24 vCPU · 192 GB RAM
Local NVMe / card3.84 TB3.84 TB
7-day price / card$512$380
30-day price / card$1,832$1,352
4-GPU node / 30 days$6,742$4,975
Catalog quantity265 cards690 cards