AGAnchorGPU

H200 SXM vs L40S

H200 SXM vs L40S: specs and rental cost

Compare memory, node configurations, and fixed weekly and monthly cost before choosing between NVIDIA H200 SXM and NVIDIA L40S.

Decision summary

H200 SXM provides 93 GB more VRAM per card. L40S costs $1,416 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.

NVIDIA

H200 SXM

LLM inference · fine-tuning

$1,832/ 30 days
View GPU
VS
NVIDIA

L40S

video · inference

$416/ 30 days
View GPU
SpecificationH200 SXML40S
ArchitectureHopperAda
VRAM141 GB HBM3e48 GB GDDR6 ECC
Host resources / card24 vCPU · 192 GB RAM16 vCPU · 128 GB RAM
Local NVMe / card3.84 TB2 TB
7-day price / card$512$118
30-day price / card$1,832$416
4-GPU node / 30 days$6,742$1,531
Catalog quantity265 cards430 cards