AGAnchorGPU

H100 SXM vs A40

H100 SXM vs A40: specs and rental cost

Compare memory, node configurations, and fixed weekly and monthly cost before choosing between NVIDIA H100 SXM and NVIDIA A40.

Decision summary

H100 SXM provides 32 GB more VRAM per card. A40 costs $1,160 less per 30-day term . Choose based on whether memory headroom or lower fixed cost is the binding constraint.

NVIDIA

H100 SXM

training · high-throughput inference

$1,352/ 30 days
View GPU
VS
NVIDIA

A40

rendering · inference

$192/ 30 days
View GPU
SpecificationH100 SXMA40
ArchitectureHopperAmpere
VRAM80 GB HBM348 GB GDDR6 ECC
Host resources / card24 vCPU · 192 GB RAM12 vCPU · 96 GB RAM
Local NVMe / card3.84 TB1 TB
7-day price / card$380$54
30-day price / card$1,352$192
4-GPU node / 30 days$4,975$707
Catalog quantity690 cards265 cards