NVIDIA H100 SXM
The H100 SXM is NVIDIA's flagship datacenter GPU for AI training, built on the Hopper architecture with 4th-gen Tensor Cores. With 80GB HBM3 and 900GB/s NVLink, it excels at large-scale distributed training.
VRAM
80 GB
Memory
HBM3
Bandwidth
3350 GB/s
TDP
700W
Suitable Workloads
Large Language Models
Training and inference for models like GPT-4, Llama 70B+
Deep Learning Training
High-performance training for neural networks
Distributed Training
Multi-node training with fast interconnects
High-Throughput Inference
Optimized for batched inference workloads
Key Highlights
- Built on Hopper architecture
- 528 AI accelerator cores for tensor operations
- 16,896 compute cores for parallel processing
- SXM5 form factor
Memory
Compute Performance
Architecture
Power & Physical
Interconnect
Pricing
Notes
Flagship datacenter GPU for AI training
Models That May Fit on NVIDIA H100 SXM
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
Related Tools
Added Jan 25, 2026
Last updated: Jan 25, 2026
Build Your AI Stack with Confidence
Explore models, compare pricing and benchmarks, and right-size your infrastructure — all in one place.