Inferbase
Beta
NVIDIA V100 SXM2 32GB
Datacenter
The V100 pioneered Tensor Cores and mixed-precision training with 32GB HBM2 memory. A landmark GPU that defined modern AI infrastructure, still deployed for many workloads.
VRAM
32 GB
Memory
HBM2
Bandwidth
900 GB/s
TDP
300W
Suitable Workloads
Smaller Language Models
Inference for 7B-13B parameter models
Enterprise Deployment
Designed for 24/7 datacenter operations
Key Highlights
- Built on Volta architecture
- 640 AI accelerator cores for tensor operations
- 5,120 compute cores for parallel processing
- SXM2 form factor
Memory
VRAM32 GB
Memory TypeHBM2
Memory Bandwidth900 GB/s
Compute Performance
FP32 (Single Precision)15.7 TFLOPS
FP16 (Half Precision)125 TFLOPS
Architecture
ArchitectureVolta
Compute Cores5,120
AI Accelerators640
Release Year2018
Power & Physical
TDP300 W
Max Power300 W
Form FactorSXM2
PCIe GenerationGen3
Interconnect
Multi-GPU SupportYes
Interconnect Bandwidth300 GB/s
Pricing
MSRP$8,000
Notes
Previous gen flagship
Models That May Fit on NVIDIA V100 SXM2 32GB
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
Related Tools
Added Jan 25, 2026
Last updated: Jan 25, 2026
Build Your AI Stack with Confidence
Explore models, compare pricing and benchmarks, and right-size your infrastructure — all in one place.