Inferbase
Beta
NVIDIA A100 PCIe 80GB
Datacenter
The A100 PCIe 80GB offers Ampere performance in a PCIe form factor with 80GB HBM2e memory. Enables enterprise deployment without specialized SXM baseboard infrastructure.
VRAM
80 GB
Memory
HBM2e
Bandwidth
1935 GB/s
TDP
300W
Suitable Workloads
Large Language Models
Training and inference for models like GPT-4, Llama 70B+
Distributed Training
Multi-node training with fast interconnects
Enterprise Deployment
Designed for 24/7 datacenter operations
Key Highlights
- Built on Ampere architecture
- 432 AI accelerator cores for tensor operations
- 6,912 compute cores for parallel processing
- PCIe form factor
Memory
VRAM80 GB
Memory TypeHBM2e
Memory Bandwidth1935 GB/s
Compute Performance
FP32 (Single Precision)156 TFLOPS
FP16 (Half Precision)312 TFLOPS
BF16312 TFLOPS
INT8624 TOPS
Architecture
ArchitectureAmpere
Compute Cores6,912
AI Accelerators432
Release Year2021
Power & Physical
TDP300 W
Max Power300 W
Form FactorPCIe
PCIe GenerationGen4 x16
Interconnect
Multi-GPU SupportYes
Interconnect Bandwidth600 GB/s
Pricing
MSRP$11,000
Notes
PCIe 80GB
Models That May Fit on NVIDIA A100 PCIe 80GB
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
Related Tools
Added Jan 25, 2026
Last updated: Jan 25, 2026
Build Your AI Stack with Confidence
Explore models, compare pricing and benchmarks, and right-size your infrastructure — all in one place.