The MI250 delivers dual-GCD CDNA 2 performance with 128GB HBM2e for demanding workloads. Optimized for high-performance computing and large-scale AI training.
VRAM
128 GB
Memory
HBM2e
Bandwidth
3277 GB/s
TDP
500W
Large Language Models
Training and inference for models like GPT-4, Llama 70B+
Distributed Training
Multi-node training with fast interconnects
High-Throughput Inference
Optimized for batched inference workloads
Enterprise Deployment
Designed for 24/7 datacenter operations
Dual-GCD design for HPC and AI training workloads.
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
Added Jan 27, 2026
Last updated: Apr 30, 2026
Every month new models become cheaper, faster, and more capable. Inferbase ensures your application automatically benefits without changing a single API call.