AMD Instinct MI300A
The MI300A is a revolutionary APU combining Zen 4 CPU cores with CDNA 3 GPU compute on a single package. Its unified memory architecture eliminates data transfer overhead between CPU and GPU.
VRAM
128 GB
Memory
HBM3
Bandwidth
5300 GB/s
TDP
760W
Suitable Workloads
Large Language Models
Training and inference for models like GPT-4, Llama 70B+
Deep Learning Training
High-performance training for neural networks
Distributed Training
Multi-node training with fast interconnects
High-Throughput Inference
Optimized for batched inference workloads
Key Highlights
- Built on CDNA 3 architecture
- 912 AI accelerator cores for tensor operations
- 14,592 compute cores for parallel processing
- OAM form factor
Memory
Compute Performance
Architecture
Power & Physical
Interconnect
Notes
APU combining Zen 4 CPU cores with CDNA 3 GPU. Unified memory architecture.
Models That May Fit on AMD Instinct MI300A
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
Explore More
Added Jan 27, 2026
Last updated: Apr 30, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.