VRAM
96 GB
Memory
GDDR7 ECC
Bandwidth
1792 GB/s
TDP
600W
Large Language Models
Training and inference for models like GPT-4, Llama 70B+
Deep Learning Training
High-performance training for neural networks
Actively cooled workstation variant (full 1792 GB/s vs the down-clocked Server Edition). List price raised to $13,250 in June 2026 (from ~$8.5K at launch).
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
Added Jul 30, 2026
Last updated: Jul 30, 2026
Every month new models become cheaper, faster, and more capable. Inferbase ensures your application automatically benefits without changing a single API call.