NVIDIA B300 SXM
VRAM
288 GB
Memory
HBM3e
Bandwidth
8,000 GB/s
FP16
4,500 TF
TDP
1400 W
Memory and compute
Architecture and power
Notes
Blackwell Ultra. FP8 rate identical to B200 (5/10 PF dense/sparse, so FP16 sparse figure matches B200 convention); NVFP4 15 PF dense. Shipping since Jan 2026. Liquid-cooled in all form factors.
Models that may fit on NVIDIA B300 SXM
Estimates based on INT8 quantization. Actual fit depends on framework and batch size.
More GPUs by NVIDIA
The manufacturer's other cards in the catalog, largest memory first, with bandwidth and power where published.
Frequently asked questions about NVIDIA B300 SXM
Answered from the entry's own figures: memory, which models fit, bandwidth, power and the card's class.
NVIDIA B300 SXM has 288 GB of HBM3e at 8,000 GB/s. At INT8 a model's weights take about one byte per parameter, so the card holds roughly a 230B-parameter model with room for context; larger models need several cards or a lower precision.
From the catalog's estimates at INT8, Qwen3 235B A22B Thinking 2507, Minimax M2.7, Qwen3 VL 235B A22B Thinking and Minimax M2.1 fit on a single NVIDIA B300 SXM with their default context. The list on this page shows the estimated memory each takes; the capacity planner sizes any model against this card for your own context length, batch size and request rate.
8,000 GB/s. Bandwidth bounds how fast a model generates tokens, because every token reads the whole set of weights and the KV cache from memory; at this rate a 230B model at INT8 could be read on the order of 35 times a second on one card, before batching and framework efficiency.
NVIDIA B300 SXM has a TDP of 1400 W, in the SXM form factor. Budget the TDP per card plus host overhead when sizing a server's power and cooling.
NVIDIA B300 SXM is a datacenter accelerator, meant for servers and multi-GPU serving, built on the Blackwell Ultra architecture and released in 2026. It supports a multi-GPU interconnect at 1,800 GB/s, so a model larger than one card can be split across several.
Specifications from the manufacturer's published material; a figure that is not published is shown as such, and a derived one is explained in the notes.
Added Jul 30, 2026 · Last updated Jul 30, 2026
Explore more
Companion tools that draw on the same catalog and routing engine.
Put intelligence in the middle.
One gateway in front of every model, with your policies applied and every decision on record. Start with $5 of credit and 5,000 routing decisions a month, no card required.