Llama 3.1 Nemotron Ultra 253B v1
Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node. Note: you must include `detailed thinking on` in the system prompt to enable reasoning. Please see [Usage Recommendations](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1#quick-start-and-usage-recommendations) for more.
Input
Output
Context
131K
Max Output
—
Parameters
253B
Technical Specifications
Capabilities
Input Modalities
Output Modalities
Benchmarks
Pricing
per 1M tokens • updated regularlyPricing
Input
$0.600
Output
$1.80
Available on 1 Platform
| Platform | Input | Output |
|---|---|---|
OpenRouter | $0.600 | $1.80 |
Estimated GPU Requirements for Llama 3.1 Nemotron Ultra 253B v1
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Mar 24, 2026
Build Your AI Stack with Confidence
Explore models, compare pricing and benchmarks, and right-size your infrastructure — all in one place.