nvidia-llama-3-1-nemotron-70b-instruct
NVIDIA's llama-3.1-nemotron-70b-instruct is a chat model capable of processing long sequences of up to 16,384 tokens, allowing it to handle complex and extended conversations. It is genuinely best at tasks that require streaming, function calling, and generating structured output.
Input
Output
Context
16K
Max Output
4K
Parameters
70B
Technical Specifications
Model TypeChat
Context Window16,384 tokens
Max Output Tokens4,096 tokens
Parameters70B
Release DateOct 12, 2024
Training CutoffDec 1, 2023
Licensellama3.1
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Resources & Links
Estimated GPU Requirements for nvidia-llama-3-1-nemotron-70b-instruct
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.