Llama 3.1 8B Instruct
Meta AI's Llama 3.1 8B Instruct is a multilingual large language model optimized for dialogue use cases, with capabilities including function calling, JSON mode, reasoning, streaming, and text generation. It is notable for its use of an optimized transformer architecture with supervised fine-tuning and reinforcement learning with human feedback, and its large context window of 131,072 tokens.
Input
Output
Context
131K
Max Output
4K
Parameters
8B
Technical Specifications
Model TypeChat
Context Window131,072 tokens
Max Output Tokens4,096 tokens
Parameters8B
Release DateJul 18, 2024
Training CutoffDec 1, 2023
Licensellama3.1
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Benchmarks
Artificial Analysis
5.1%
HLE
7.7%
AIME
25.9%
GPQA
13.2%
SciCode
51.9%
MATH 500
47.6%
MMLU Pro
4.3
Math
4.9
Coding
11.6%
LiveCodeBench
6.1
Intelligence
200
Speed (tok/s)
0.528
TTFA (s)
0.528
TTFT (s)
Resources & Links
Estimated GPU Requirements for Llama 3.1 8B Instruct
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.