Llama 3.2 1B Instruct
Meta AI's Llama 3.2 1B Instruct Qlora_int 4_EO 8 is a multilingual large language model optimized for dialogue use cases, including agentic retrieval and summarization tasks, with capabilities such as function calling, JSON mode, and text generation. It is particularly suited for tasks that require a large context window, with a context length of 131,072 tokens.
Input
Output
Context
131K
Max Output
-
Parameters
1.2B
Technical Specifications
Model TypeChat
Context Window131,072 tokens
Max Output TokensNot available
Parameters1.2B
Release DateSep 18, 2024
Training CutoffDec 1, 2023
Licensellama3.2
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Benchmarks
Artificial Analysis
5.3%
HLE
19.6%
GPQA
1.7%
SciCode
14.0%
MATH 500
20.0%
MMLU Pro
0.600
Coding
1.9%
LiveCodeBench
1.1
Intelligence
86.5
Speed (tok/s)
0.586
TTFA (s)
0.586
TTFT (s)
Resources & Links
Estimated GPU Requirements for Llama 3.2 1B Instruct
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.