Qwen builds the Qwen 2.5 3B Instruct model, a chat model exceling at instruction following, generating long texts, and understanding structured data, thanks to its specialized training and architecture. Notably, it features a transformer architecture with RoPE, SwiGLU, RMSNorm, and other optimizations, and supports a context window of up to 32,768 tokens.
Input
Output
Context
33K
Max Output
-
Parameters
3.1B
Input Modalities
Output Modalities
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Automatically route workloads to the right model for every task, every time.