Qwen builds the Qwen 2.5 1.5B Instruct model, a chat model exceling in instruction following, generating long texts, and understanding structured data, with notable strengths in coding and mathematics. Its transformer architecture incorporates RoPE, SwiGLU, RMSNorm, and Attention QKV bias, and it supports a context window of up to 32,768 tokens.
Input
Output
Context
33K
Max Output
-
Parameters
1.5B
Input Modalities
Output Modalities
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Automatically route workloads to the right model for every task, every time.