Qwen builds the Qwen 2.5 3B Instruct model, a chat model exceling at instruction following, generating long texts, and understanding structured data, thanks to its specialized training and architecture. Notably, it features a transformer architecture with RoPE, SwiGLU, RMSNorm, and other optimizations, and supports a context window of up to 32,768 tokens.
Input
Output
Context
33K
Max Output
8K
Parameters
3.1B
Input Modalities
Output Modalities
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Data sourced from official provider APIs and documentation
Last updated: Aug 8, 2026
Every month new models become cheaper, faster, and more capable. Inferbase ensures your application automatically benefits without changing a single API call.