Qwen 2.5 0.5B is a chat model developed by Qwen, featuring a transformer architecture with RoPE, SwiGLU, RMSNorm, and Attention QKV bias, and supporting up to 32,768 tokens in its context window. It is particularly suited for tasks that require knowledge, coding, and mathematics capabilities, as well as instruction following and generating structured outputs like JSON. With its open-source license, this model can be further fine-tuned for specific applications, although the creators recommend post-training for conversation use cases.
Input
Output
Context
33K
Max Output
-
Parameters
494M
Input Modalities
Output Modalities
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Data sourced from official provider APIs and documentation
Last updated: Jun 23, 2026
Automatically route workloads to the right model for every task, every time.