Deberta V3 Small
Deberta V3 Small is a chat model developed by Microsoft, exceling at text generation tasks with its disentangled attention and enhanced mask decoder capabilities. Notably, it features a context window of 512 tokens, allowing it to process relatively long input sequences.
Input
Output
Context
1K
Max Output
1K
Parameters
143M
Technical Specifications
Model TypeChat
Context Window512 tokens
Max Output Tokens512 tokens
Parameters143M
Release DateMar 2, 2022
Training CutoffNov 16, 2021
Licensemit
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Resources & Links
Estimated GPU Requirements for Deberta V3 Small
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.