Deberta Base
Deberta Base is an open-source chat model developed by Microsoft, exceling at text generation tasks. It achieves notable scores on natural language understanding (NLU) tasks, including a score of 93.1 on SQuAD 1.1, with its disentangled attention mechanism being a key technical trait.
Input
Output
Context
1K
Max Output
-
Parameters
184M
Technical Specifications
Model TypeChat
Context Window512 tokens
Max Output TokensNot available
Parameters184M
Release DateMar 2, 2022
Training CutoffNot available
Licensemit
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Resources & Links
Estimated GPU Requirements for Deberta Base
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 23, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.