Bigbird Roberta Base
Bigbird Roberta Base is a sparse-attention based transformer model developed by Google, exceling at handling long sequences such as documents and contexts, with a context window of 4,096 tokens. It utilizes block sparse attention, reducing compute cost compared to traditional attention mechanisms like BERT's.
Input
Output
Context
4K
Max Output
-
Parameters
-
Technical Specifications
Model TypeNot available
Context Window4,096 tokens
Max Output TokensNot available
ParametersNot available
Release DateMar 2, 2022
Training CutoffNot available
Licenseapache-2.0
Open SourceYes
Input Modalities
Text
Output Modalities
Embedding
Capabilities
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 23, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.