Bigbird Roberta Base
Bigbird Roberta Base is a sparse-attention based transformer model developed by Google, exceling at handling long sequences such as documents and contexts, with a context window of 4,096 tokens. It utilizes block sparse attention, reducing compute cost compared to traditional attention mechanisms like BERT's.
Input
Output
Context
4K
Max Output
-
Parameters
-
Technical Specifications
Input Modalities
Output Modalities
Capabilities
Loading capabilities…
More models by Google
The creator's other models in the catalog, with their context, size and license where published.
Compare it, or keep browsing
Put this model beside its alternatives on the same evidence, or go back to the full catalog.
Frequently asked questions about Bigbird Roberta Base
Answered from the entry's own fields: context, license, modalities, evidence, serving and the memory to self-host.
Bigbird Roberta Base advertises a context window of 4,096 tokens. The figure is the creator's published maximum; a given host may serve less, and the gateway routes on what each host actually serves.
Yes. Bigbird Roberta Base is an open-weight model released under the Apache 2.0 license, so the weights can be downloaded and self-hosted within that license's terms.
Bigbird Roberta Base accepts Text and produces Embedding. The capabilities card on this page lists which API features each deployment honours, such as function calling and structured output, with the source each was checked against.
No published benchmark result for Bigbird Roberta Base is in the catalog yet, so the model is shown as unmeasured. It is not ranked or estimated; the router treats it as unknown for every task until a suite measures it.
Not on the managed pool today; Bigbird Roberta Base is listed for reference and comparison. Connect your own provider key or endpoint that serves it and the gateway runs it on your account, with routing decisions recorded the same way.
Google has not published a parameter count for Bigbird Roberta Base, so the catalog cannot estimate its memory footprint. The capacity planner can size it from a parameter count you supply.
Fields collected from public registries, host APIs and benchmark publishers, each tagged with its source.
Last updated: Aug 28, 2026
Put intelligence in the middle.
One gateway in front of every model, with your policies applied and every decision on record. Start with $5 of credit and 5,000 routing decisions a month, no card required.