Byt 5 Small
ByT5 Small, developed by Google, is a token-free language model that operates directly on raw UTF-8 bytes, making it particularly effective at handling noisy text data. It is best utilized after fine-tuning for a specific downstream task, and its standard Transformer architecture allows it to process byte sequences with minimal modifications.
Input
Output
Context
-
Max Output
-
Parameters
300M
Technical Specifications
Model TypeNot available
Context WindowNot available
Max Output TokensNot available
Parameters300M
Release DateMar 2, 2022
Training CutoffNot available
Licenseapache-2.0
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Estimated GPU Requirements for Byt 5 Small
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 23, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.