Llama 3.1 405B FP8
Meta AI's Llama 3.1 405B FP 8 is a multilingual large language model optimized for dialogue use cases, with capabilities including function calling, JSON mode, reasoning, streaming, and text generation. It is genuinely best at handling a wide range of tasks due to its instruction-tuned training and optimized transformer architecture, which utilizes supervised fine-tuning and reinforcement learning with human feedback.
Input
Output
Context
131K
Max Output
2K
Parameters
405.9B
Technical Specifications
Input Modalities
Output Modalities
Capabilities
Resources & Links
Estimated GPU Requirements for Llama 3.1 405B FP8
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.