Llama 3.1 405B Instruct
Meta AI's Llama 3.1 405B Instruct FP 8 is a multilingual large language model optimized for dialogue use cases, capable of functions such as text generation, reasoning, and function calling. It utilizes an optimized transformer architecture with supervised fine-tuning and reinforcement learning with human feedback, and has a context window of 4,096 tokens.
Input
Output
Context
4K
Max Output
2K
Parameters
405.9B
Technical Specifications
Model TypeChat
Context Window4,096 tokens
Max Output Tokens2,048 tokens
Parameters405.9B
Release DateJul 16, 2024
Training CutoffDec 1, 2023
Licensellama3.1
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Resources & Links
Estimated GPU Requirements for Llama 3.1 405B Instruct
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.