Mistral Nemo Base 2407
Mistral develops the Mistral Nemo Base 2407, a 12B-parameter large language model trained jointly with NVIDIA, exceling at generative text tasks, particularly with its large 131,072-token context window. Its transformer architecture, featuring 40 layers and a vocabulary size of approximately 128k, is notable for its use of SwiGLU activation function and rotary embeddings.
Input
Output
Context
131K
Max Output
16K
Parameters
12.2B
Technical Specifications
Input Modalities
Output Modalities
Capabilities
Estimated GPU Requirements for Mistral Nemo Base 2407
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
More Models by Mistral
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Aug 8, 2026
Your AI stack shouldn't stand still.
Every month new models become cheaper, faster, and more capable. Inferbase ensures your application automatically benefits without changing a single API call.