Mistral makes an open-source chat model called Mistral 7B Instruct V0.2. It takes text as input and generates text as output, designed for instruction-following tasks.
Input
Output
Context
33K
Max Output
256
Parameters
7.2B
Input Modalities
Output Modalities
Some values come from web research and may be incorrect. Report incorrect data
None the catalog can show from stated facts or measured scores.
Download 14.5 GB · Runs on vLLM v0.32.0 · 74 GGUF builds
| Precision | Weights | One request at 33K tokens | Smallest GPU that fits |
|---|---|---|---|
| FP16 / BF16 | 13.5 GB | 17.6 GB | 1x NVIDIA GeForce RTX 3090 (24 GB) |
| INT8 | 6.74 GB | 10.6 GB | 1x NVIDIA T4 (16 GB) |
| INT4 | 3.37 GB | 7.01 GB | 1x NVIDIA T4 (16 GB) |
Computed by Inferbase from the 7,241,732,096 parameters in the creator's Hugging Face repository; one request adds its KV cache, activations and framework overhead, with the layer layout estimated from the parameter count.
Public resources
Specification sources
As of Nov 17, 2026.
Answered from the facts on this page, with their sources.
Mistral 7B Instruct V0.2 has a context window of 32,768 tokens and a maximum output of 256 tokens (source: Creator or provider API). A provider may serve less; Inferbase routes on what each provider serves.
Yes. Mistral 7B Instruct V0.2 is an open-weight model under the Apache 2.0 license. You can download and self-host it within the license terms.
Mistral 7B Instruct V0.2 has 7,241,732,096 parameters (7.2B), as stated in the creator's Hugging Face repository.
Strengths: Open weights under a permissive license (apache-2.0). Each is computed from the model's stated facts and benchmark results.
Mistral 7B Instruct V0.2 accepts Text and produces Text. The Capabilities card lists the API features it supports, such as function calling and structured output.
No benchmark source has published a result for Mistral 7B Instruct V0.2 yet, so it is shown as unmeasured, not estimated.
Not on Inferbase Managed today. Add your own provider key or endpoint that serves Mistral 7B Instruct V0.2, and Inferbase runs it on your account with the same routing and logs.
The weights take 13.5 GB at FP16 / BF16, 6.7 GB at INT8, 3.4 GB at INT4, computed from the 7,241,732,096 parameters its creator publishes. Each request adds its KV cache and the framework's overhead. The hardware section shows one request and the smallest GPU that fits; the GPU planner sizes it for your context length and traffic.
Start on the free plan with 5,000 requests a month, no card required.