Gemma 4 12B IT QAT Q4_0 Unquantized is an open-source, multimodal chat model from Google that processes text, image, and audio inputs to generate text, image, and audio outputs. It is designed for chat applications and can call tools through its API for functions, extended thinking, and parallel tool calls.
Input
Output
Context
262K
Max Output
-
Parameters
12B
Input Modalities
Output Modalities
Some values come from web research and may be incorrect. Report incorrect data
None the catalog can show from stated facts or measured scores.
| Precision | Weights | One request at 33K tokens | Smallest GPU that fits |
|---|---|---|---|
| FP16 / BF16 | 22.3 GB | 27.5 GB | 1x Tenstorrent Blackhole p150 (32 GB) |
| INT8 | 11.1 GB | 15.8 GB | 1x NVIDIA GeForce RTX 3090 (24 GB) |
| INT4 | 5.57 GB | 9.97 GB | 1x NVIDIA T4 (16 GB) |
Computed by Inferbase from the 11,959,730,224 parameters in the creator's Hugging Face repository; one request adds its KV cache, activations and framework overhead, with the layer layout estimated from the parameter count.
Public resources
Specification sources
As of Nov 11, 2026.
Answered from the facts on this page, with their sources.
Gemma 4 12B IT QAT Q4_0 Unquantized has a context window of 262,144 tokens (source: Creator or provider API). A provider may serve less; Inferbase routes on what each provider serves.
Yes. Gemma 4 12B IT QAT Q4_0 Unquantized is an open-weight model under the Apache 2.0 license. You can download and self-host it within the license terms.
Gemma 4 12B IT QAT Q4_0 Unquantized has 11,959,730,224 parameters (12B), as stated in the creator's Hugging Face repository.
Strengths: Open weights under a permissive license (apache-2.0); 262K token context window. Each is computed from the model's stated facts and benchmark results.
Gemma 4 12B IT QAT Q4_0 Unquantized accepts Text, Image and Audio and produces Text, Image and Audio. The Capabilities card lists the API features it supports, such as function calling and structured output.
No benchmark source has published a result for Gemma 4 12B IT QAT Q4_0 Unquantized yet, so it is shown as unmeasured, not estimated.
Not on Inferbase Managed today. Add your own provider key or endpoint that serves Gemma 4 12B IT QAT Q4_0 Unquantized, and Inferbase runs it on your account with the same routing and logs.
The weights take 22.3 GB at FP16 / BF16, 11.1 GB at INT8, 5.6 GB at INT4, computed from the 11,959,730,224 parameters its creator publishes. Each request adds its KV cache and the framework's overhead. The hardware section shows one request and the smallest GPU that fits; the GPU planner sizes it for your context length and traffic.
Start on the free plan with 5,000 requests a month, no card required.