Google DeepMind releases Gemma 4 12B: encoder-free multimodal model runs on 16GB RAM

Google DeepMind has released Gemma 4 12B, a 12-billion parameter multimodal model designed to run locally on consumer laptops with 16GB of RAM. The model eliminates traditional multimodal encoders, processing vision and audio inputs directly through its language model backbone.

Technical architecture

Gemma 4 12B differs from conventional multimodal models by removing separate encoder modules:

• Vision processing: Replaces the vision encoder with a single matrix multiplication, positional embedding, and normalization layers, allowing the LLM backbone to handle visual processing directly
• Audio processing: Projects raw audio signals into the same dimensional space as text tokens without any encoder
• Memory footprint: Requires 16GB of VRAM or unified memory for local inference

According to Google DeepMind, this architecture reduces latency and memory usage compared to encoder-based approaches.

Performance and positioning

Google DeepMind claims Gemma 4 12B delivers benchmark performance approaching its larger 26B Mixture of Experts model at less than half the memory footprint. Specific benchmark scores were not disclosed. The model sits between the company's edge-focused E4B and the 26B MoE in terms of capability and size.

Gemma 4 12B is the first mid-sized model in the Gemma family to support native audio inputs alongside text and vision.

Availability and ecosystem support

The model is released under an Apache 2.0 license and available now through:

• Direct download from Hugging Face and Kaggle
• Inference tools: LM Studio, Ollama, Hugging Face Transformers, llama.cpp, MLX, SGLang, and vLLM
• Fine-tuning: Unsloth support
• Deployment: Google Cloud via Gemini Enterprise Agent Platform Model Garden, Cloud Run, and GKE

Google also released an official Skills Repository library for agent development with Gemma models.

The company states the Gemma 4 model family has reached 150 million downloads. The model includes Multi-Token Prediction drafters for latency reduction.

What this means

Gemma 4 12B represents a shift toward unified multimodal architectures that eliminate specialized encoder modules. By processing raw audio and simplified vision embeddings directly in the LLM backbone, Google is betting on architectural simplicity over modular design. The 16GB memory requirement makes this genuinely laptop-deployable for developers, though actual performance relative to encoder-based alternatives remains to be independently verified. The Apache 2.0 license and broad tooling support position this as a practical option for local multimodal inference.