Gemma 4 12B Unified

Name: Gemma 4 12B Unified
Author: Google DeepMind

Google DeepMind🇺🇸 United States

active

Compare with other models →

Context window256K tokens

Version History

4majorJune 3, 2026

Gemma 4 12B Unified introduces encoder-free multimodal architecture that processes text, images, and audio through a single decoder-only transformer, eliminating separate vision and audio encoders while maintaining 256K context window and strong benchmark performance.

Coverage

model releaseGoogle DeepMind

Google DeepMind releases Gemma 4 12B Unified: encoder-free multimodal model with 256K context window

Google DeepMind has released Gemma 4 12B Unified, an encoder-free multimodal model that processes text, images, and audio through a single decoder-only transformer. The model features 11.95 billion parameters, a 256K token context window, and achieves 77.2% on MMLU Pro and 72.0% on LiveCodeBench v6.

June 3, 2026 · 5:51 PM3 min read

google-deepmind gemma-4 multimodal