Gemma 4 26B A4B

Google DeepMind🇺🇸 United States
active
Context window262K tokens

Version History

4.0major

Gemma 4 introduces reasoning capabilities, extended 256K context, mixture-of-experts efficiency, and enhanced multimodal understanding. The 26B A4B variant activates only 3.8B of 25.2B parameters during inference for speed comparable to 4B models.

Coverage

model releaseGoogle DeepMind

Google DeepMind releases Gemma 4 open models with up to 256K context and multimodal reasoning

Google DeepMind has released Gemma 4, an open-weights model family in four sizes (2.3B to 31B parameters) with multimodal capabilities handling text, images, video, and audio. The 26B A4B variant uses mixture-of-experts to achieve 4B active parameters while supporting 256K token context windows and native reasoning modes.

3 min read