Amazon Bedrock adds Gemma 4 models with 256K context and built-in reasoning mode
Amazon Web Services today announced availability of Google DeepMind's Gemma 4 family on Amazon Bedrock. The open-weight models include three instruction-tuned variants spanning 2.3B to 30.7B parameters, with 256K context windows, multimodal input support, and built-in reasoning mode.
Amazon Web Services today announced availability of Google DeepMind's Gemma 4 family on Amazon Bedrock. The open-weight models include three instruction-tuned variants spanning 2.3B to 30.7B parameters, with 256K context windows, multimodal input support, and built-in reasoning mode.
Three model variants
The Gemma 4 family includes:
- Gemma 4 31B: Dense architecture with 30.7B parameters, 256K context window
- Gemma 4 26B-A4B: Mixture-of-experts design with 25.2B total parameters but only 3.8B active per token, 256K context window
- Gemma 4 E2B: Compact model with 5.1B total parameters (2.3B effective), 128K context window
All three variants support text and image input, native function calling, and over 35 languages. According to AWS, independent benchmarks from Artificial Analysis report an Intelligence Index of 39 for Gemma 4 31B, compared to a median of 15 in the 4B-40B open-weights class.
Technical architecture
The models use hybrid attention that interleaves local and global attention to maintain long context support while reducing memory footprint. The 26B-A4B variant activates only 3.8B parameters per token despite having 25.2B total, delivering what AWS describes as "4B-class cost and latency with the knowledge capacity of a larger model."
The E2B variant uses Per-Layer Embeddings (PLE) to keep its effective parameter count at 2.3B of 5.1B total parameters.
Built-in reasoning mode
All Gemma 4 variants include a built-in reasoning mode that, when enabled, emits the model's internal thought process before producing the final answer. AWS documentation notes that in multi-turn conversations, only final answers from previous turns should be sent back to the model, not their reasoning items, as "replaying prior reasoning back to the model can degrade its responses."
Service access
The models are accessed through Amazon Bedrock's bedrock-mantle endpoint, which uses an OpenAI-compatible API. The endpoint URL is https://bedrock-mantle.{region}.api.aws/openai/v1 and supports both Chat Completions and Responses APIs.
All three variants are available in Standard, Priority, and Flex service tiers. AWS states that prompts and completions are not used to train any models and content is not shared with third parties.
The models are released under the Apache 2.0 license, allowing independent evaluation of model architecture and training methodology.
What this means
Gemma 4's availability on Bedrock gives enterprises access to competitive open-weight models through AWS infrastructure without managing inference stacks. The MoE variant's 3.8B active parameters at 25.2B total capacity represents a meaningful efficiency gain for high-throughput workloads. The 256K context window matches or exceeds most competing models, though pricing details were not disclosed in the announcement, making direct cost comparisons premature.
Related Articles
DeepSeek Ships V4.1-Flash With Novel Encoder-Decoder Architecture, Cuts KV Cache to 1/8 of Predecessor
DeepSeek released V4.1-Flash, a 763B-parameter model built on a new causal encoder-decoder architecture that splits 8B active parameters for prefill and 16B for decode. The model adds native vision support, a 1M-token context window, and shrinks KV cache footprint to roughly 1/8 of DeepSeek V4 Flash, while retiring V4 Pro.
Unverified 'GPT Astra' Model Appears on OpenRouter With 1.05M Token Context, No OpenAI Confirmation
OpenRouter is listing a model called 'OpenAI GPT Astra Latest' with a 1.05 million token context window and $10/$50 per-million-token pricing. OpenAI has made no public announcement, and the listing's own description says it is an auto-redirecting alias rather than a fixed model.
OpenRouter Lists 'GPT Sol Latest' — An Alias Pointer to OpenAI's Newest Sol-Family Model, Not a Standalone Release
OpenRouter has added a listing called '~openai/gpt-sol-latest,' described as an alias that always points to the newest model in an undisclosed 'GPT Sol' family from OpenAI. The listing shows a 1050K token context window and pricing of $2.00 per million input tokens and $10.00 per million output tokens, but OpenAI has not publicly confirmed a model line by this name.
DeepSeek Launches V4.1 Flash: Low-Cost MoE Model Claims to Beat V4 Pro
DeepSeek has released V4.1 Flash, a sparse mixture-of-experts model priced at $0.30 per 1M input tokens and $1.20 per 1M output tokens with a 1 million token context window. DeepSeek claims the model exceeds the larger V4 Pro on performance, speed, and task completion time.
Comments
Loading...