prompt caching

Moonshot AI's Kimi K3, described by the company as the first open model to reach 2.8 trillion parameters, is now available on Amazon Bedrock. It features native vision, a 1-million-token context window, and is the first open-weight model on Bedrock to support explicit prompt caching.

OpenAI released v3.15.0 of its Python SDK on September 18, 2026, adding managed Responses WebSocket sessions, prompt-cache prewarming, compaction progress events, and audio-mini model choices. The release also fixes a bug affecting chat stream moderation results.

Amazon Bedrock's prompt caching feature can cut input token costs by up to 90% on cache hits by storing repeated context like documents, system prompts, and tool definitions. AWS outlines six implementation patterns and pricing details, including a 25% premium for cache writes and 90% discount on cache reads.

OpenAI's GPT-5.6 Sol, Terra, and Luna models are now generally available on Amazon Bedrock, accessible through the OpenAI-compatible Responses API. The release introduces explicit prompt caching, letting developers manually mark cache boundaries for a 90% discount on reused input tokens.

Alibaba has released Qwen3.7 Max, the flagship model in its Qwen3.7 series, featuring a 1 million token context window. The text-only model is designed for agent-centric workloads with strengths in coding, office productivity, and long-horizon autonomous execution, and includes explicit prompt caching support.