SageMaker HyperPod

AWS has launched model caching for Amazon SageMaker Inference on HyperPod, pre-loading model weights and container images onto cluster nodes to cut inference pod startup times from tens of minutes to seconds. The feature targets large models like DeepSeek-R1, which previously took 30+ minutes to become servable during scale-out events.

Moonshot AI released Kimi K3 on July 27, 2026, a 2.8 trillion parameter Mixture-of-Experts model with a 1 million token context window and native multimodal support. AWS has published a deployment guide covering SageMaker HyperPod and Amazon EKS using ml.p6-b300.48xlarge instances with 8 NVIDIA B300 Blackwell Ultra GPUs.

AWS has released infrastructure for deploying multi-turn reinforcement learning to train Amazon Nova models on SageMaker HyperPod. The system requires a minimum of 10 ml.p5.48xlarge instances and costs approximately $786-$1,180 per hour when running.