model deployment

AWS has launched model caching for Amazon SageMaker Inference on HyperPod, pre-loading model weights and container images onto cluster nodes to cut inference pod startup times from tens of minutes to seconds. The feature targets large models like DeepSeek-R1, which previously took 30+ minutes to become servable during scale-out events.

OpenAI's GPT-5.5 and GPT-5.4 models are now generally available on Amazon Bedrock, with pricing matching OpenAI's first-party rates. Codex, OpenAI's coding agent used by 5 million developers weekly, is also available with pay-per-token pricing and no seat licenses.