OpenAI API compatibility
1 article tagged with OpenAI API compatibility
September 18, 2026
product updateAmazon Web Services
AWS Ships 13 SageMaker Inference Features in 2026, Cutting Startup Latency 51% and GPT-OSS-20B Throughput 2x
Amazon rolled out 13 new SageMaker AI inference capabilities in 2026 across managed endpoints and HyperPod Inference, spanning automated benchmarking, instance-pool fallback, OpenAI-compatible APIs, and container caching. AWS claims container caching cut endpoint startup latency by 51% and an inference-recommendation feature doubled GPT-OSS-20B throughput at equal latency.