product updateAmazon Web Services

AWS Releases AgentCore Platform for Building Voice AI Agents with Nova 2 Sonic Integration

TL;DR

Amazon has released Bedrock AgentCore, a platform for building and deploying AI agents with microVM isolation for secure session handling. The platform integrates with Amazon Nova 2 Sonic, a speech-to-speech foundation model, and supports the Model Context Protocol (MCP) for connecting agents to backend services.

2 min read
0

AWS Releases AgentCore Platform for Building Voice AI Agents with Nova 2 Sonic Integration

Amazon has released Bedrock AgentCore, a platform for building, deploying, and operating AI agents at scale. The platform features microVM isolation for user sessions and integrates with Amazon Nova 2 Sonic, a speech-to-speech foundation model available through Amazon Bedrock.

Platform Architecture

Bedrock AgentCore consists of two main components:

AgentCore Runtime hosts AI agents with microVM isolation, according to AWS. Each user session runs in an isolated virtual machine to prevent cross-session interference and data access. The runtime supports WebSocket protocol for real-time bidirectional audio streaming.

AgentCore Gateway provides standardized communication between agents and backend services using the Model Context Protocol (MCP), an open standard for connecting AI applications to external data sources and tools. The gateway exposes backend REST APIs as MCP tools that agents can discover and invoke.

Nova 2 Sonic Integration

The platform integrates with Amazon Nova 2 Sonic for real-time voice interactions. The model processes speech-to-speech without intermediate text conversion. When a user speaks an order, the agent processes voice input through Nova 2 Sonic, invokes backend tools asynchronously through AgentCore Gateway, and streams contextualized voice responses back over the WebSocket connection.

Reference Implementation

AWS published a reference implementation for an omnichannel ordering system on GitHub. The implementation uses AWS CDK for infrastructure deployment and includes:

  • Amazon Cognito for OAuth 2.0 authentication
  • API Gateway for REST endpoint exposure with IAM authorization
  • Lambda functions for business logic execution
  • DynamoDB for data storage with single-digit millisecond latency
  • AWS Location Services for pickup recommendations
  • AWS Amplify for frontend hosting

The authentication flow uses SigV4-signed WebSocket connections. Users authenticate with Cognito to receive JWT tokens, exchange ID tokens for temporary AWS credentials, and establish WebSocket connections to AgentCore Runtime. The runtime validates access tokens by calling the Cognito GetUser API and extracts verified customer context.

Requirements

The platform requires foundation model access for Amazon Nova 2 Sonic in Amazon Bedrock, Node.js 20.x or later, Python 3.13 or later, AWS CLI 2.x, AWS CDK CLI 2.x, and Boto3 1.38.0 or later for bedrock-agentcore-control service support.

What This Means

Bedrock AgentCore addresses operational challenges in deploying voice AI at scale by providing managed infrastructure with automatic scaling and session isolation. The microVM approach prevents the "noisy neighbor" problem common in multi-tenant systems where one customer's load affects others. The MCP integration standardizes how agents connect to backend services, reducing the integration code needed when modifying backends or adding tools. However, AWS has not disclosed pricing for AgentCore Runtime or Gateway services, making total cost of ownership unclear for production deployments.

Related Articles

product update

OpenAI upgrades ChatGPT memory architecture with automatic 'dreaming' synthesis, now available to free users

OpenAI is rolling out a new memory architecture for ChatGPT that automatically synthesizes information across conversations without explicit user prompts. The company announced free tier users will access memory features for the first time, while Plus and Pro users receive expanded memory capacity.

product update

Canva adds Perplexity Computer connector for autonomous design asset creation

Canva launched a connector for Perplexity Computer that enables the AI agent platform to autonomously create editable design assets based on user prompts and data. The integration is available for Perplexity Pro, Max, Enterprise Pro, and Enterprise Max subscribers.

product update

LM Studio adds iPhone-to-Mac connection for running local LLMs via Locally app

LM Studio has released LM Link, a feature connecting its Mac app with the Locally AI iOS app to let users access local LLMs running on their Macs from their iPhones. The connection uses end-to-end encryption via Tailscale mesh VPNs and will be free during the preview period.

product update

Replit Agent now generates custom Shopify storefronts in 10 minutes from a single prompt

Replit launched an integration allowing its AI Agent to design and deploy custom Shopify storefronts from natural language prompts. The system generates the front end, provisions a Shopify store, and adds products in a single conversation, with the entire process from first prompt to accepting orders taking roughly 10 minutes.

Comments

Loading...