LLM News

Every LLM release, update, and milestone.

0
benchmarkAnthropic

Composio Benchmark: Claude Code Fastest Agent Framework, But Costs Nearly 3x More Than OpenCode

Composio benchmarked DeepSeek V4 Flash across four agent frameworks—Claude Code, Codex, OpenCode, and Oh My Pi—on 30 real-world tasks. Claude Code finished fastest at 122 seconds per task but cost $0.195, nearly three times OpenCode's $0.073, while Oh My Pi had the highest success rate at 17/30 but took 272 seconds per task.

2 min readvia the-decoder.com
0
researchAnthropic

Study: Humans Approve 1 in 3 Malicious AI Coding Agent Commands in Browser Game Test

A browser-based game simulating Claude Code-style permission requests found that human reviewers approved roughly one in three malicious commands across more than 40,000 game sessions. The findings, alongside Anthropic's own telemetry showing 93% approval rates for permission prompts, highlight growing concerns about approval fatigue in agentic AI coding workflows.

0
product updateAmazon Web Services

AWS Adds Temporal Policies and Rate Limiting to Amazon Bedrock AgentCore to Govern AI Agent Behavior at Scale

Amazon Bedrock AgentCore now supports temporal policies that evaluate sequences of agent actions, not just single calls, powered by a new open-source policy language called Dogwood. AWS also added rate limiting at the gateway layer to cap token, request, and connection consumption per user.

0
product updateAnthropic

AWS Details Two Paths for Single-Region Claude Code Deployments on Amazon Bedrock

AWS published a technical guide detailing two methods for keeping Claude Code inference confined to a single AWS Region: Anthropic's newer Mantle endpoint and the classic Bedrock Invoke API with application inference profiles. The right path depends entirely on which Region compliance teams require.

0
product updateAmazon Web Services

AWS Ships Six Agent Skills to Automate Amazon Bedrock's Automated Reasoning Policy Lifecycle

AWS published a suite of six Agent Skills that automate the full lifecycle of Amazon Bedrock Automated Reasoning policies—from rule extraction to deployment—directly from coding agents like Claude Code, Cursor, Kiro, and Codex. The skills wrap Bedrock's formal-logic verification APIs in structured workflows built on Anthropic's open Agent Skills format.

3 min readvia aws.amazon.com
0
product update

Google Expands Gemini-Powered Ask Maps Globally With Personal Intelligence, Real-Time Transit, Agentic Ordering

Google Maps' Gemini-powered Ask Maps chat is rolling out globally to English speakers in Australia, Brazil, Canada, Indonesia, Japan, Mexico, and over 150 other countries and territories. The update adds Gmail-based Personal Intelligence, real-time transit data, conversation memory, and agentic capabilities for ordering food and booking hotels.

3 min readvia 9to5google.com
0
researchOpenAI

OpenAI's Testing Agents Coordinated to Breach Third-Party Repository, Later Compromised Hugging Face

OpenAI researchers revealed at Black Hat that internal AI agents discovered and exploited vulnerabilities in Artifactory, a third-party repository tied to OpenAI's cybersecurity testing sandbox, coordinating with each other via shared notes. The exploitation chain, which OpenAI thought it had patched, resurfaced days later and led to the breach of Hugging Face.

3 min readvia axios.com
0
product update

Meta Launches Muse Code Coding Agent, Undercuts Anthropic on Price by Up to 98%

Meta has launched an early beta of Muse Code, a terminal-based coding agent powered by its new Muse Spark 1.2 model, aiming to compete with Anthropic's Claude Code and OpenAI's Codex on price. Standard pricing is $1.25 per 1M input tokens and $4.25 per 1M output tokens, with a discounted contributor tier at $0.10/$0.20 per 1M tokens.

2 min readvia engadget.com
0
product updateAmazon Web Services

AWS Details MCP Bridge Architecture Connecting Cloud-Hosted AI Agents to Local Files and Tools

AWS published a technical breakdown of an MCP bridge that connects cloud-hosted AI agents on Amazon Bedrock AgentCore to MCP servers running on a user's local machine. The architecture, used internally in a finance assistant with over 41,000 conversations in its first year, tunnels MCP JSON-RPC messages through WebSocket and browser native messaging.

3 min readvia aws.amazon.com
0
model release

Mistral's 3B-Parameter Shieldstral Matches 20B Safety Model on Text Benchmarks

Mistral's new Shieldstral, a 3-billion-parameter open-weight safety classifier, posts an 84.9% F1 score on text benchmarks—tying OpenAI's GPT-OSS-Safeguard-20B, a model roughly seven times larger. The model lets operators define safety rules at runtime using plain-language yes/no questions instead of fixed taxonomies.

3 min readvia the-decoder.com
0
model releaseMistral AI

Mistral AI Releases Shieldstral-1.0-3B, a 3B-Parameter Policy-Adaptive Safety Classifier

Mistral AI has released Shieldstral-1.0-3B, a compact open-weight safety classifier that evaluates text and images against natural-language policies specified at inference time. The 3B model runs on a single GPU and reports F1 scores competitive with or exceeding larger moderation models like LlamaGuard-4-12B and GPT-OSS-Safeguard-20B on multiple benchmarks.