product update

Google's Gemini API Agent Skill boosts coding task success from 28% to 97%

TL;DR

Google has released an Agent Skill for the Gemini API that provides language models with current information about their own APIs, SDKs, and best practices. Testing across 117 coding tasks showed Gemini 3.1 Pro's success rate jumped from 28.2% to 96.6%, though older 2.5-series models showed minimal improvement.

2 min read
0

Google Addresses AI Models' Knowledge Gap With New Gemini Agent Skill

Google has launched an Agent Skill for the Gemini API designed to solve a core limitation of large language models: their training data has a cutoff date, leaving them unaware of their own API updates, SDK changes, and current best practices.

The new skill feeds live information to Gemini coding agents about current models, available SDKs, and sample code implementations. In testing across 117 coding tasks, the results were stark: Gemini 3.1 Pro Preview's success rate jumped from 28.2% to 96.6% when using the Agent Skill.

Performance Varies Significantly by Model Generation

Not all Gemini models benefited equally. Google attributes the stark difference to reasoning capabilities: newer 3-series models showed dramatic improvements, while older 2.5-series models saw only marginal gains. This suggests the Agent Skill's effectiveness depends on the underlying model's ability to apply contextual information effectively.

Google released the Agent Skill publicly on GitHub, making it available for developers integrating Gemini APIs into coding applications.

Competing Approaches Emerging

The release comes as the industry converges on multiple strategies to address the knowledge-cutoff problem. Anthropic introduced "Skills" for Claude last year, and the concept has been adopted across the AI industry. However, research from Vercel suggests that simpler approaches—providing model instructions through AGENTS.md files—might be equally or more effective than structured skills.

Google is also exploring Model Context Protocol (MCP) services as an alternative method to feed models updated information at inference time.

What This Means

This update addresses a practical pain point for AI-powered coding assistants: models that don't know about their own APIs perform poorly at using them. The massive improvement in Gemini 3.1 Pro's task completion rate demonstrates that the solution works, but the minimal gains for older models suggest reasoning quality remains a critical bottleneck. For developers, this means newer Gemini models with the Agent Skill could reliably handle SDK-dependent coding tasks, but legacy model deployments will need architectural workarounds.

Related Articles

product update

Google rolls out computer use in the Gemini app for Mac for multi-step desktop tasks

Google announced on November 19, 2026 that computer use is rolling out in the Gemini app for Mac. Gemini can carry out multi-step work across local files, desktop applications and websites, working in an isolated background window with a live preview in the chat.

product update

Gemini adds Google Wallet as a Connector for spending analysis, rewards advice and ticket lookup in the US

Google Gemini now supports Google Wallet as a Connector through its Personal Intelligence features, letting users ask about spending, generate charts, understand card rewards and retrieve saved passes and tickets. The rollout covers Gemini users in the US on web and mobile. Bank and card linking runs through Plaid and is optional and read-only.

product update

Cline v4.1.27 fixes reasoning-effort errors that caused GPT-6 and gpt-5.6 tool-call rejections

Cline v4.1.27 fixes several reasoning-effort bugs that caused GPT-6 and gpt-5.6 endpoints to reject tool calls. It also refreshes the model catalog with 94 new providers and changes default models for 67 others.

product update

Tencent opens WorkBuddy Computer Use beta for Windows and macOS apps that lack APIs

Tencent announced a public beta of WorkBuddy's Computer Use feature on November 20. It lets the office agent operate desktop applications that have no API, connector or browser version, on Windows and macOS, and requires WorkBuddy client 5.11.0 or later.

Comments

Loading...