Microsoft's MAI Code 1.1 Flash Loses on Price and Performance to DeepSeek-V4-Flash
Microsoft's MAI Code 1.1 Flash beats its predecessor and mini-models from Anthropic and OpenAI on SWE-bench Verified, but DeepSeek-V4-Flash-0731 outperforms it on Terminal Bench 2.1 (82.7% vs 62.9%) while costing roughly a third as much per token.
MAI Code 1.1 Flash at a glance
How MAI Code 1.1 Flash ranks now
| Benchmark | Score | Rank | Source |
|---|---|---|---|
| SWE-bench Verified | 72.6% | 52 of 80 | the-decoder.com, Aug 2026 ↗ |
Rank is against every model in our database with a sourced score on that benchmark, each counted once with its best score.
What happened
Microsoft released MAI Code 1.1 Flash, an updated code model powering GitHub Copilot. According to Microsoft, the model writes better code, is 25 percent more token-efficient, and costs a quarter of its June predecessor, MAI-Code-1-Flash. Microsoft says developers accepted 4 percent more of its output than the previous version, and that training used "hundreds of thousands of reinforcement-learning environments in GitHub Copilot."
The benchmarks
On SWE-bench Verified, MAI-Code-1.1-Flash scores 72.6%, ahead of MAI-Code-1-Flash (71.6%), Claude Haiku 4.5 (69.8%), and GPT-5.4 mini (69.2%). DeepSeek did not publish a comparable SWE-bench Verified score for its V4-Flash-0731 release.
On Terminal Bench 2.1, the picture reverses sharply. MAI-Code-1.1-Flash posts 62.9%, ahead of its predecessor (51.7%) and Haiku 4.5 (49.4%), and roughly in line with GPT-5.4 mini (60.7%). But DeepSeek-V4-Flash-0731 scores 82.7% on the same benchmark — nearly 20 points higher than Microsoft's model.
Pricing gap
DeepSeek-V4-Flash charges $0.14 per 1M input tokens ($0.0028 with caching) and $0.28 per 1M output tokens. MAI Code 1.1 Flash charges $0.20 per 1M input tokens ($0.02 with caching) and $1.20 per 1M output tokens — more than four times DeepSeek's output price. Claude Haiku 4.5 is the most expensive of the three, at $1.00 input and $5.00 output per 1M tokens.
Cost per token alone doesn't capture full usage efficiency, but the gap favoring DeepSeek is large enough that token-efficiency differences are unlikely to close it.
Notable omission
Microsoft's official announcement for MAI Code 1.1 Flash does not include direct benchmark comparisons against competitors. It cites internal metrics instead — "code survival rose 4% and return visits increased 9%" relative to the prior version — while the head-to-head benchmark table against Haiku 4.5, GPT-5.4 mini, and DeepSeek-V4-Flash-0731 appears only in the model card.
What this means
Microsoft has been vocal about supporting open AI development, but its own roadmap points toward proprietary, closed-weight models like MAI Code 1.1 Flash that underperform freely available alternatives such as DeepSeek-V4-Flash-0731 on some benchmarks while costing more per output token. This follows Microsoft's recent Copilot changes, where it replaced some OpenAI and Anthropic models with cheaper in-house MAI alternatives, trading capability for margin.
The pattern suggests strategy rather than accident: Microsoft controls the default model choice inside its own ecosystem, and most Copilot users never actively select a different model. Even a model that trails on independent benchmarks can capture significant usage share simply by being the default — regardless of whether cheaper, better-performing open alternatives exist elsewhere.
Related Articles
Microsoft launches seven models at Ignite; claims MAI Code 2 matches 96% of Claude Opus 5.5 at 5% of price
Microsoft unveiled seven AI models at Ignite on Nov. 17, aimed at coding, cybersecurity and other enterprise tasks. The company claims MAI Code 2 delivered 96% of Claude Opus 5.5's performance across four coding benchmarks at 5% of the price, using a promotional rate.
Nadella says Claude Code's CLI caught Microsoft off guard and the IDE "kind of faded away"
Microsoft CEO Satya Nadella said Anthropic's Claude Code moved coding from the editor to the command line, and that within about six months the IDE "kind of faded away." In an hour-long interview with Gergely Orosz, he also covered verification of AI-written code, agent risk, local models and Microsoft's workforce changes.
AWS launches SageMaker JumpStart Model Leaderboard covering more than 70 models
Amazon Web Services introduced the Amazon SageMaker JumpStart Model Leaderboard on November 18, 2026. It gives SageMaker Studio users one view of benchmark results, response performance and estimated instance pricing across more than 70 models.
Microsoft releases Aion 1.0 Instruct, a 2.3B on-device SLM with 32K context under MIT license
Microsoft's Windows Applied Sciences Group has published Aion 1.0 Instruct, a roughly 2.29B-parameter instruction-tuned small language model with a 32,768-token context window under the MIT license. A further optimized version is slated to become the Windows OS SLM by the end of January 2027.
Comments
Loading...