Mistral releases Devstral Medium and Small 1.1 with 61.6% SWE-Bench Verified score
Mistral AI has released two specialized coding models: Devstral Medium, achieving 61.6% on SWE-Bench Verified, and Devstral Small 1.1, scoring 53.6% and released under Apache 2.0 license. The company claims Devstral Medium surpasses Gemini 2.5 Pro and GPT-4.1 at a quarter of the price.
Devstral Medium — Quick Specs
Mistral releases Devstral Medium and Small 1.1 with 61.6% SWE-Bench Verified score
Mistral AI has released two specialized coding models developed in collaboration with All Hands AI: Devstral Medium and Devstral Small 1.1. The models are designed specifically for agentic coding tasks, with emphasis on generalization across different prompts and agentic scaffolds.
Devstral Medium: API-only proprietary model
Devstral Medium achieves 61.6% on SWE-Bench Verified, according to Mistral AI. The company claims the model surpasses Gemini 2.5 Pro and GPT-4.1 at a quarter of the price, though specific benchmark comparisons were not provided.
Pricing for Devstral Medium (devstral-medium-2507):
- Input: $0.40 per 1M tokens
- Output: $2.00 per 1M tokens
The model is available through Mistral's API and supports on-premise deployment for enterprise customers. Custom fine-tuning is available for enterprises requiring task-specific optimization.
Devstral Small 1.1: Open-source Apache 2.0 release
Devstral Small 1.1 scores 53.6% on SWE-Bench Verified. Mistral claims this sets a new state-of-the-art for open models without test-time scaling, though the model maintains the same 24B parameter architecture as its predecessor.
Pricing for Devstral Small 1.1 (devstral-small-2507):
- Input: $0.10 per 1M tokens
- Output: $0.30 per 1M tokens
Key improvements over the previous version:
- Enhanced performance on SWE-Bench Verified (previous score not disclosed)
- Better generalization to different coding environments
- Support for both Mistral function calling and XML formats
- Optimized for use with OpenHands agentic framework
Technical specifications
Both models support:
- Multiple agentic scaffolds and prompting formats
- Integration with coding environments
- Function calling capabilities
Devstral Small 1.1 is released under the Apache 2.0 license, allowing unrestricted commercial and research use. The model is available for local deployment. Devstral Medium remains proprietary but can be deployed on private infrastructure through enterprise agreements.
Context window size, training data cutoff, and detailed architecture specifications were not disclosed.
What this means
Mistral is positioning itself in the increasingly competitive coding model space with a two-tier strategy: an open-source model for local deployment and experimentation, and a proprietary API model targeting enterprise customers. The 61.6% SWE-Bench Verified score for Devstral Medium, if independently verified, would be competitive with leading coding models, though claims of cost advantage over Gemini 2.5 Pro and GPT-4.1 require context on benchmark parity. The Apache 2.0 release of the 24B parameter Small model provides the open-source community with a capable coding agent foundation without licensing restrictions.
Related Articles
Alibaba Releases Qwen3.8-Flash-Next: 125B-Parameter MoE Model Matches Larger Rivals at $0.16/$0.47 per Million Tokens
Alibaba's Qwen team released Qwen3.8-Flash-Next, a 125-billion-parameter mixture-of-experts model that activates just 6 billion parameters per token and previews architecture planned for Qwen4. The model outperforms the much larger Qwen3.7-Plus at roughly one-ninth the training cost and ships at $0.16 per million input tokens and $0.47 per million output tokens.
Zhipu AI Releases GLM-5.3-Flash: First Multimodal Model in GLM-5 Series, 320B Parameters with Only 18B Active
Zhipu AI has released GLM-5.3-Flash, the first natively multimodal model in its GLM-5 series, built on a 320B-parameter mixture-of-experts architecture with only 18B active parameters. The company claims it outperforms GLM-5.2 across benchmarks at one-tenth the cost while approaching Claude Opus 4.8 on coding and agentic tasks.
Z.ai Confirmed as Creator of Chart-Topping 'Ox Alpha' Model, Weights Coming Wednesday
Z.ai, maker of the GLM model series, has confirmed it is behind Ox Alpha, the mysterious open-weight model that appeared anonymously on OpenRouter and topped benchmark leaderboards. The company will release the model's weights on Wednesday.
Z.ai Launches GLM-5.3-Flash With 1M-Token Context and Hybrid Attention Architecture
Z.ai has released GLM-5.3-Flash, a native multimodal model built for coding and long-horizon agent tasks, featuring a 1M-token context window and a hybrid sparse-linear attention architecture. The model is available via OpenRouter at a discounted $0.075/$0.25 per 1M tokens through September 2026.
Comments
Loading...