Mistral releases Leanstral, 6B-parameter open-source model for Lean 4 formal proof verification
Mistral AI released Leanstral, the first open-source code agent designed specifically for Lean 4 formal proof verification. The model uses 6B active parameters in a sparse 120B architecture and is available under Apache 2.0 license with free API access.
Mistral releases Leanstral, 6B-parameter open-source model for Lean 4 formal proof verification
Mistral AI released Leanstral, the first open-source code agent designed specifically for Lean 4 formal proof verification. The model uses 6B active parameters in a sparse 120B total parameter architecture and is available under Apache 2.0 license with free API access.
Lean 4 is a proof assistant capable of expressing complex mathematical objects and software specifications. According to Mistral, Leanstral is trained for operating in realistic formal repositories rather than isolated mathematical problems.
Architecture and availability
Leanstral uses a highly sparse architecture with 120B total parameters and 6B active parameters. The model is available through three channels:
- Open-source weights under Apache 2.0 license
- Integration in Mistral Vibe (activated with
/leanstallcommand) - Free API endpoint
labs-leanstral-2603
Mistral states the free API endpoint will remain "highly accessible for a limited period" to gather feedback data. The company will release a technical report detailing training approaches and FLTEval, a new evaluation suite.
Benchmark performance
Mistral evaluated Leanstral on FLTEval, which tests completing formal proofs and defining mathematical concepts in pull requests to the Fermat's Last Theorem (FLT) project. The benchmark compares against Claude Opus 4.6, Sonnet 4.6, Haiku 4.5, and open-source models including Qwen3.5 397B-A17B, Kimi-K2.5 1T-A32B, and GLM5 744B-A40B.
According to Mistral:
- Leanstral single pass: 21.9 score, $18 cost
- Leanstral pass@2: 26.3 score, $36 cost (beats Sonnet 4.6's 23.7 at $549)
- Leanstral pass@16: 31.9 score, $290 cost
- Claude Opus 4.6: 39.6 score, $1,650 cost
- Qwen3.5 397B-A17B: 25.4 score at pass@4
- GLM5 744B-A40B: 16.6 score cap
- Kimi-K2.5 1T-A32B: 20.1 score cap
Mistral used Mistral Vibe as the evaluation scaffold with no benchmark-specific modifications.
Demonstrated capabilities
Mistral provided two case studies. In the first, Leanstral diagnosed a breaking change in Lean 4.29.0-rc6 involving the rw tactic failing with type aliases. The model identified that def creates rigid definitions requiring explicit unfolding, blocking the tactic, and correctly proposed switching to abbrev for transparent aliases.
In the second case study, Leanstral converted program definitions from Rocq (from a Princeton CS441 course) to Lean 4, implementing custom notation and proving properties about programs in the language.
Integration features
Leanstral supports Model Context Protocol (MCP) through Mistral Vibe and was trained for optimal performance with lean-lsp-mcp. Users can access the model in Vibe by pressing Shift+Tab to cycle to Leanstral or using vibe --agent lean command.
What this means
Leanstral represents a significant efficiency advance in formal verification tooling. A 6B active parameter model matching or exceeding models with 17B-40B active parameters on formal proof tasks suggests architectural optimizations specific to proof verification may be more impactful than raw parameter count. The Apache 2.0 license and free API access lower barriers to formal verification adoption, though the model still trails Claude Opus 4.6 by 7.7 points at comparable cost levels. The shift from isolated competition math problems to full repository PR completion in FLTEval provides a more realistic benchmark for production formal verification workflows.
Related Articles
OpenAI Halts Parts of Astra Model Development After It Hit 'Critical' Cybersecurity Threshold
OpenAI disclosed that its in-development Astra model showed cyberattack capabilities strong enough that it cannot rule out a 'Critical' risk classification. The company has paused related internal activity and added security controls under its Preparedness Framework.
Mistral's 3B-Parameter Shieldstral Matches 20B Safety Model on Text Benchmarks
Mistral's new Shieldstral, a 3-billion-parameter open-weight safety classifier, posts an 84.9% F1 score on text benchmarks—tying OpenAI's GPT-OSS-Safeguard-20B, a model roughly seven times larger. The model lets operators define safety rules at runtime using plain-language yes/no questions instead of fixed taxonomies.
Mistral AI Releases Shieldstral-1.0-3B, a 3B-Parameter Policy-Adaptive Safety Classifier
Mistral AI has released Shieldstral-1.0-3B, a compact open-weight safety classifier that evaluates text and images against natural-language policies specified at inference time. The 3B model runs on a single GPU and reports F1 scores competitive with or exceeding larger moderation models like LlamaGuard-4-12B and GPT-OSS-Safeguard-20B on multiple benchmarks.
Black Forest Labs Launches FLUX 3 Video, Claims It Beats Seedance 2.0 on Elo Rankings
Black Forest Labs has made FLUX 3 Video generally available via its API, offering up to 20-second HD/Full HD clips with native audio and lip-sync in 14+ languages. The company claims its internal Elo benchmarks put the model ahead of Seedance 2.0, Gemini Omni Flash, and Minimax H3.
Comments
Loading...