Mistral releases Leanstral, open-source 6B-parameter proof assistant for Lean 4 under Apache 2.0
Mistral AI has released Leanstral, a sparse 120B model with 6B active parameters designed specifically for the Lean 4 proof assistant. The model is available under Apache 2.0 license with free API access and achieves a 26.3 FLTEval score at pass@2, outperforming Claude Sonnet 4.6 while costing $36 versus $549.
Mistral releases Leanstral, open-source 6B-parameter proof assistant for Lean 4 under Apache 2.0
Mistral AI has released Leanstral, a sparse architecture model with 6B active parameters trained specifically for the Lean 4 proof assistant. The company positioned it as the "first open-source code agent designed for Lean 4," targeting formal verification of mathematics and software rather than general code generation.
Model specifications
- Architecture: 120B total parameters with 6B active (sparse)
- License: Apache 2.0
- API: Free endpoint (labs-leanstral-2603) during initial period
- Integration: Built into Mistral Vibe with
/leanstallcommand - Training focus: Proof engineering in Lean 4 repositories
Benchmark performance
Mistral introduced FLTEval, a new benchmark based on completing formal proofs in pull requests to the Fermat's Last Theorem (FLT) project, rather than isolated math problems.
According to Mistral, Leanstral achieved:
- 21.9 at pass@1 ($18 cost)
- 26.3 at pass@2 ($36 cost)
- 31.9 at pass@16 ($290 cost)
Compared results:
- Claude Sonnet 4.6: 23.7 ($549)
- Claude Haiku 4.5: 23.0 ($184)
- Claude Opus 4.6: 39.6 ($1,650)
- Qwen3.5-397B-A17B: 25.4 at pass@4
- GLM5-744B-A40B: 16.6
- Kimi-K2.5-1T-A32B: 20.1
Mistral claims Leanstral at pass@2 beats Sonnet by 2.6 points while costing 93% less, and at pass@16 beats Sonnet by 8 points. Claude Opus 4.6 remains ahead but costs 92x more than Leanstral at similar pass rates.
Technical capabilities
Leanstral is trained to:
- Complete formal proofs in realistic repository contexts
- Define new mathematical concepts with correct syntax
- Translate code between proof assistants (demonstrated with Rocq to Lean 4 conversion)
- Debug proof failures in new Lean versions (tested with Lean 4.29.0-rc6, which Mistral states was not in training data)
The model supports Model Context Protocol (MCP) integration and was specifically optimized for lean-lsp-mcp. Mistral used parallel inference with Lean's verifier to validate outputs.
Case study details
Mistral provided two demonstrations:
-
Version migration debugging: Given a Stack Exchange question about code breaking in Lean 4.29.0-rc6, Leanstral diagnosed that
defcreates rigid definitions blocking therwtactic, and correctly recommended switching toabbrevfor transparent aliasing. -
Cross-assistant translation: Successfully converted program semantics definitions from Rocq (from Princeton CS441 course materials) to Lean 4, including custom notation, and proved properties about the translated code.
What this means
Leanstral targets a narrow but technically demanding niche: formal verification in Lean 4. The sparse architecture approach (6B active from 120B total parameters) appears designed to reduce inference costs while maintaining specialized performance.
The Apache 2.0 license and free API access lower barriers for formal methods researchers and projects using Lean 4. However, the model's utility depends entirely on adoption within the Lean ecosystem—a small community compared to general programming.
Mistral's cost comparisons assume pass@N sampling strategies, which require multiple API calls. The $36 at pass@2 versus Sonnet's $549 calculation reflects running the model twice versus once, making direct cost efficiency claims dependent on whether the sampling strategy is necessary for a given task.
The FLTEval benchmark based on real repository PRs is a more realistic evaluation than competition math problems, but as a new benchmark created by Mistral, independent validation of results is not yet available.
Related Articles
Thinking Machines' Inkling 2 Small scores 31 on Artificial Analysis Intelligence Index, matching Gemini 3.8 Flash (high)
Thinking Machines has released Inkling 2 Small, which scores 31 on the Artificial Analysis Intelligence Index v5.0.1, matching Gemini 3.8 Flash (high). It launches as a proprietary model on Tinker at $0.30/$1.00 per 1M input/output tokens, with an Apache 2.0 weights release planned.
Baidu open-sources ERNIE 5.5 Flash Base, an MoE model with 1M-token context for fine-tuning and inference
Baidu open-sourced ERNIE 5.5 Flash Base on November 5. It is a Mixture-of-Experts base model pretrained on 33.5 trillion tokens, with 128K pretraining context and up to 1M tokens in fine-tuning and inference. Baidu claims it sets state-of-the-art results among models of the same size.
Salesforce launches Koa Decisions, a Gemma-based model that classifies text, image and audio requests
Salesforce introduced Koa Decisions on November 6, 2026. The decision model is built from Google's open-weight Gemma and accepts text, images and audio. It is the next version of HyperClassifier.
Underdog releases Woof, a 31M-parameter open text-to-speech model that runs in a browser
Underdog's new text-to-speech model Woof has 31 million parameters and weighs 31.7 MB. The company says it runs on most devices without an internet connection, and the weights are open to download. Underdog demonstrated it with a browser game posted on November 5, 2026.
Comments
Loading...