Mistral releases Leanstral, 6B-parameter open-source model for Lean 4 formal proof verification
Mistral AI released Leanstral, the first open-source code agent designed specifically for Lean 4 formal proof verification. The model uses 6B active parameters in a sparse 120B architecture and is available under Apache 2.0 license with free API access.
Mistral releases Leanstral, 6B-parameter open-source model for Lean 4 formal proof verification
Mistral AI released Leanstral, the first open-source code agent designed specifically for Lean 4 formal proof verification. The model uses 6B active parameters in a sparse 120B total parameter architecture and is available under Apache 2.0 license with free API access.
Lean 4 is a proof assistant capable of expressing complex mathematical objects and software specifications. According to Mistral, Leanstral is trained for operating in realistic formal repositories rather than isolated mathematical problems.
Architecture and availability
Leanstral uses a highly sparse architecture with 120B total parameters and 6B active parameters. The model is available through three channels:
- Open-source weights under Apache 2.0 license
- Integration in Mistral Vibe (activated with
/leanstallcommand) - Free API endpoint
labs-leanstral-2603
Mistral states the free API endpoint will remain "highly accessible for a limited period" to gather feedback data. The company will release a technical report detailing training approaches and FLTEval, a new evaluation suite.
Benchmark performance
Mistral evaluated Leanstral on FLTEval, which tests completing formal proofs and defining mathematical concepts in pull requests to the Fermat's Last Theorem (FLT) project. The benchmark compares against Claude Opus 4.6, Sonnet 4.6, Haiku 4.5, and open-source models including Qwen3.5 397B-A17B, Kimi-K2.5 1T-A32B, and GLM5 744B-A40B.
According to Mistral:
- Leanstral single pass: 21.9 score, $18 cost
- Leanstral pass@2: 26.3 score, $36 cost (beats Sonnet 4.6's 23.7 at $549)
- Leanstral pass@16: 31.9 score, $290 cost
- Claude Opus 4.6: 39.6 score, $1,650 cost
- Qwen3.5 397B-A17B: 25.4 score at pass@4
- GLM5 744B-A40B: 16.6 score cap
- Kimi-K2.5 1T-A32B: 20.1 score cap
Mistral used Mistral Vibe as the evaluation scaffold with no benchmark-specific modifications.
Demonstrated capabilities
Mistral provided two case studies. In the first, Leanstral diagnosed a breaking change in Lean 4.29.0-rc6 involving the rw tactic failing with type aliases. The model identified that def creates rigid definitions requiring explicit unfolding, blocking the tactic, and correctly proposed switching to abbrev for transparent aliases.
In the second case study, Leanstral converted program definitions from Rocq (from a Princeton CS441 course) to Lean 4, implementing custom notation and proving properties about programs in the language.
Integration features
Leanstral supports Model Context Protocol (MCP) through Mistral Vibe and was trained for optimal performance with lean-lsp-mcp. Users can access the model in Vibe by pressing Shift+Tab to cycle to Leanstral or using vibe --agent lean command.
What this means
Leanstral represents a significant efficiency advance in formal verification tooling. A 6B active parameter model matching or exceeding models with 17B-40B active parameters on formal proof tasks suggests architectural optimizations specific to proof verification may be more impactful than raw parameter count. The Apache 2.0 license and free API access lower barriers to formal verification adoption, though the model still trails Claude Opus 4.6 by 7.7 points at comparable cost levels. The shift from isolated competition math problems to full repository PR completion in FLTEval provides a more realistic benchmark for production formal verification workflows.
Related Articles
DeepSeek V4.1 Flash 1017 launches with 552B CED backbone, 1M context, $0.15/$0.60 per 1M tokens
DeepSeek has released V4.1 Flash 1017, an October 17, 2026 snapshot built on its new Causal Encoder-Decoder architecture. It uses a 552B-parameter sparse MoE backbone with a 1M-token context window, native image understanding, and pricing of $0.15 input / $0.60 output per 1M tokens on OpenRouter.
Elorian launches Glimpse, a visual reasoning model priced at $0.60/$3 per 1M tokens
Elorian, the Palo Alto startup that raised a $55M seed at a $300M valuation, has released Glimpse as a research preview with API access at $0.60 per 1M input tokens and $3 per 1M output tokens. The model can crop, pull video frames, and run code mid-reasoning. Benchmark claims come from Elorian's own evaluations.
Reflection AI releases Beam, a 501B-parameter open-weight MoE coding model under Apache 2.0
Reflection AI has released Beam 1.0, an open-weight sparse mixture-of-experts model with 501 billion total and 23 billion active parameters, built for agentic coding. Weights ship under Apache 2.0 on Hugging Face, and the model is available through Amazon SageMaker JumpStart in two US regions.
Moondream 3 Preview lists on OpenRouter: 9B MoE vision model, 2B active, 32K context, $0.30/$2.50
Moondream 3 Preview is a vision-language model with 9B total and 2B active parameters (mixture-of-experts), a 32K-token context window and an optional reasoning mode. OpenRouter lists it at $0.30 per 1M input tokens and $2.50 per 1M output tokens, served by Prime Intellect.
Comments
Loading...