model releaseMistral AI

Mistral releases Leanstral, open-source 6B-parameter proof assistant for Lean 4 under Apache 2.0

TL;DR

Mistral AI has released Leanstral, a sparse 120B model with 6B active parameters designed specifically for the Lean 4 proof assistant. The model is available under Apache 2.0 license with free API access and achieves a 26.3 FLTEval score at pass@2, outperforming Claude Sonnet 4.6 while costing $36 versus $549.

3 min read
0

Mistral releases Leanstral, open-source 6B-parameter proof assistant for Lean 4 under Apache 2.0

Mistral AI has released Leanstral, a sparse architecture model with 6B active parameters trained specifically for the Lean 4 proof assistant. The company positioned it as the "first open-source code agent designed for Lean 4," targeting formal verification of mathematics and software rather than general code generation.

Model specifications

  • Architecture: 120B total parameters with 6B active (sparse)
  • License: Apache 2.0
  • API: Free endpoint (labs-leanstral-2603) during initial period
  • Integration: Built into Mistral Vibe with /leanstall command
  • Training focus: Proof engineering in Lean 4 repositories

Benchmark performance

Mistral introduced FLTEval, a new benchmark based on completing formal proofs in pull requests to the Fermat's Last Theorem (FLT) project, rather than isolated math problems.

According to Mistral, Leanstral achieved:

  • 21.9 at pass@1 ($18 cost)
  • 26.3 at pass@2 ($36 cost)
  • 31.9 at pass@16 ($290 cost)

Compared results:

  • Claude Sonnet 4.6: 23.7 ($549)
  • Claude Haiku 4.5: 23.0 ($184)
  • Claude Opus 4.6: 39.6 ($1,650)
  • Qwen3.5-397B-A17B: 25.4 at pass@4
  • GLM5-744B-A40B: 16.6
  • Kimi-K2.5-1T-A32B: 20.1

Mistral claims Leanstral at pass@2 beats Sonnet by 2.6 points while costing 93% less, and at pass@16 beats Sonnet by 8 points. Claude Opus 4.6 remains ahead but costs 92x more than Leanstral at similar pass rates.

Technical capabilities

Leanstral is trained to:

  • Complete formal proofs in realistic repository contexts
  • Define new mathematical concepts with correct syntax
  • Translate code between proof assistants (demonstrated with Rocq to Lean 4 conversion)
  • Debug proof failures in new Lean versions (tested with Lean 4.29.0-rc6, which Mistral states was not in training data)

The model supports Model Context Protocol (MCP) integration and was specifically optimized for lean-lsp-mcp. Mistral used parallel inference with Lean's verifier to validate outputs.

Case study details

Mistral provided two demonstrations:

  1. Version migration debugging: Given a Stack Exchange question about code breaking in Lean 4.29.0-rc6, Leanstral diagnosed that def creates rigid definitions blocking the rw tactic, and correctly recommended switching to abbrev for transparent aliasing.

  2. Cross-assistant translation: Successfully converted program semantics definitions from Rocq (from Princeton CS441 course materials) to Lean 4, including custom notation, and proved properties about the translated code.

What this means

Leanstral targets a narrow but technically demanding niche: formal verification in Lean 4. The sparse architecture approach (6B active from 120B total parameters) appears designed to reduce inference costs while maintaining specialized performance.

The Apache 2.0 license and free API access lower barriers for formal methods researchers and projects using Lean 4. However, the model's utility depends entirely on adoption within the Lean ecosystem—a small community compared to general programming.

Mistral's cost comparisons assume pass@N sampling strategies, which require multiple API calls. The $36 at pass@2 versus Sonnet's $549 calculation reflects running the model twice versus once, making direct cost efficiency claims dependent on whether the sampling strategy is necessary for a given task.

The FLTEval benchmark based on real repository PRs is a more realistic evaluation than competition math problems, but as a new benchmark created by Mistral, independent validation of results is not yet available.

Related Articles

model release

Tencent Open-Sources AuK, a 1.5B-Parameter Speech Generation and Editing Model

Tencent has open-sourced AuK, a 1.5B-parameter foundation model for speech generation and editing that handles TTS, content editing, and audio enhancement through natural-language instructions. The release includes a distilled AuK-Flash variant for 4-step fast inference, both under MIT license.

model release

Ex-OpenAI Researcher Launches Jev, an AI Model That Scores Options Instead of Generating Text

Startup TypeSafe AI has released Jev, a model built to score predefined answer options rather than generate text, claiming response times of 70 to 500 milliseconds. Co-founder Diogo Almeida, a former OpenAI researcher and InstructGPT co-author, says the model targets background classification tasks like sorting customer requests.

model release

Anonymous Provider Launches Union Alpha, a Free 262K-Context Multimodal Model on OpenRouter

A third-party provider using the alias 'Stealth' has released Union Alpha on OpenRouter, a multimodal model with a 262K context window, currently free to use during its preview period. The model's developer remains anonymous, and OpenRouter states it is not the model's owner or operator.

model release

TypeSafe Launches Jev, a Non-Generative 'Decision Model' Claiming Up to 200x Faster, 400x Cheaper Than Small LLMs

TypeSafe, founded by ChatGPT co-inventor Diogo Almeida, launched Jev on September 15, 2026 — a model that cannot generate free-form text but claims to classify, route, and score 20-200x faster and 40-400x cheaper than small frontier LLMs. Trained via a new method called RLCD, Jev targets production systems that use LLMs purely as structured judges or routers.

Comments

Loading...