model releaseMistral AI

Mistral releases Leanstral 1.5: 119B parameter open-source model for Lean 4 proof assistance

TL;DR

Mistral AI has released Leanstral 1.5, an open-source 119B parameter mixture-of-experts model designed specifically for Lean 4 proof assistance. The model features 128 experts with 4 active per token (6.5B activated parameters), a 256k token context window, and multimodal input capabilities.

2 min read
0

Mistral releases Leanstral 1.5: 119B parameter open-source model for Lean 4 proof assistance

Mistral AI has released Leanstral 1.5, an open-source 119B parameter mixture-of-experts model designed specifically for Lean 4, a proof assistant used for expressing complex mathematical objects and software specifications.

Technical specifications

Leanstral 1.5 is built as part of the Mistral Small 4 family and uses a mixture-of-experts architecture:

  • Total parameters: 119B
  • Active parameters per token: 6.5B (128 experts, 4 active)
  • Context window: 256k tokens (200k recommended)
  • Input: Text and images (multimodal)
  • Output: Text only

The model supports a "reasoning effort" parameter with two settings: 'none' for standard operation and 'high' for chain-of-thought reasoning on complex prompts. Mistral recommends temperature 1.0 for inference.

Deployment and access

Leanstral 1.5 is available free through Mistral's API with no requirement for a Pro subscription. Users must opt into "Enable Labs models" in their Mistral account settings to access the model.

The model integrates with Mistral's Vibe CLI tool as a code agent, accessible via the command vibe --agent lean. According to Mistral, "Leanstral is capable of doing very long range tasks which requires hours of work."

For local deployment, Mistral recommends vLLM with specific configuration:

  • Minimum vLLM version: 0.24.0
  • Recommended tensor parallel size: 4
  • Maximum model length: 200,000 tokens
  • Attention backend: FLASH_ATTN_MLA

Integration with Lean ecosystem

The model works with the lean-lsp-mcp, a Model Context Protocol tool for AI agents to interact with Lean's language server. This enables the model to directly interact with Lean projects, prove theorems, and fix code within the Lean 4 environment.

Mistral recommends running the Vibe CLI inside VS Code's terminal and within Lean project directories for optimal workflow integration.

What this means

Leanstral 1.5 represents a specialized application of large language models for formal verification and mathematical proof assistance. The free API access removes cost barriers for researchers and developers working with Lean 4, while the mixture-of-experts architecture keeps inference costs manageable. The 256k context window enables the model to work with large codebases and complex proofs that require extensive context. This release positions Mistral as a key player in AI-assisted formal mathematics, an area that has traditionally relied on closed-source models or general-purpose coding assistants not optimized for proof systems.

Related Articles

model release

Thinking Machines Lab releases Inkling 2 Mini: 26B-parameter looped MoE with 3B active and 1M-token context

Thinking Machines Lab has released Inkling 2 Mini, a multimodal Mixture-of-Experts model with about 26B physical total parameters and 3B active per token. It repeats its middle layers three times, supports a 1M-token context, and ships with a DSpark drafter. Hugging Face reports it leads 32 of 48 benchmarks against four comparable models.

model release

Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license

Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.

model release

Tencent releases Hy4 flash: 220B MoE, 12B active parameters, 1M-token context

Tencent has released Hy4 flash, a multimodal Mixture-of-Experts model with 220B total parameters, 12B active per token, and a 1,048,576-token context window. Tencent calls it its most cost-effective Hy model to date and claims a per-task cost of 1/20 that of Hy4 on its internal WorkIndex benchmark.

model release

OpenAI releases GPT-Live-1.1 in the API, with standby mode billing idle WebRTC time at $0.02 per minute

OpenAI has released GPT-Live-1.1 in the API. The full-duplex voice model improves multilingual accents and transcription, and a new standby mode bills idle WebRTC time at $0.02 per minute instead of $0.05.

Comments

Loading...