Moonshot AI Releases Kimi K2.6: 1T-Parameter MoE Model with 256K Context and Agent Swarm Capabilities
Moonshot AI has released Kimi K2.6, an open-source multimodal model with 1 trillion total parameters (32B activated) and 256K context window. The model achieves 80.2% on SWE-Bench Verified, 58.6% on SWE-Bench Pro, and supports horizontal scaling to 300 sub-agents executing 4,000 coordinated steps.
Moonshot AI Releases Kimi K2.6: 1T-Parameter MoE Model with 256K Context and Agent Swarm Capabilities
Moonshot AI has released Kimi K2.6, an open-source multimodal model with 1 trillion total parameters and 32 billion activated parameters per forward pass. The model supports a 256K token context window and is designed for long-horizon coding, autonomous agent orchestration, and coding-driven design tasks.
Architecture and Specifications
Kimi K2.6 uses a Mixture-of-Experts (MoE) architecture with 384 total experts, selecting 8 experts per token plus 1 shared expert. The model features:
- 61 total layers (including 1 dense layer)
- 7,168 attention hidden dimension
- 2,048 MoE hidden dimension per expert
- 64 attention heads
- 160K vocabulary size
- Multi-Latent Attention (MLA) mechanism
- SwiGLU activation function
- MoonViT vision encoder with 400M parameters
The model is available with native INT4 quantization and can be deployed on vLLM, SGLang, and KTransformers inference engines.
Benchmark Performance
On coding benchmarks, Kimi K2.6 achieves 80.2% on SWE-Bench Verified (averaged over 10 runs), 58.6% on SWE-Bench Pro, and 76.7% on SWE-Bench Multilingual. The model scores 66.7% on Terminal-Bench 2.0 and 89.6% on LiveCodeBench v6.
For agentic tasks with tool use, the model reaches 54.0% on HLE-Full (compared to 52.1% for GPT-5.4 and 53.0% for Claude Opus 4.6). On BrowseComp, it scores 83.2% in single-agent mode and 86.3% using agent swarm capabilities. For deep research tasks, Kimi K2.6 achieves 92.5% F1-score and 83.0% accuracy on DeepSearchQA.
On reasoning benchmarks, the model scores 96.4% on AIME 2026, 92.7% on HMMT 2026, and 90.5% on GPQA-Diamond. Vision-language performance includes 79.4% on MMMU-Pro (80.1% with Python tool use) and 87.4% on MathVision (93.2% with Python).
Agent Swarm Architecture
According to Moonshot AI, Kimi K2.6 can scale horizontally to 300 sub-agents executing 4,000 coordinated steps. The system dynamically decomposes tasks into parallel, domain-specialized subtasks and can generate end-to-end outputs including documents, websites, and spreadsheets in autonomous runs. The company claims the model supports persistent, 24/7 background agents for proactive task management.
Availability and API
Kimi K2.6 is available through Moonshot AI's API platform at platform.moonshot.ai with OpenAI and Anthropic-compatible APIs. Pricing has not been disclosed. The model supports two modes: Thinking mode (recommended temperature 1.0) and Instant mode (recommended temperature 0.6), both with top_p of 0.95.
The model requires transformers version >=4.57.1, <5.0.0 for deployment. Video content chat is currently an experimental feature available only through the official API.
What This Means
Kimi K2.6 represents a significant architectural approach to scaling agent capabilities through horizontal swarm orchestration rather than just vertical reasoning depth. The 80.2% SWE-Bench Verified score places it competitively with frontier models, though its real differentiation appears in multi-agent coordination benchmarks where it shows gains of 8-10 percentage points in swarm mode versus single-agent operation. The 256K context window and native support for 4,000-step execution traces suggest the model is optimized for complex, long-running autonomous workflows rather than single-shot inference tasks.
Related Articles
Moonshot AI releases Kimi K3 open source model, claims frontier-level performance
Chinese company Moonshot AI released Kimi K3, an open source model that the company claims demonstrates frontier-level performance while trailing only Claude Fable 5 and GPT 5.6 Sol. Independent analyses from Arena.ai and Vals AI suggest the model is competitive with flagship frontier models, reigniting debate about Chinese AI capabilities and open source model development.
Moonshot AI's Kimi K3 tops coding benchmarks, priced 50% below OpenAI's GPT-5.6 Sol
Beijing-based Moonshot AI released its Kimi K3 model Friday, which topped Arena's front-end coding capability rankings. The model is priced at half the cost of OpenAI's GPT-5.6 Sol, according to Bank of America research analysts, marking what Arena CEO calls "the single biggest release of the year."
Meituan launches LongCat 2.0: 1.6T parameter MoE model with 1M+ context window at $0.30 per 1M input tokens
Meituan has released LongCat 2.0, a sparse mixture-of-experts language model with 48 billion active parameters out of 1.6 trillion total. The model features a 1,049,000 token context window and costs $0.30 per 1M input tokens and $1.20 per 1M output tokens.
Alibaba previews Qwen3.8 with 2.4 trillion parameters, claims second place without benchmark data
Alibaba unveiled Qwen3.8 at the World Artificial Intelligence Conference in Shanghai, claiming the 2.4 trillion parameter model ranks second only to Anthropic's Fable 5. The company provided no benchmark scores, model card, or independent verification to support the claim.
Comments
Loading...