Moonshot AI Releases Kimi K2.6: 1T-Parameter MoE Model with 256K Context and Agent Swarm Capabilities
Moonshot AI has released Kimi K2.6, an open-source multimodal model with 1 trillion total parameters (32B activated) and 256K context window. The model achieves 80.2% on SWE-Bench Verified, 58.6% on SWE-Bench Pro, and supports horizontal scaling to 300 sub-agents executing 4,000 coordinated steps.
Kimi K2.6 — Quick Specs
Moonshot AI Releases Kimi K2.6: 1T-Parameter MoE Model with 256K Context and Agent Swarm Capabilities
Moonshot AI has released Kimi K2.6, an open-source multimodal model with 1 trillion total parameters and 32 billion activated parameters per forward pass. The model supports a 256K token context window and is designed for long-horizon coding, autonomous agent orchestration, and coding-driven design tasks.
Architecture and Specifications
Kimi K2.6 uses a Mixture-of-Experts (MoE) architecture with 384 total experts, selecting 8 experts per token plus 1 shared expert. The model features:
- 61 total layers (including 1 dense layer)
- 7,168 attention hidden dimension
- 2,048 MoE hidden dimension per expert
- 64 attention heads
- 160K vocabulary size
- Multi-Latent Attention (MLA) mechanism
- SwiGLU activation function
- MoonViT vision encoder with 400M parameters
The model is available with native INT4 quantization and can be deployed on vLLM, SGLang, and KTransformers inference engines.
Benchmark Performance
On coding benchmarks, Kimi K2.6 achieves 80.2% on SWE-Bench Verified (averaged over 10 runs), 58.6% on SWE-Bench Pro, and 76.7% on SWE-Bench Multilingual. The model scores 66.7% on Terminal-Bench 2.0 and 89.6% on LiveCodeBench v6.
For agentic tasks with tool use, the model reaches 54.0% on HLE-Full (compared to 52.1% for GPT-5.4 and 53.0% for Claude Opus 4.6). On BrowseComp, it scores 83.2% in single-agent mode and 86.3% using agent swarm capabilities. For deep research tasks, Kimi K2.6 achieves 92.5% F1-score and 83.0% accuracy on DeepSearchQA.
On reasoning benchmarks, the model scores 96.4% on AIME 2026, 92.7% on HMMT 2026, and 90.5% on GPQA-Diamond. Vision-language performance includes 79.4% on MMMU-Pro (80.1% with Python tool use) and 87.4% on MathVision (93.2% with Python).
Agent Swarm Architecture
According to Moonshot AI, Kimi K2.6 can scale horizontally to 300 sub-agents executing 4,000 coordinated steps. The system dynamically decomposes tasks into parallel, domain-specialized subtasks and can generate end-to-end outputs including documents, websites, and spreadsheets in autonomous runs. The company claims the model supports persistent, 24/7 background agents for proactive task management.
Availability and API
Kimi K2.6 is available through Moonshot AI's API platform at platform.moonshot.ai with OpenAI and Anthropic-compatible APIs. Pricing has not been disclosed. The model supports two modes: Thinking mode (recommended temperature 1.0) and Instant mode (recommended temperature 0.6), both with top_p of 0.95.
The model requires transformers version >=4.57.1, <5.0.0 for deployment. Video content chat is currently an experimental feature available only through the official API.
What This Means
Kimi K2.6 represents a significant architectural approach to scaling agent capabilities through horizontal swarm orchestration rather than just vertical reasoning depth. The 80.2% SWE-Bench Verified score places it competitively with frontier models, though its real differentiation appears in multi-agent coordination benchmarks where it shows gains of 8-10 percentage points in swarm mode versus single-agent operation. The 256K context window and native support for 4,000-step execution traces suggest the model is optimized for complex, long-running autonomous workflows rather than single-shot inference tasks.
Related Articles
DeepSeek V4.1 Flash 1017 launches with 552B CED backbone, 1M context, $0.15/$0.60 per 1M tokens
DeepSeek has released V4.1 Flash 1017, an October 17, 2026 snapshot built on its new Causal Encoder-Decoder architecture. It uses a 552B-parameter sparse MoE backbone with a 1M-token context window, native image understanding, and pricing of $0.15 input / $0.60 output per 1M tokens on OpenRouter.
Elorian launches Glimpse, a visual reasoning model priced at $0.60/$3 per 1M tokens
Elorian, the Palo Alto startup that raised a $55M seed at a $300M valuation, has released Glimpse as a research preview with API access at $0.60 per 1M input tokens and $3 per 1M output tokens. The model can crop, pull video frames, and run code mid-reasoning. Benchmark claims come from Elorian's own evaluations.
Moondream 3 Preview lists on OpenRouter: 9B MoE vision model, 2B active, 32K context, $0.30/$2.50
Moondream 3 Preview is a vision-language model with 9B total and 2B active parameters (mixture-of-experts), a 32K-token context window and an optional reasoning mode. OpenRouter lists it at $0.30 per 1M input tokens and $2.50 per 1M output tokens, served by Prime Intellect.
Moondream 3.1: 9B MoE vision model with 2B active parameters, 32K context, $0.30/$2.50 per 1M tokens
Moondream has released Moondream 3.1, a mixture-of-experts vision-language model with 9B total and 2B active parameters and a 32K-token context window. It is listed on OpenRouter at $0.30 per 1M input tokens and $2.50 per 1M output tokens, with an optional reasoning mode.
Comments
Loading...