Moonshot AI Releases Kimi K3: 2.8T Parameter Open Model at $3/$15 Per Million Tokens
Moonshot AI has released Kimi K3, a 2.8 trillion parameter model with 1 million token context window and native multimodal input. The model ranks #1 in Frontend Code Arena and #9 in Text Arena, with pricing at $3 per million input tokens and $15 per million output tokens—comparable to Claude Sonnet 5 pricing while delivering performance the company claims is near Claude Opus 4.8 and GPT-5.5.
Moonshot AI Releases Kimi K3: 2.8T Parameter Open Model at $3/$15 Per Million Tokens
Moonshot AI has released Kimi K3, a 2.8 trillion parameter model that the company says will become the largest open-weights model when weights are released on July 27, 2026. The model is live on Kimi.com, Kimi Work, Kimi Code, and via API.
Model Specifications
- Parameters: 2.8 trillion total, with 896 experts and 16 activated (under 2% activation ratio)
- Context window: 1 million tokens
- Modalities: Native multimodal input (text + images), text output
- Pricing: $3 per 1M input tokens, $15 per 1M output tokens; cached input discounted 90% to $0.30 per 1M
- Architecture: Uses Kimi Delta Attention (KDA), Attention Residuals (AttnRes), and LatentMoE
Performance Benchmarks
According to independent testing by Artificial Analysis:
- AA Intelligence Index: 57 (comparable to Opus 4.8 and GPT-5.5, behind Fable 5 and GPT-5.6 Sol)
- GDPval v2 Elo: 1668
- AutomationBench-AA: 53% (#1 ranking)
- AA-Briefcase Elo: 1547
- Cost per task: $0.94 average (vs $1.80 for Opus 4.8)
In community Arena evaluations, K3 achieved #1 in Frontend Code Arena with 1679 points and a 76% pairwise win rate, surpassing Claude Fable 5 (63%) and GPT-5.6 Sol (58%). The model ranks #9 in Text Arena with 1486 points, jumping from #38 for its predecessor K2.6.
Technical Architecture
The model introduces three key innovations:
-
Kimi Delta Attention (KDA): Claims to enable up to 6.3x faster decoding in million-token contexts. Development reportedly started in January 2025 and took approximately 1.5 years to reach production scale.
-
Attention Residuals (AttnRes): According to Moonshot, delivers approximately 25% higher training efficiency at less than 2% additional cost.
-
LatentMoE with Stable LatentMoE: Uses 16 activated experts out of 896 total, with quantile load balancing.
Additional architecture details include per-head Muon optimization and a new activation function called SiTU (Sigmoid Tanh Unit).
Inference Performance
Early testing shows inference speeds of approximately 26-28 tokens per second via Moonshot API on OpenRouter. Moonshot recommends deployment on configurations with 64+ accelerators for optimal efficiency.
vLLM announced day-zero support for K3, with Moonshot contributing a KDA prefix caching implementation directly to the vLLM project. The contribution was necessary because KDA breaks assumptions in conventional prefix caching.
Performance Caveats
Moonshot acknowledged that despite competitive benchmark scores, K3 has a "noticeable gap in user experience" compared to Claude Fable 5 and GPT-5.6 Sol.
Artificial Analysis reported the model achieved 46% accuracy on AA-Omniscience (up from 33% on K2.6), but hallucination rates worsened to 51% from 39%.
ProgramBench author Ofir Press noted that Moonshot used averaging implementation percentage rather than counting fully working programs, which may overstate performance on coding tasks.
Cost Comparison
At 80% input / 20% output ratio, K3 costs approximately $5.40 per million tokens, compared to $9 for Opus 4.8 and $10 for GPT-5.5. Artificial Analysis measured $0.94 average cost per Intelligence Index task versus $1.04 for GPT-5.6 Sol and $1.80 for Opus 4.8.
The model consumed 132 million output tokens across the Intelligence Index tests, a 21% reduction from K2.6's 166 million tokens, while gaining 13 index points.
What This Means
Kimi K3 represents a significant scale increase for open models—if weights are released as promised on July 27, it will be more than double the size of previous open releases. The combination of competitive performance with Opus 4.8-class capabilities at significantly lower pricing ($5.40 vs $9 per million tokens blended) creates a new efficiency tier for developers.
The Frontend Code Arena #1 ranking is particularly notable as a human-preference evaluation rather than static benchmark. However, the acknowledged user experience gap versus top closed models and increased hallucination rates suggest K3 may require careful prompt engineering for production use. The 1.5-year development cycle for KDA indicates substantial research investment in long-context optimization.
Related Articles
Anthropic Releases Claude Fable 5.1, Claims 52.6% on New Terminal-Bench-Science Benchmark
Anthropic released Claude Fable (and Mythos) 5.1, claiming a 52.6% score on the new Terminal-Bench-Science 0.1 benchmark — up sharply from 24.7% for Fable 5. Independent testing shows the model's five reasoning levels produce dramatically different output token counts and costs for identical prompts, ranging from $0.10 to $3.30 per request.
OpenAI's GPT-6 Astra Reportedly Automates AI Engineering Tasks at Under $6 an Hour, According to Latent Space Testing
A Latent Space report describes GPT-6 Astra, a new OpenAI model the blog says can autonomously handle AI engineering tasks—training models, labeling data, deploying systems—at an estimated cost of under $6 per hour. The claims, including 97.6% on FrontierMath and 99.9% on ARC-AGI-3, come from independent blog testing rather than an official OpenAI announcement.
OpenAI Launches GPT-6 Astra, Says the Model May Already Qualify as AGI
OpenAI has released GPT-6 Astra, its most capable model yet, with benchmark scores the company says surpass GPT-5.6 Sol and Anthropic's Fable 5 models. President Greg Brockman called it a step into the 'AGI era,' though OpenAI acknowledges there's no agreed-upon threshold for that term.
Meta's Muse Spark 1.3 Claims #3 Global Ranking, Matches OpenAI's GPT-5.6-Sol on Coding Benchmarks
Meta Superintelligence Labs shipped Muse Spark 1.3, which the company claims ranks #3 globally on the Artificial Analysis Intelligence Index and matches OpenAI's GPT-5.6-Sol on coding and agentic benchmarks. The model is available now via Muse Code and Meta's API, with open weights and a follow-up model promised soon.
Comments
Loading...