Artificial Analysis

Artificial Analysis released Intelligence Index v5 on Tuesday, with 60% of the test built on private, held-out questions. Moonshot AI's Kimi K3.1 Pro fell from 4th to 9th, and Google's Gemini 4 Carbon debuted at #1 with a score of 59.

Google announced Gemini 4 Carbon, which it says ranks #1 on v5.0 of the Artificial Analysis Intelligence Index with a score of 59. Access begins this week with a subset of cyber defenders through the Fairwind Program, at a stated price of $2 per million input tokens and $10 per million output tokens.

Artificial Analysis has launched Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades, including new coding and science benchmarks. For the first time, the majority of the Index is built on private datasets. Claude Opus 5.5 (max) leads at 58.

Moonshot AI has released Kimi K3.1 Pro, which scores 55 on the Artificial Analysis Intelligence Index, an 11-point gain over Kimi K3 and fourth place overall. Parameter count is unchanged at 2.8 trillion, while API prices fall by 33 percent. Moonshot plans to release the weights by November 4, 2026.

DeepSeek has upgraded its open-weight V4.1 Flash to revision 1017, a 552B-parameter MoE model with 16B active parameters and a 1 million token context window. Off-peak API pricing is $0.15 per 1M input tokens and $0.6 per 1M output tokens. Artificial Analysis data shows strong intelligence scores but weak results on hallucination.

ElevenLabs released two speech-to-speech models, Eleven Realtime v1 Max and v1 Mini, on October 20, 2026. Max scores 98.8% on Big Bench Audio with a 0.57-second response time, according to the company. Both are available through the ElevenAgents platform and an OpenAI-compatible Realtime API.

MiniMax has released M3.1 Flash, a reasoning model that scores 42 on the Artificial Analysis Intelligence Index, up from 29 for M3. It costs $0.15 per 1M input tokens and $0.60 per 1M output tokens, and open weights are planned for October 23.

Google DeepMind is positioning Gemini 4 Argon as one model that controls robots, builds simulated training environments, and grades training data. Google claims 87% on the ERQA benchmark, ahead of Claude Opus 5.5 at 82.3%. Artificial Analysis's AA-Robotics test, published a day later, placed Argon third at 55 out of 100.

Google unveiled Gemini 4 Argon, its new flagship model, which sits behind only Claude Opus 5.5 and Claude Sonnet 5.5 on the Artificial Analysis Intelligence Index. Access begins with trusted cybersecurity partners, with no date given for wider availability.

OpenAI's GPT-6 Sol and Luna cut input/output token prices in half versus GPT-5.6, with Sol now at $2/$10 per million tokens and Luna at $0.10/$0.50. Independent testing from Artificial Analysis shows intelligence scores barely moved, with regressions on some knowledge-work benchmarks.

Xiaomi's new MiMo-V2.6-Pro, a 1.02 trillion parameter mixture-of-experts model, now leads open-model rankings with a 46 on Artificial Analysis's Intelligence Index while costing roughly $0.13 per task. Anthropic simultaneously accuses Xiaomi of funneling user conversations through Claude to train the model, part of a broader pattern the company calls illegal distillation.

Xiaomi released MiMo-V2.6-Pro, a 1.02T-parameter mixture-of-experts model with 42B active parameters, which debuted as the top-scoring open-weights model on Artificial Analysis' Intelligence Index (46). The company claims the model's RL training run cost roughly $2.6M and completed in 130 hours.

Artificial Analysis released version 4.2 of its Intelligence Index after its original scoring showed GPT-6 Astra barely improving on its predecessor, contradicting Epoch AI's ranking of Astra as the top model out of 267 tested. The update adds two benchmarks, drops the saturated GPQA-Diamond, and increases private test weighting to 40 percent.

Meta has released Muse Spark 1.3, its fourth model in five months, with an xhigh tier available now and a more powerful max tier in limited preview. The model improves sharply on agentic benchmarks and costs $0.55 per index task—cheaper than any rival at the same performance level—but still trails Claude Fable 5.1 on most tests.

Z.ai's GLM-5.3 ties Kimi K3 for the top spot among open models on the Artificial Analysis Intelligence Index, driven by a major leap in agentic task performance. The company is delaying the open-weight release by about two weeks, citing the model's unusually strong vulnerability-detection capabilities.

Artificial Analysis has released the Search Index, a benchmark measuring how search API providers perform for AI agents across quality, cost, and speed. Parallel, Exa, and Firecrawl lead the initial rankings, with search access boosting model scores from 33 to as high as 75 points.

Artificial Analysis has launched Optima, a platform that lets users build custom AI benchmarks using their own data, workflows, or use-case descriptions. Unlike public benchmarks, Optima compares models on cost per task and time per task in addition to quality.

Ant Group's inclusionAI released Ling 3.0 Flash, which scores 38 points on the Artificial Analysis Intelligence Index — the highest of any open model under 124 billion total parameters. The model cuts its hallucination rate from 97 to 44 percent versus its predecessor and ships under an MIT license.

xAI's Grok 4.6 ties OpenAI's GPT-5.6 Sol on the Artificial Analysis Intelligence Index with a score of 61, trailing only Anthropic's Claude Opus 5 and Claude Fable 5. Pricing remains at $2/$6 per million tokens, undercutting both competitors by more than 60 percent.

Alibaba's Qwen3.8 Max jumps 10 points to 56 on the Artificial Analysis Intelligence Index, putting it on par with Claude Opus 4.8. But Kimi K3 still edges it out at a lower per-task cost, and Qwen3.8 Max shows a sharp rise in hallucination rate.

DeepSeek has updated its budget model V4 Flash to version '0731,' pushing its Artificial Analysis Intelligence Index score to 50 — just one point behind OpenAI's GPT-5.6 Luna — while costing an estimated 60 percent less per task. The MIT-licensed model keeps its 284B-parameter architecture but shows major gains in agentic benchmarks and token efficiency.

Anthropic's Claude Opus 5 posts a 61 on the Artificial Analysis Intelligence Index, narrowly beating Claude Fable 5 (60) and GPT-5.6 Sol (59) while costing less per task. The model leads in coding and knowledge-work benchmarks but shows a rising hallucination rate of 50 percent.

xAI's Grok 4.20 scores 48 on Artificial Analysis' Intelligence Index—6 points ahead of Grok 4 but trailing Gemini 3.1 Pro Preview and GPT-5.4 at 57. The model distinguishes itself with a 78% non-hallucination rate on the AA Omniscience test, the highest recorded across any model tested.