LLM News

Every LLM release, update, and milestone.

0
benchmarkAi2

Ai2's XYBench: Five LLMs Stay Focused on Users' Mistaken Approach Instead of Their Real Goal

Ai2 released XYBench, a benchmark of 8,115 real-world questions that tests whether AI assistants recognize when a user's request rests on a misconception. Five evaluated models, including Claude Sonnet 4.6 and GPT-5, were less likely than human reference answers to steer users toward their actual goal. The paper won the Best Resource Paper Award at EMNLP 2026.

4 min readvia huggingface.co ↗
0
product updateAnthropic

Claude Duet agent, in research preview for US Pro, Max and Ultra users, is useful but jumpy, The Verge finds

Claude Duet, Anthropic's AI agent for professionals and small business owners, is a research preview limited to US Pro, Max and Ultra subscribers, with a waitlist. In The Verge's hands-on, it connected information across email, Slack and Google Docs, but misjudged urgency and timing.

3 min readvia theverge.com ↗
0
benchmark

Future Doctor's MedGPT beats 250 hospital physicians 88 to 12 on 40 complex lung cancer cases

Chinese medical AI company Future Doctor (未来医生) and thoracic surgery teams at top-tier hospitals report that its MedGPT won 88 to 12 against 250 physicians on 40 unpublished complex lung cancer cases. MedGPT scored 96.22 in a head-to-head comparison with general-purpose models, against 71.38 for GPT-5.4, 61.81 for Claude Opus 4.7 and 54.62 for Gemini 3.1 Pro.

3 min readvia qbitai.com ↗
0
model release

Endless Frontier open-sources Fx-Bio-1031, a 125B MoE bioinformatics model with 512K context

Endless Frontier (无界前沿) has open-sourced Fx-Bio-1031, a bioinformatics model with 125B total parameters and 6B active per token, with a 512K context window. The company claims 70.59% Pass@5 on the Difficult subset of Anthropic's BioMysteryBench, against 47.06% for GPT-6-Astra and 52.94% for Claude Opus-5.

0
model release

Huawei Cloud to unveil CloudRobo-WM1.2, its first Ascend-native world model, on November 16

Huawei Cloud will launch CloudRobo-WM1.2, an embodied world model for robots, at an online event on November 16 (14:00 to 15:30 Beijing time). Its poster bills the model as the first Ascend-native world model from the Industry AI Dream Factory. Parameter counts, benchmarks, availability and pricing have not been disclosed.

0
analysisDeepSeek

Analysis finds Blackwell fingerprints in six open-weight models from four Chinese labs

Unemployment Labs reports that six models released since April 2026 by DeepSeek, Moonshot AI, MiniMax and Ant Group carry numerical patterns matching NVIDIA Blackwell GPUs. Earlier models from the same labs match the older Hopper generation. The analysis says it does not establish where the chips were located or whether export controls were violated.

4 min readvia unemploymentlabs.com ↗
0
researchNVIDIA

NVIDIA releases two synthetic Japanese datasets, Nemotron-Personas-Finance-Japan and Nemotron-PII-Japan

At NVIDIA Agentic AI Day Japan 2026 in Tokyo on November 10, NVIDIA presented two synthetic datasets for Japanese AI development. Nemotron-Personas-Finance-Japan targets financial AI and user simulation, and Nemotron-PII-Japan covers PII detection and masking across 8 domains. Both are published on Hugging Face.

3 min readvia monoist.itmedia.co.jp ↗