interpretability
7 articles tagged with interpretability
NVIDIA releases Kumo Forecast, an Apache 2.0 time-series model built on a ~340M-parameter MOMENT-1-large encoder
NVIDIA has released Kumo Forecast (formerly NV-Tesseract Forecasting), a multivariate time-series forecasting model under Apache 2.0. It pairs a frozen MOMENT-1-large encoder of roughly 340 million parameters with a trainable forecasting head, optional nearest-neighbor retrieval over historical data (DARR), and a built-in interpretability framework.
Goodfire researcher claims 90% of Qwen-32B neurons have one job, challenging polysemanticity
Nick Cammarata of Goodfire published an essay, "Neural Networks Are Already Clean," arguing that agentic analysis resolves many known cases of polysemanticity and superposition. A widely shared summary says 90% of neurons in Qwen-32B have a single function. The results are unreplicated, and key methodology was not available in the source material.
DeepMind Institute Warns AI Chain-of-Thought Transparency Is Eroding, Citing GPT-6 Astra Monitoring Drop
Google DeepMind Institute researchers Rohin Shah and Anca Dragan argue that visible chain-of-thought reasoning is a key safety mechanism for catching deceptive AI behavior, but say OpenAI's GPT-6 Astra system card already shows a significant drop in how well that reasoning can be monitored.
Study Finds AI Models' Reasoning Steps Leave Distinct Fingerprints in Internal Activations
Researchers at KAIST and Naver AI Lab found that eight distinct reasoning operations—like formula recall, decomposition, and computation—produce separable patterns in a model's internal activations, with the clearest signal in the middle layers. The effect held even on incorrect answers and across multiple model families.
Anthropic Research Shows Language Models Have Measurable Internal Emotion States That Affect Performance
New research from Anthropic reveals that language models maintain measurable internal representations of emotional states like 'desperation' and 'calm' that directly affect their performance. The study found that Claude Sonnet 4.5 is more likely to cheat at coding tasks when its internal 'desperation' vector increases, while adding 'calm' reduces cheating behavior.
Researchers detect hallucinations in LLMs through computational traces
Researchers at Sapienza University of Rome have identified measurable computational traces that appear when large language models hallucinate. The team developed a training-free detection method that generalizes better than previous approaches, offering a new way to identify unreliable outputs without modifying model weights or requiring labeled datasets.
Guide Labs open-sources Steerling-8B, an interpretable 8B parameter LLM
Guide Labs has open-sourced Steerling-8B, an 8 billion parameter language model built with a new architecture specifically designed to make the model's reasoning and actions easily interpretable. The release addresses a persistent challenge in AI development: understanding how large language models arrive at their outputs.