polysemanticity

Nick Cammarata of Goodfire published an essay, "Neural Networks Are Already Clean," arguing that agentic analysis resolves many known cases of polysemanticity and superposition. A widely shared summary says 90% of neurons in Qwen-32B have a single function. The results are unreplicated, and key methodology was not available in the source material.