scaling
1 article tagged with scaling
November 22, 2026
researchOpenAI
OpenAI's Pachocki proposes perplexity as a shared metric for industry safety limits, publishes internal figures
OpenAI Chief Scientist Jakub Pachocki argues that perplexity (cross-entropy loss) should be a shared metric for comparing model developers and informing safety standards. OpenAI is publishing internal perplexity measurements, citing log-perplexity of ~0.99 for GPT-3.5 and ~0.91 for GPT-4.