scaling

1 article tagged with scaling

November 22, 2026
researchOpenAI

OpenAI's Pachocki proposes perplexity as a shared metric for industry safety limits, publishes internal figures

OpenAI Chief Scientist Jakub Pachocki argues that perplexity (cross-entropy loss) should be a shared metric for comparing model developers and informing safety standards. OpenAI is publishing internal perplexity measurements, citing log-perplexity of ~0.99 for GPT-3.5 and ~0.91 for GPT-4.