OpenAI Fixed GPT-5.5's Goblin Obsession by Explicitly Banning Mythical Creature References
OpenAI discovered its GPT-5.1 through GPT-5.4 models developed an increasing fixation on goblins, gremlins, and other mythical creatures. The issue traced back to reinforcement learning rewards used to develop a discontinued 'Nerdy personality' feature, which persisted across model generations.
OpenAI Fixed GPT-5.5's Goblin Obsession by Explicitly Banning Mythical Creature References
OpenAI's GPT-5.5 models now include explicit instructions to avoid mentioning goblins, gremlins, and other mythical creatures after multiple model generations developed an escalating fixation on these references.
The Problem
Starting with GPT-5.1, OpenAI's models began increasingly using goblins, gremlins, and similar creatures in metaphors and explanations. According to OpenAI, "A single 'little goblin' in an answer could be harmless, even charming. Across model generations, though, the habit became hard to miss: the goblins kept multiplying."
The issue persisted through GPT-5.4, with both users and employees reporting the model's unusual attachment to these references. OpenAI stated that "the increasing number of employee reports became concerning."
Root Cause
The goblin fixation originated from training data used to develop ChatGPT's discontinued "Nerdy personality" option. To create this personality variant, OpenAI's reinforcement learning process rewarded the model for creative use of mythical metaphors.
Even after the Nerdy personality feature was retired, the learned behavior persisted across subsequent model versions. The training rewards had effectively embedded the preference for goblin and gremlin references into the model's base behavior.
The Fix
GPT-5.5 now includes specific base instructions to suppress these references:
"Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals or creatures unless it is absolutely and unambiguously relevant to the user's query."
The fix appears effective in the GPT-5.5 release, which OpenAI reports is proceeding more smoothly than the GPT-5.0 launch in August 2025.
Override Available in Codex
For developers using OpenAI's Codex tool, the company shared a command-line workaround to bypass the goblin restrictions by filtering out the anti-goblin instructions from the model's cached configuration. OpenAI warns users to "proceed at your own risk" when enabling what they call "goblin mode."
What This Means
This incident demonstrates how reinforcement learning rewards can create persistent, unintended behaviors that propagate across model generations. The goblin problem shows that even after removing features or training signals, their effects can remain embedded in model weights and require explicit countermeasures to suppress.
The fix represents a practical application of system instructions to override learned behaviors — though the need for such specific prohibitions highlights ongoing challenges in controlling emergent model behaviors from complex training processes. OpenAI's transparency about the issue and its origins provides rare insight into how subtle training decisions can have cascading effects across model development.
Related Articles
OpenAI Launches Agent Plugins Standard as GPT-5 Turns One Year Old
OpenAI released Agent Plugins, a vendor-neutral standard for packaging Agent Skills and MCP servers into portable extensions, one day before GPT-5's first anniversary. The steering committee includes Amazon, Cursor, Microsoft, and Vercel alongside OpenAI.
OpenAI's ChatGPT Work Agent Reportedly Crosses 10 Million Users Three Weeks After Launch
OpenAI's ChatGPT Work, launched July 9th as an agent product for knowledge work, has reportedly crossed 10 million users in three weeks. Built on the Codex harness and running in isolated cloud microVMs, Work is expected to merge with standard ChatGPT by year-end, according to OpenAI president Greg Brockman.
OpenAI Testing ChatGPT Feature to Export Custom Stickers Directly to WhatsApp
An APK teardown of ChatGPT's Android app reveals a hidden 'ChatGPT Stickers' feature that would let users create custom stickers and export them directly into WhatsApp as sticker packs. The feature is unreleased and its public launch timeline is unknown.
OpenAI Removes Text Chat Limits for Free ChatGPT Users, Launches GPT-5.6 Luna
OpenAI is removing text chat limits for Free and Go ChatGPT users, powered by a new GPT-5.6 Luna model with a 'Think' button for harder questions. The company also upgraded GPT-5.6 Sol for Plus and Pro users, claiming a 68% reduction in factual errors versus GPT-5.5-Instant.
Comments
Loading...