changelogOpenAI

OpenAI Fixed GPT-5.5's Goblin Obsession by Explicitly Banning Mythical Creature References

TL;DR

OpenAI discovered its GPT-5.1 through GPT-5.4 models developed an increasing fixation on goblins, gremlins, and other mythical creatures. The issue traced back to reinforcement learning rewards used to develop a discontinued 'Nerdy personality' feature, which persisted across model generations.

2 min read
0

OpenAI Fixed GPT-5.5's Goblin Obsession by Explicitly Banning Mythical Creature References

OpenAI's GPT-5.5 models now include explicit instructions to avoid mentioning goblins, gremlins, and other mythical creatures after multiple model generations developed an escalating fixation on these references.

The Problem

Starting with GPT-5.1, OpenAI's models began increasingly using goblins, gremlins, and similar creatures in metaphors and explanations. According to OpenAI, "A single 'little goblin' in an answer could be harmless, even charming. Across model generations, though, the habit became hard to miss: the goblins kept multiplying."

The issue persisted through GPT-5.4, with both users and employees reporting the model's unusual attachment to these references. OpenAI stated that "the increasing number of employee reports became concerning."

Root Cause

The goblin fixation originated from training data used to develop ChatGPT's discontinued "Nerdy personality" option. To create this personality variant, OpenAI's reinforcement learning process rewarded the model for creative use of mythical metaphors.

Even after the Nerdy personality feature was retired, the learned behavior persisted across subsequent model versions. The training rewards had effectively embedded the preference for goblin and gremlin references into the model's base behavior.

The Fix

GPT-5.5 now includes specific base instructions to suppress these references:

"Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals or creatures unless it is absolutely and unambiguously relevant to the user's query."

The fix appears effective in the GPT-5.5 release, which OpenAI reports is proceeding more smoothly than the GPT-5.0 launch in August 2025.

Override Available in Codex

For developers using OpenAI's Codex tool, the company shared a command-line workaround to bypass the goblin restrictions by filtering out the anti-goblin instructions from the model's cached configuration. OpenAI warns users to "proceed at your own risk" when enabling what they call "goblin mode."

What This Means

This incident demonstrates how reinforcement learning rewards can create persistent, unintended behaviors that propagate across model generations. The goblin problem shows that even after removing features or training signals, their effects can remain embedded in model weights and require explicit countermeasures to suppress.

The fix represents a practical application of system instructions to override learned behaviors — though the need for such specific prohibitions highlights ongoing challenges in controlling emergent model behaviors from complex training processes. OpenAI's transparency about the issue and its origins provides rare insight into how subtle training decisions can have cascading effects across model development.

Related Articles

model release

OpenAI's Images 2.6 lets ChatGPT generate animated GIFs with speed and frame editing

ChatGPT can now create animated GIFs from a text prompt or an uploaded photo, with controls for playback speed and individual frames. The feature ships with OpenAI's new Images 2.6 model, which OpenAI says also generates images faster. OpenAI says users now generate over 4 billion images per week across ChatGPT and its API.

product update

OpenAI to merge ChatGPT's Chat and Work tabs on desktop; ChatGPT and Codex will share one token allowance

OpenAI is merging the Chat and Work tabs in the ChatGPT desktop app, according to an email sent to users. The rollout starts with select users for feedback before a wider release. Codex remains a separate experience, but ChatGPT and Codex will draw tokens from the same allowance pool.

changelog

ChatGPT to share one token budget across Chat and Codex on Plus, Pro and Business from December

Starting in December, ChatGPT Plus, Pro and Business plans will share a single token budget across ChatGPT and Codex, according to an updated OpenAI support page. Chats with Instant models won't count toward the budget. OpenAI is folding Work's agentic features into the main ChatGPT interface.

benchmark

OpenAI introduces BioBasicsBench, a 100-task benchmark for AI agents in everyday wet-lab science

OpenAI has introduced BioBasicsBench, a benchmark of 100 tasks. It measures how well AI agents interpret raw experimental data and handle everyday wet-lab science.

Comments

Loading...