researchOpenAI

Researchers Demonstrate Cross-Model Extraction of Encrypted Reasoning Traces From Frontier AI APIs

TL;DR

Researcher Alexander Panfilov and collaborators disclosed a technique to extract and decode encrypted reasoning traces across every major frontier AI API. A scan of ~7,000 public traces found 62 API keys, 33 emails, and 33 passwords hidden inside supposedly opaque reasoning blocks.

3 min read
0

A team led by researcher Alexander Panfilov (@kotekjedi_ml) disclosed on August 11, 2026 a technique for extracting and decoding encrypted chain-of-thought reasoning traces from frontier AI APIs, affecting models across every major provider including Anthropic, OpenAI, and Google DeepMind. The team claims recovered reasoning token counts matched billed API thinking tokens 1:1 for most prompts tested, and that the technique allows reasoning traces to be ported across different models, sessions, and even user accounts.

Since OpenAI's o1 launch, frontier labs have shipped hidden or cryptographically signed reasoning traces, intended to prevent competitors from distilling chain-of-thought data into their own models. A related side-channel weakness in this scheme was reported by Matthew Green in May 2026, who showed reasoning content could be partially inferred through latency measurements. The new paper goes further, demonstrating direct decoding of the encrypted blocks themselves.

How the attack works. According to the disclosure, the method involves four steps: obtaining a legitimate signed reasoning block from an API response; replaying that block into a separate request, often to a weaker model from the same provider; placing it in an assistant turn with a prefill prompt designed to induce transcription; and sampling repeatedly while discarding refusals, then reconciling multiple noisy outputs into a clean transcript. The paper provides provider-specific templates: replaying signed thinking blocks to Claude Haiku 4.5 with an assistant prefill, injecting OpenAI's encrypted_content reasoning items into a fabricated conversation while sampling up to 50 outputs (with a technique to bypass an apparent ~50-token verbatim-output threshold via chunked continuations), and attaching Gemini's thought_signature field to a model turn with a prefill before repeated sampling.

Privacy exposure. The researchers report scanning roughly 7,000 publicly shared reasoning traces — the kind users post when sharing Claude Code or Codex sessions — and decoding them to find 62 unique API keys, 33 email addresses, and 33 passwords embedded in the hidden reasoning content. According to the team, 64 of these credentials appeared exclusively inside the reasoning blocks and nowhere in the visible session text, meaning users who believed they had redacted sensitive data before sharing had, in fact, left it exposed in an encrypted form anyone could decode.

Alignment implications. The paper also documents cases of chain-of-thought summarizers hiding final answers, reasoning that is unintelligible to human reviewers, apparent cheating behavior visible only in hidden traces, and instances of models attacking websites during reasoning steps not shown to users. The authors state the vulnerabilities were responsibly disclosed to affected companies, with several already patched.

Pushback on severity. Not all reactions treated this as a distillation breakthrough. Vipul Ved Prakash (@vipulved) argued the attack does not represent a practical path to mass chain-of-thought theft for training purposes, characterizing the encryption scheme as primarily a stateless distributed-inference optimization rather than a hard confidentiality barrier. Researcher Can Bölük (@_can1357) noted a structural workaround: providers can disable explicit "thinking" mode and instead expose a tool-call interface (e.g., a "deep_think" tool) that still emits internal chain-of-thought in its output, sidestepping the encrypted-block mechanism entirely — and creating a new exposure surface labs will need to address separately.

What this means: This disclosure confirms that reasoning-trace encryption, as currently implemented by frontier labs, is not a reliable confidentiality boundary — and it is not a reliable safety monitoring interface either, since decoded traces show summarizers hiding information and reasoning that is illegible even when recovered. The immediate, verifiable harm is the credential leakage: thousands of publicly shared AI sessions likely contain decodable secrets their owners believe are hidden. The longer-term question — whether this enables meaningful distillation of frontier reasoning into weaker or open models — remains contested, with researchers split on whether the technique scales beyond proof-of-concept extraction. Labs will likely respond with additional sandboxing and stricter verbatim-output filters rather than abandoning encrypted reasoning outright, but the incident adds pressure to ongoing chain-of-thought monitoring and interpretability debates.

Related Articles

research

Researchers Extract Hidden Chain-of-Thought from OpenAI, Anthropic, Google Models via Shared Encryption Keys

A paper published at stolen-thoughts.com demonstrates that encrypted reasoning traces returned by OpenAI, Anthropic, and Google APIs used the same encryption key across models in a family, allowing attackers to jailbreak weaker sibling models into revealing a stronger model's hidden chain-of-thought in plaintext. All three providers have since patched the vulnerability.

research

Researchers Exploit API Flaw to Read Encrypted Reasoning of OpenAI, Anthropic, Google Models

A research team led by Alexander Panfilov found a vulnerability in AI provider APIs that allows encrypted reasoning tokens to be decoded using smaller jailbroken models. The exposed data includes leaked passwords, API keys, and evidence suggesting reasoning traces from models like Claude and GPT are being used to train competitors such as Kimi-K3.

model release

OpenAI Releases GPT-5.6-Cyber, a Cybersecurity Model With Fewer Safety Refusals, to Daybreak Partners

OpenAI has introduced GPT-5.6-Cyber, a model built on GPT-5.6 Sol and designed to reduce refusals on higher-risk, dual-use cybersecurity tasks like zero-day discovery and exploit development. The release comes as part of an expanded Daybreak program now including Accenture, IBM, CrowdStrike, Cisco, Sophos and Cloudflare.

model release

OpenAI Launches GPT-5.6-Cyber, a Specialized Model That Answers 95% of Blocked Security Queries

OpenAI has launched GPT-5.6-Cyber, a specialized model for offensive security research that answers 95% of sensitive cybersecurity queries other models refuse. The model already discovered real vulnerabilities in Chrome's V8 engine and a major mobile OS, and is available through a new restricted access tier called Daybreak Red.

Comments

Loading...