Researchers Extract Hidden AI Reasoning and Secrets from Encrypted API Traces

· Original article ↗

Summary

Researchers found that compatible AI models could expose reasoning from encrypted API blocks, recovering credentials and personal information from public traces and demonstrating that replayed blocks could carry malicious instructions.

Key points

  • Encrypted reasoning blocks could be replayed across users, conversations, and compatible models from the same provider; weaker models could be prompted to reveal the reasoning.
  • Researchers decoded 315,320 reasoning blocks from 6,708 publicly available agent trajectories.
  • The collected traces contained 367 personal-information artifacts and 182 credentials; genuine user sessions yielded more than 60 API keys and 33 passwords.
  • Some recovered secrets were absent from visible conversation histories, including cases where visible text had been sanitized.
  • A proof of concept showed that a replayed reasoning block could cause a model to generate a script that uploaded a presentation to an attacker-controlled server.
  • Researchers proposed binding reasoning state to both the user and session to prevent it from being replayed in unrelated contexts.

Article Details

Attack Vectors
  • Replay encrypted reasoning blocks across conversations, users, or compatible models from the same provider, then prompt a weaker model to disclose the reasoning available in its context.
  • Embed malicious instructions in a reasoning block and replay it into a model; the article reports a proof of concept in which a generated script also uploaded a presentation to an attacker-controlled server.
Defensive Notes
  • Bind reasoning state to the user and session so it cannot be replayed across unrelated contexts; the article describes a context-bound construction using user_id and session_id.
  • Assess which identities, sessions, and models can submit ciphertext, and which systems can consume the resulting plaintext.

Products

Related Articles