Researchers Cracked the 'Secret Thoughts' of Every Major AI — and Found Your API Keys Inside
A cross-model replay attack exposed 315,000 encrypted reasoning blocks from Anthropic, OpenAI, and Google. The researchers also pulled 182 live credentials from public logs. Yes, today.
#AI #security #ChatGPT #Claude #Gemini #vulnerability #API keys
You know how ChatGPT, Claude, and Gemini all got 'extended thinking' modes that they promised were locked down and encrypted? Turns out those encrypted reasoning blocks were about as locked down as a diary with 'DO NOT READ' written on the cover. Researchers from the ELLIS Institute and Max Planck Institute published a paper this Tuesday showing that a trivially simple cross-model replay attack — feeding one company's encrypted reasoning tokens through a weaker sibling model in the same stack — spits out the full plaintext reasoning in plain text. No cryptography was actually broken. The 'encryption' was just a way to pass state between sessions, not a security boundary.
The scale of what they found is the part that should make every developer's stomach drop. The team scanned public repositories — GitHub, Hugging Face, places developers casually dump session logs — and found 315,320 exploitable reasoning blocks already sitting there. From those, they recovered 367 pieces of personally identifiable information and 182 credentials, including 62 live API keys and 33 active passwords. The paper notes that some of the reasoning contained fragments wild enough to name-check: one block contained someone's chicken marinade recipe alongside what appeared to be a plaintext database connection string. Security researchers have a term for this kind of finding. They call it 'not great.'
The timeline here is what makes this worse. Two independent researchers flagged the cross-session replay flaw to OpenAI and Anthropic through official bug bounty programs in May and June 2026. Both companies dismissed the reports. The formal paper submitted August 10 arrived eleven weeks later, forced the companies' hands, and all three providers appear to have patched the immediate vector — but the 315,000 blocks that were already in the wild aren't going anywhere. Security communities on Telegram had the paper circulating hours before mainstream tech outlets even had headlines. The AI industry built secret thought boxes and then shipped them to GitHub in public luggage.
For regular users the practical risk is low unless you've been pasting session logs anywhere public — which apparently many developers have been doing without knowing the encrypted blocks carried recoverable state. The bigger fallout is reputational: these companies sold 'hidden reasoning' as a moat, a way to protect their model IP from competitors. The paper's authors note that the attack could also be used to lift a strong model's reasoning patterns using a weaker, cheaper sibling. The AI industry's most expensive secret wasn't a secret at all.
“Researchers cracked the encrypted 'thinking' of GPT, Claude, and Gemini via a cross-model replay attack, recovering 315K reasoning blocks from public repos — including 182 live credentials. The bug was reported and dismissed by bug bounties months ago.”
Why It Matters