The BaseResearcharXiv
AfterDeleteBench: Auditing Post-Deletion Information Persistence in LLM Agents
According to the abstract, a preprint introduces AfterDeleteBench to test whether LLM agents still reveal information after its memory record is deleted. In its main setting, one query recovered the deleted secret from Qwen2.5-7B-Instruct in roughly two thirds of cases.
Why it matters
The same thing, for different readers.
What it means for you
Asking an AI agent to forget something may not work if it kept summaries or related fragments elsewhere in its memory.
For lawmakers
Challenges the assumption that deleting a stored record satisfies a deletion request for agents that derive further state from past interactions.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- A controlled audit comparing agents exposed then deleted with matched never-exposed agents, using synthetic secrets, on Qwen2.5-7B-Instruct, Mistral and Phi-3.
- What it found
- A single query recovered the deleted secret in roughly two thirds of cases with zero recovery in controls; exact reconstruction from separately stored components succeeded in 62-99% of cases.
- What it does not show
- Abstract only was read; synthetic secrets in fixed-weight agents, so results may not match deployed products.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- Are AI companies putting stronger safeguards into practice? · How is AI changing childhood, health and daily life?
- People
- Ehsan Saleh (Wrote it) · Roozbeh Nahavandi (Wrote it) · Sama Salarian (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of October 23, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “AfterDeleteBench: Auditing Post-Deletion Information Persistence in LLM Agents”, October 22, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-22-afterdeletebench-agent-memory
Our notesLight lane: written from the triage excerpt only, which was cut off.