Gosha Kozhevnikov
Titles as the sources gave them. In 1 entry, with 4 checked quotations.
What they said
Newest first. Each quotation was found word for word in the source.
“Six of these 35 attacks also evaded the frontier developer’s monitor, and we confirmed them as valid through human review.”
“In its current form, the pipeline can’t show how often a monitor fails in normal deployment or produce a numerical safety estimate.”
“So the absence of found attacks provides little information about safety.”
“In our experiments, final review confirmed 6 of the 17 attacks that evaded the held-out monitor.”
In the Base
Every entry they appear in.
Screwtape: Adversarial Transcript Editing for Monitor Red-Teaming
Redwood Research describes Screwtape, a pipeline that inserts attacks into real AI agent transcripts and refines them until a monitor stops flagging them. Across 252 runs on 94 transcripts it found 35 attacks that evaded the authors' monitors; six also evaded a frontier developer's monitor and passed human review.