The BaseResearcharXiv

Scaling Adaptive Prompt Injection Attacks with Agent Swarms

According to the abstract, Alexey Kurakin and colleagues argue that prompt injection attacks on AI agents remain possible despite apparent plateaus. They report that an agentic attacker can reliably trick models into following instructions found in tool output, even models seen as robust on public benchmarks.

Open the source ↗

Why it matters

The same thing, for different readers.

What it means for you

Kurakin and colleagues report that AI agents can still be tricked by instructions hidden in the content they read, even models thought robust.

For researchers

Kurakin and colleagues argue that frontier defenses against prompt injection may need proactive, automated red-teaming, since human red-teaming may be nearing saturation.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
A new synthetic evaluation dataset using random non-malicious actions as adversarial goals, to measure respect for instruction hierarchy; tested against an agentic attacker.
What it found
The abstract says the attacker can reliably trick models into following instructions in tool output, including models previously considered robust on benchmarks such as GraySwan Arena. No numbers in the excerpt.
What it does not show
Not stated in the excerpt available.
Status
A preprint: not yet peer reviewed

The record

Questions
Are AI companies putting stronger safeguards into practice? · How is AI used in attacks, defence and war?
People
Alexey Kurakin (Wrote it) · Vishal Karande (Wrote it) · Alex Bie (Wrote it)
What we read
We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by
The Radar, run of November 10, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Scaling Adaptive Prompt Injection Attacks with Agent Swarms”, November 9, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-09-adaptive-prompt-injection-agent-swarms
Our notesLight lane: abstract only. Excerpt mentions the Gemini family but names no company in the authors' affiliation; org left empty.