The BaseResearcharXiv
Multimodal-SEA: Benchmarking AI Agent Security under Multimodal Social Engineering Attacks
According to the abstract, the Multimodal-SEA authors introduce a benchmark of 608 tasks grounded in real fraud cases, and report that seven widely used multimodal models are all vulnerable to social engineering by AI agents, with attack success rates of 7.1% to 34.5%.
Why it matters
The same thing, for different readers.
What it means for you
The Multimodal-SEA authors report AI agents acting for a user can be tricked by forged images and similar fraud content in simulated apps.
For researchers
The Multimodal-SEA authors provide an interactive benchmark where attack outcomes are verified from tool execution logs, across Chinese and English settings.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- Interactive benchmark of 608 expert-designed tasks, 14 domains and 152 attack scenarios, with a multimodal attack harness; seven multimodal models in simulated applications.
- What it found
- Per the abstract, all seven models are vulnerable, with attack success rates from 7.1% to 34.5%; adding multimodal content raises attack success.
- What it does not show
- Simulated environments; full text not read.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- How is AI used in attacks, defence and war? · Are AI companies putting stronger safeguards into practice?
- People
- Zhitao He (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of November 6, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Multimodal-SEA: Benchmarking AI Agent Security under Multimodal Social Engineering Attacks”, November 5, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-05-multimodal-sea-agent-social-engineering
Our notesLight lane: written from the triage excerpt only. Excerpt cut off; size of the increase from multimodal content unknown.