The BaseResearcharXiv

MMA-SafetyBench: A Benchmark for Multimodal Agent Safety Evaluation

A preprint presents MMA-SafetyBench, 1,083 adversarial trajectories testing whether forged interface elements, such as fake system alerts, pull multimodal agents off their authorized task. The authors report high attack success across nine models.

Open the source ↗

Why it matters

The same thing, for different readers.

What it means for you

AI agents that operate screens can be fooled by fake pop-ups or alerts into doing something other than what they were asked.

For lawmakers

Text-only safety evaluations do not cover this attack surface for agents that act through visual interfaces.

For researchers

Offers a reproducible benchmark and a 1-3-5 scoring scheme; a safety-priority prompt lowered but did not remove the failures.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
1,083 adversarial trajectories across web, desktop, mobile, document and video tasks, nine models, with control conditions.
What it found
Attack Success Rate reaches 87.96% and Semantic Compromise Rate 98.09%; a safety-priority prompt lowers ASR without eliminating the failure.
What it does not show
Abstract only; which models were tested and how they compare is not stated in the excerpt.
Status
A preprint: not yet peer reviewed

The record

Questions
Can AI systems act beyond what people intended or allowed? · Are AI companies putting stronger safeguards into practice?
People
Yuke Wang (Wrote it) · Benlei Cui (Wrote it) · Shen Pang (Wrote it)
What we read
We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by
The Radar, run of October 15, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “MMA-SafetyBench: A Benchmark for Multimodal Agent Safety Evaluation”, October 14, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-14-mma-safetybench-multimodal-agents
Our notesLight lane: written from title, author and abstract excerpt only; not fetched. Authors listed are those named in triage.