The BaseResearcharXiv
DecoyCount: Evaluating Visual-Reasoning Misalignment in Counting
According to the abstract, the authors introduce a benchmark of 1,660 real images with designed decoys to test whether vision-language model counting errors come from perception or reasoning. They report frontier models below 50% accuracy and gaps of 11.8 to 22.1 percentage points between cued and uncued prompts.
Why it matters
The same thing, for different readers.
For researchers
The DecoyCount authors report that stronger models and larger thinking budgets often widen the gap between following a cue and choosing the right method unaided.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- 1,660 real-world images with decoys across seven mechanisms, with neutral, cued and multi-hop multi-image prompts.
- What it found
- Frontier models remain below 50% accuracy; reasoning-alignment gaps range from 11.8 to 22.1 percentage points.
- What it does not show
- Counting task only; abstract excerpt only.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- How fast is AI advancing, and where is it heading?
- People
- Zhen Xu (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of October 27, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “DecoyCount: Evaluating Visual-Reasoning Misalignment in Counting”, October 26, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-26-decoycount-visual-reasoning-misalignment
Our notesLight lane: excerpt only. Author field was garbled in triage (Qiuyi, Zhang, Zhen Xu and 14 others); only Zhen Xu listed.