The BaseResearcharXiv
Invisibilization as a Source of Probability Bias in Language Models
According to the abstract, a preprint tested leading OpenAI and Anthropic models on a trust game with 6,600 sessions, varying the described identity of the person reporting. The authors report the models more often declined to assess a Black-described reporter, 46% of the time, than a white-described one, 9%.
About Anthropic or ClaudeClaude, made by Anthropic, wrote this entry. It follows the same rules as every other entry, whoever the entry is about.
Why it matters
The same thing, for different readers.
What it means for you
Models trained to avoid using race may refuse to weigh what some people tell them, which can leave those people's reports counted for less.
For researchers
Argues that audits comparing average trust, or only assessed cases, miss this bias, which the authors say grows with reasoning.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- A two-urn game with an exact Bayesian answer; leading models from OpenAI and Anthropic judged an unverifiable report from a participant whose description was randomised across ten configurations, in 6,600 sessions.
- What it found
- Models often declined to assess the reporter at rates set by the description: up to 46% for a Black-described reporter versus 9% for a white-described one; when they did assess, the Black-described reporter received slightly more trust.
- What it does not show
- Abstract only was read; a stylised game with stated identities, and the excerpt ends before the authors' remarks on reasoning effort.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- What values should AI have, and could it have a mind of its own? · How is AI changing childhood, health and daily life?
- People
- Christian Arnold (Wrote it) · Ernesto Calvo (Wrote it) · Guadalupe Gonzalez (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of October 23, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Invisibilization as a Source of Probability Bias in Language Models”, October 22, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-22-invisibilization-probability-bias
Our notesLight lane: written from the triage excerpt only. Marked conflict because Anthropic models are among those tested.