The BaseResearcharXiv

Do large language models rank moral values? A transitivity test of moral competence

According to the abstract, Wasson, Song, Jennings and colleagues test whether language models' choices among moral value trade-offs can form a consistent ranking. They report most choice sets admitted weak or unstable orderings, and aggregating responses produced structure matching no individual set.

Open the source ↗

Why it matters

The same thing, for different readers.

For researchers

Wasson and colleagues argue evaluations of AI morality should first establish that choices are structured, since benchmark performance does not show moral competence.

The question it raises

Wasson and colleagues' test asks whether a model can be said to weigh values at all if its choices do not order consistently.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
Pairwise trade-offs among moral value violations in vignette choice sets; choice probabilities from first-token distributions tested against three stochastic transitive choice models.
What it found
Per the abstract, most choice sets admitted weak or unstable orderings; aggregated responses matched no individual choice set.
What it does not show
Models tested and sample sizes not in the excerpt; full text not read.
Status
A preprint: not yet peer reviewed

The record

Questions
What values should AI have, and could it have a mind of its own?
People
Katelyn A. Wasson (Wrote it)
What we read
We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by
The Radar, run of November 6, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Do large language models rank moral values? A transitivity test of moral competence”, November 6, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-06-llm-moral-values-transitivity-test
Our notesLight lane: written from the triage excerpt only.