The BaseResearcharXiv

ABench: Adversarily Benchmarking Large Language Models across Taxonomized Values

According to the abstract, Liping Yang and co-authors present ABench, a handcrafted Chinese-language benchmark of 2,895 open-ended questions across 158 value subcategories, testing how stable models' stances are under adversarial prompts. They report that most of 16 models scored below 60.

Open the source ↗

Why it matters

The same thing, for different readers.

For researchers

Adds a Chinese-language, culturally specific adversarial benchmark for model values, where earlier alignment tests were mostly English or simple discriminative tasks, as the authors describe.

The question it raises

Asks whose values a model should hold when deployed across cultures, and how firmly it should keep them under pressure.

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
A handcrafted benchmark of 2,895 open-ended Chinese questions built on a taxonomy of 158 value subcategories, using role-playing and logical traps, with weighted automated scoring; 16 mainstream models tested.
What it found
Most models showed significant vulnerabilities under sophisticated adversarial attacks on values, scoring below 60.
What it does not show
Only the abstract excerpt was read; scoring scale, model names and limits are not known. Scoring is automated.
Status
A preprint: not yet peer reviewed

The record

Questions
What values should AI have, and could it have a mind of its own? · Are AI companies putting stronger safeguards into practice?
People
Liping Yang (Wrote it)
What we read
We have read only the description the publisher gives. No quotations until someone reads the source itself.
Found by
The Radar, run of October 21, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “ABench: Adversarily Benchmarking Large Language Models across Taxonomized Values”, October 20, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-20-abench-chinese-values-benchmark
Our notesLight lane: triage excerpt only. Other authors beyond the first three are not listed in triage.