The BaseResearcharXiv
Revisiting Over-refusal in Safety-aligned Large Language Models: A Representation and Optimization Perspective
According to the abstract, Chao Chen, Pengyang Shao, Wei Qin and three co-authors study why safety-trained language models refuse harmless but risky-looking requests. They report that harmful and over-refused prompts overlap in deeper layers and share gradient directions, and propose a method named GOAL.
Why it matters
The same thing, for different readers.
What it means for you
Chao Chen and co-authors examine why AI models sometimes refuse harmless questions that merely sound risky, a side effect of making them safer.
For researchers
The authors report that harmful-sample gradients concentrate in a low-rank subspace aligned with refusal targets, and propose GOAL, a gradient-orthogonalisation method, to reduce over-refusal.
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- An analysis of model representations across layers and of gradients on harmful versus over-refusal prompts, followed by a proposed training method (GOAL).
- What it found
- Per the abstract, harmful and over-refusal representations are separable at intermediate layers but overlap more in deeper layers, and harmful-sample gradients are tightly clustered and aligned with refusal targets.
- What it does not show
- The excerpt was cut off before the method's results and the models tested.
- Status
- A preprint: not yet peer reviewed
The record
- Questions
- Are AI companies putting stronger safeguards into practice? · How is AI changing childhood, health and daily life?
- People
- Chao Chen (Wrote it) · Pengyang Shao (Wrote it) · Wei Qin (Wrote it)
- What we read
- We have read only the description the publisher gives. No quotations until someone reads the source itself.
- Found by
- The Radar, run of October 30, 2026, via
arxiv-ai-safety-query(tier 1: the source’s own channel or an official record) - Cite this
- arXiv, “Revisiting Over-refusal in Safety-aligned Large Language Models: A Representation and Optimization Perspective”, October 29, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-29-over-refusal-representation-optimization