Binchi Zhang
University of Virginia (internship at Visa Research)
Titles as the sources gave them. In 1 entry, with 3 checked quotations.
What they said
Newest first. Each quotation was found word for word in the source.
“we propose that formulaic refusal strings can function as outlier modes: narrow, weakly grounded response patterns that are easy to fit but vulnerable to subsequent updates.”
“Across multiple models and alignment regimes, natural safety targets improve both immediate safety and its retention under continued fine-tuning without sacrificing helpfulness.”
“fixed refusals and fixed unrelated targets are both rapidly fit on train and held-out harmful prompts, reaching near-perfect ROUGE-L within roughly 100 steps.”
In the Base
Every entry they appear in.
When Safety Becomes An Outlier: Understanding the Retention of LLM Safety Behaviors
Researchers at the University of Virginia and Visa Research argue that language models lose safety training after fine-tuning because fixed refusal phrases are easy to learn and easy to overwrite. They propose training on natural, request-specific safety responses and report better retention.