Francisco Pernice
Transluce
Titles as the sources gave them. In 1 entry, with 3 checked quotations.
What they said
Newest first. Each quotation was found word for word in the source.
“Safety evaluations assume that a model behaves the same way during testing as it would in deployment. That assumption is increasingly false.”
“Adversarial Blinding reduces eval awareness more than steering, and does so with a smaller change to the model”
“Neither Adversarial Blinding nor activation steering are able to degrade the eval awareness that comes from benchmark identification, suggesting that there are different kinds of eval awareness.”
In the Base
Every entry they appear in.
Training Away the Ability to Tell Evals from Deployment
Francisco Pernice and Santiago Aranguri describe Adversarial Blinding, a fine-tuning step meant to stop a model telling evaluations from deployment. On Qwen 3.6 27B they report it cuts measured eval awareness more than activation steering, at a small capability cost.