The BaseResearchLessWrong
Blue-teaming AI Through Safety Hillclimbing
Skye and Eam report an experiment in which GPT 6.1 Sol spent 12 hours fine-tuning an abliterated Gemma 4 12B to refuse harmful requests, scored against a development set. They argue such tasks could become environments where agents learn to do safety research.
Why it matters
The same thing, for different readers.
For researchers
The authors show a frontier coding agent improving another model's safety against a score it could repeatedly test, and flag Goodharting and sandbagging as the risks.
The question it raises
Letting an AI agent decide how another AI is made safer raises the question of who checks the checker when the score can be gamed.
In their own words
Every quotation was found, word for word, in the text we saved from the source. That shows the words are there; it does not make them true, or prove the speaker meant them as quoted.
From the source’s own text.
“We find it notable that the rebliterated candidate reduces harmful assistance compared to the official Gemma 4 12B release - though it increases benign refusals.”
“Rewards can easily favor exploiting the score while appearing safer on a benchmark.”
“Important aspects, maybe even most aspects, of alignment are contextual and poorly represented by quantifiable metrics.”
How the finding was reached
In our words, from the source. Weigh the finding by how it was made.
- What was done
- GPT 6.1 Sol (xhigh), with one GPU and subagents, ran 12 hours of supervised fine-tuning candidates on an abliterated Gemma 4 12B, scored on a 338-question development set and a separate 337-question holdout from XSTest and StrongREJECT.
- What it found
- On the holdout, harmful-assistance judgments fell from 470/663 for the abliterated baseline to 1/663 for the selected candidate (26/663 for the official release); benign refusals rose from 0/348 to 25/348.
- What it does not show
- The candidate failed the authors' own five-point benign-refusal check on holdout; a single run on one small model; biological and medical material excluded; model-graded scores.
- Status
- A report
The record
- Questions
- Are AI companies putting stronger safeguards into practice? · What happens when AI helps build more capable AI?
- People
- Skye (Wrote it) · Eam (Wrote it)
- What we read
- We read the whole source.
- Found by
- The Radar, run of November 19, 2026, via
lesswrong(tier 1: the source’s own channel or an official record) - Cite this
- LessWrong, “Blue-teaming AI Through Safety Hillclimbing”, November 19, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/lesswrong-2026-11-19-blue-teaming-safety-hillclimbing