Samuel Knoche
Titles as the sources gave them. In 1 entry, with 0 checked quotations.
In the Base
Every entry they appear in.
LoReFT GRAFT Better at Preventing RL Grift
On LessWrong, Samuel Knoche reports that the GRAFT method against reward hacking can be improved by using a single-layer rank-1 LoReFT adapter as the forget adapter. The post says this uses 0.029% of the parameters of the original, suppresses hacking equally well, improves clean-environment solve rate and needs no anchor environment.