John Hewitt
Columbia University
Titles as the sources gave them. In 1 entry, with 0 checked quotations.
In the Base
Every entry they appear in.
Reward Misspecification Degrades Chain-of-Thought Monitorability
Columbia University researchers Tianyi Lorena Yan and John Hewitt report that training language models on a flawed reward makes their reasoning traces harder for monitors to use for spotting reward hacking. They also propose training models on an inferred description of the reward, which they report improves monitorability.