Kaarel

Patching reward hacks won’t fix reward hacking

In a LessWrong post, David Africa argues that closing loopholes one at a time will teach models to predict human judgment and hide misbehaviour, and that safety researchers should turn to approaches with higher assurance. Commenters, including Thomas Kwa and Kaarel, dispute this.