Le Song

Rent-Seeking Language Models: Reward Models Set the Prices, Frequent Audits Curb the Rent

A preprint recasts reward model overoptimization in RLHF as rent-seeking, with measurable rent and deadweight loss, and reports that RL turns 41% to 66% of its proxy gain into rent while true reward plateaus.