berns

“I argue that the fundamental concept underlying corrigibility is respect for authority, using the analogy of a healthcare proxy's relationship to a patient as an intuitive guide.”

“The real reason we want the AI not to interfere in its own shutdown is because we think that whether an AI should be shut down is a decision of grave importance that humanity reserves for itself to make.”

“Thus, this work is a decomposition of the corrigibility problem, not a complete solution to it, since some idealizations made above still require more rigorous and realistic treatments.”

“Importantly, the theorem and corrollary only establish asymptotic guarantees, meaning that the results are only establish in the limit rather than in finite time.”