Reward Misspecification Degrades CoT Monitorability
tianyi-lorena-yan-me.web.app · saved by 2 readers
A controlled testbed shows that reward misspecification alone makes chain-of-thought unmonitorable, and reward description training recovers monitorability.