When Do Models Admit They Are Wrong? Failure Disclosure Is Unstable Under Reinforcement Learning

Steven Y. Feng, Noah D. Goodman, Michael C. Frank +3

Outcome-based reinforcement learning can produce models with similar task performance but very different ways of communicating about their mistakes. We study failure disclosure: wh…