Categorizing Variants of Goodhart's Law

David Manheim, Scott Garrabrant

There are several distinct failure modes for overoptimization of systems on the basis of metrics. This occurs when a metric which can be used to improve a system is used to an exte…