Deep and shallow biases in language models

An Vo, Vy Tuong Dang, Khai-Nguyen Nguyen +4

Large language models often repeatedly select the same answer even when many alternatives are plausible. Prior work treats this concentration as bias, but it does not distinguish s…