LLMs Know More About Numbers than They Can Say

Fengting Yuchi, Li Du, Jason Eisner

Although state-of-the-art LLMs can solve math problems, we find that they make errors on numerical comparisons with mixed notation: "Which is larger, $5.7\times 10^2$ or $580$?" T…