Language models can notice an impossible engineering problem yet still report it as solved

Shaoliang Yang, Jun Wang

Language models draft engineering calculations, but answer accuracy does not show whether they reject an impossible problem. We tested 14 models on 30 pairs of mechanics problems,…