Large Language Model probabilities cannot reliably distinguish between possible and impossible language

Evelina Leivada, Raquel Montero, Paolo Morosi +5

A controversial test for Large Language Models concerns the ability to discern possible from impossible language. While some evidence attests to the models sensitivity to what cros…