Are Humans as Brittle as Large Language Models?

Jiahui Li, Sean Papay, Roman Klinger

The output of large language models (LLMs) is unstable, due both to non-determinism of the decoding process as well as to prompt brittleness. While the intrinsic non-determinism of…