Counterfactual reasoning: Testing language models' understanding of hypothetical scenarios

Jiaxuan Li, Lang Yu, Allyson Ettinger

Current pre-trained language models have enabled remarkable improvements in downstream tasks, but it remains difficult to distinguish effects of statistical correlation from more s…