Counterfactual reasoning: Do language models need world knowledge for causal understanding?

Jiaxuan Li, Lang Yu, Allyson Ettinger

Current pre-trained language models have enabled remarkable improvements in downstream tasks, but it remains difficult to distinguish effects of statistical correlation from more s…