23 citations · 38 across the 3 of their papers we have counts for
3 papers
cs.CL2022★ 23 cited
Shortcut Learning of Large Language Models in Natural Language Understanding
Mengnan Du, Fengxiang He, Na Zou +2
Large language models (LLMs) have achieved state-of-the-art performance on a series of natural language understanding tasks. However, these LLMs might rely on dataset bias and arti…
cs.CL2021★ 4 cited
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding
Mengnan Du, Subhabrata Mukherjee, Yu Cheng +3
Recent work has focused on compressing pre-trained language models (PLMs) like BERT where the major focus has been to improve the in-distribution performance for downstream tasks.…
cs.CL2021★ 11 cited
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models
Mengnan Du, Varun Manjunatha, Rajiv Jain +5
Recent studies indicate that NLU models are prone to rely on shortcut features for prediction, without achieving true language understanding. As a result, these models fail to gene…