687 citations · 4k across the 58 of their papers we have counts for
8 papers · 1 filter
Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese
Zhuosheng Zhang, Hanqing Zhang, Keming Chen +4
Although pre-trained models (PLMs) have achieved remarkable improvements in a wide range of NLP tasks, they are expensive in terms of time and resources. This calls for the study o…
Jointly Learning to Repair Code and Generate Commit Message
Jiaqi Bai, Long Zhou, Ambrosio Blanco +4
We propose a novel task of jointly repairing program codes and generating commit messages. Code repair and commit message generation are two essential and related tasks for softwar…
Discovering Representation Sprachbund For Multilingual Pre-Training
Yimin Fan, Yaobo Liang, Alexandre Muzio +4
Multilingual pre-trained models have demonstrated their effectiveness in many multilingual NLP tasks and enabled zero-shot or few-shot transfer from high-resource languages to low…
From LSAT: The Progress and Challenges of Complex Reasoning
Siyuan Wang, Zhongkun Liu, Wanjun Zhong +4
Complex reasoning aims to draw a correct inference based on complex rules. As a hallmark of human intelligence, it involves a degree of explicit reading comprehension, interpretati…
CoSQA: 20,000+ Web Queries for Code Search and Question Answering
Junjie Huang, Duyu Tang, Linjun Shou +5
Finding codes given natural language query isb eneficial to the productivity of software developers. Future progress towards better semantic matching between query and code require…
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text
Siyuan Wang, Wanjun Zhong, Duyu Tang +5
Logical reasoning of text requires understanding critical logical information in the text and performing inference over them. Large-scale pre-trained models for logical reasoning m…