activity
20172021
most citedDistilling Task-Specific Knowledge from BERT into Simple Neural Networks

335 citations · 373 across the 3 of their papers we have counts for

collaborators

6 papers

cs.CL20216 cited

Controllable Abstractive Dialogue Summarization with Sketch Supervision

Chien-Sheng Wu, Linqing Liu, Wenhao Liu +2

In this paper, we aim to improve abstractive dialogue summarization quality and, at the same time, enable granularity control. Our model has two primary components and stages: 1) a…

cs.CL2021

PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them

Patrick Lewis, Yuxiang Wu, Linqing Liu +5

Open-domain Question Answering models which directly leverage question-answer (QA) pairs, such as closed-book QA (CBQA) models and QA-pair retrievers, show promise in terms of spee…

cs.CL2021

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned

Sewon Min, Jordan Boyd-Graber, Chris Alberti +50

We review the EfficientQA competition from NeurIPS 2020. The competition focused on open-domain question answering (QA), where systems take natural language questions as input and…

cs.CL2019

MKD: a Multi-Task Knowledge Distillation Approach for Pretrained Language Models

Linqing Liu, Huan Wang, Jimmy Lin +2

Pretrained language models have led to significant performance gains in many NLP tasks. However, the intensive computing resources to train such models remain an issue. Knowledge d…

cs.CL2019335 cited

Distilling Task-Specific Knowledge from BERT into Simple Neural Networks

Raphael Tang, Yao Lu, Linqing Liu +3

In the natural language processing literature, neural networks are becoming increasingly deeper and complex. The recent poster child of this trend is the deep language representati…

cs.CL201732 cited

Generative Adversarial Network for Abstractive Text Summarization

Linqing Liu, Yao Lu, Min Yang +3

In this paper, we propose an adversarial process for abstractive text summarization, in which we simultaneously train a generative model G and a discriminative model D. In particul…