activity
20192026
most citedALBERT: A Lite BERT for Self-supervised Learning of Language Representations

984 citations · 1.1k across the 27 of their papers we have counts for

collaborators
Showing 2019 · cs.CLShow all

8 papers · 2 filters

cs.CL2019★ 1 cited

How to Ask Better Questions? A Large-Scale Multi-Domain Dataset for Rewriting Ill-Formed Questions

Zewei Chu, Mingda Chen, Jing Chen +4

We present a large-scale dataset for the task of rewriting an ill-formed natural language question to a well-formed one. Our multi-domain question rewriting MQR dataset is construc…

cs.CL2019★ 984 cited

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Zhenzhong Lan, Mingda Chen, Sebastian Goodman +3

Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases be…

cs.CL2019★ 1 cited

Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations

Mingda Chen, Zewei Chu, Kevin Gimpel

Prior work on pretrained sentence embeddings and benchmarks focus on the capabilities of stand-alone sentences. We propose DiscoEval, a test suite of tasks to evaluate whether sent…

cs.CL2019

EntEval: A Holistic Evaluation Benchmark for Entity Representations

Mingda Chen, Zewei Chu, Yang Chen +2

Rich entity representations are useful for a wide class of problems involving entities. Despite their importance, there is no standardized benchmark that evaluates the overall qual…

cs.CL2019★ 1 cited

Variational Sequential Labelers for Semi-Supervised Learning

Mingda Chen, Qingming Tang, Karen Livescu +1

We introduce a family of multitask variational methods for semi-supervised sequence labeling. Our model family consists of a latent-variable generative model and a discriminative l…

cs.CL2019

Smaller Text Classifiers with Discriminative Cluster Embeddings

Mingda Chen, Kevin Gimpel

Word embedding parameters often dominate overall model sizes in neural methods for natural language processing. We reduce deployed model sizes of text classifiers by learning a har…