activity
20162023
most citedXLNet: Generalized Autoregressive Pretraining for Language Understanding

1.8k citations · 4.6k across the 52 of their papers we have counts for

collaborators
Showing 2019Show all

15 papers · 1 filter

cs.LG2019★ 7 cited

Graph-Revised Convolutional Network

Donghan Yu, Ruohong Zhang, Zhengbao Jiang +2

Graph Convolutional Networks (GCNs) have received increasing attention in the machine learning community for effectively leveraging both the content features of nodes and the linka…

cs.CL2019★ 6 cited

A Re-evaluation of Knowledge Graph Completion Methods

Zhiqing Sun, Shikhar Vashishth, Soumya Sanyal +2

Knowledge Graph Completion (KGC) aims at automatically predicting missing links for large-scale knowledge graphs. A vast number of state-of-the-art KGC techniques have got publishe…

cs.CL2019★ 7 cited

XL-Editor: Post-editing Sentences with XLNet

Yong-Siang Shih, Wei-Cheng Chang, Yiming Yang

While neural sequence generation models achieve initial success for many NLP applications, the canonical decoding procedure with left-to-right generation order (i.e., autoregressiv…

cs.LG2019★ 28 cited

Active Learning for Graph Neural Networks via Node Feature Propagation

Yuexin Wu, Yichong Xu, Aarti Singh +2

Graph Neural Networks (GNNs) for prediction tasks like node classification or edge prediction have received increasing attention in recent machine learning from graphically structu…

cs.CL2019★ 9 cited

Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework

Zirui Wang, Jiateng Xie, Ruochen Xu +3

Learning multilingual representations of text has proven a successful method for many cross-lingual transfer learning tasks. There are two main paradigms for learning such represen…

cs.CL2019★ 14 cited

Bridging the domain gap in cross-lingual document classification

Guokun Lai, Barlas Oguz, Yiming Yang +1

The scarcity of labeled training data often prohibits the internationalization of NLP models to multiple languages. Recent developments in cross-lingual understanding (XLU) has mad…

cs.LG2019

A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text

Bohan Li, Junxian He, Graham Neubig +2

When trained effectively, the Variational Autoencoder (VAE) is both a powerful language model and an effective representation learning framework. In practice, however, VAEs are tra…

cs.CL2019★ 1.8k cited

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Zhilin Yang, Zihang Dai, Yiming Yang +3

With the capability of modeling bidirectional contexts, denoising autoencoding based pretraining like BERT achieves better performance than pretraining approaches based on autoregr…

cs.LG2019★ 13 cited

Taming Pretrained Transformers for Extreme Multi-label Text Classification

Wei-Cheng Chang, Hsiang-Fu Yu, Kai Zhong +2

We consider the extreme multi-label text classification (XMC) problem: given an input text, return the most relevant labels from a large label collection. For example, the input te…

stat.ML2019★ 28 cited

Implicit Kernel Learning

Chun-Liang Li, Wei-Cheng Chang, Youssef Mroueh +2

Kernels are powerful and versatile tools in machine learning and statistics. Although the notion of universal kernels and characteristic kernels has been studied, kernel selection…

cs.CL2019★ 4 cited

The ARIEL-CMU Systems for LoReHLT18

Aditi Chaudhary, Siddharth Dalmia, Junjie Hu +27

This paper describes the ARIEL-CMU submissions to the Low Resource Human Language Technologies (LoReHLT) 2018 evaluations for the tasks Machine Translation (MT), Entity Discovery a…

cs.LG2019★ 1 cited

Re-examination of the Role of Latent Variables in Sequence Modeling

Zihang Dai, Guokun Lai, Yiming Yang +1

With latent variables, stochastic recurrent models have achieved state-of-the-art performance in modeling sound-wave sequence. However, opposite results are also observed in other…

cs.CL2019★ 20 cited

An Adversarial Approach to High-Quality, Sentiment-Controlled Neural Dialogue Generation

Xiang Kong, Bohan Li, Graham Neubig +2

In this work, we propose a method for neural dialogue response generation that allows not only generating semantically reasonable responses according to the dialogue history, but a…

stat.ML2019★ 15 cited

Kernel Change-point Detection with Auxiliary Deep Generative Models

Wei-Cheng Chang, Chun-Liang Li, Yiming Yang +1

Detecting the emergence of abrupt property changes in time series is a challenging problem. Kernel two-sample test has been studied for this task which makes fewer assumptions on t…

cs.LG2019

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

Zihang Dai, Zhilin Yang, Yiming Yang +3

Transformers have a potential of learning longer-term dependency, but are limited by a fixed-length context in the setting of language modeling. We propose a novel neural architect…