activity
20152026
most citedXLNet: Generalized Autoregressive Pretraining for Language Understanding

1.8k citations · 3.8k across the 47 of their papers we have counts for

collaborators
Showing 2017Show all

8 papers · 1 filter

cs.CL2017★ 3 cited

Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent

Zhilin Yang, Saizheng Zhang, Jack Urbanek +5

Contrary to most natural language processing research, which makes use of static datasets, humans learn language interactively, grounded in an environment. In this work we propose…

cs.CL2017★ 63 cited

Breaking the Softmax Bottleneck: A High-Rank RNN Language Model

Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov +1

We formulate language modeling as a matrix factorization problem, and show that the expressiveness of Softmax-based models (including the majority of neural language models) is lim…

cs.LG2017★ 228 cited

Good Semi-supervised Learning that Requires a Bad GAN

Zihang Dai, Zhilin Yang, Fan Yang +2

Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint…

cs.CL2017★ 218 cited

Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks

Zhilin Yang, Ruslan Salakhutdinov, William W. Cohen

Recent papers have shown that neural networks obtain state-of-the-art performance on several different sequence tagging tasks. One appealing property of such systems is their gener…

cs.CL2017★ 33 cited

Linguistic Knowledge as Memory for Recurrent Neural Networks

Bhuwan Dhingra, Zhilin Yang, William W. Cohen +1

Training recurrent neural networks to model long term dependencies is difficult. Hence, we propose to use external linguistic knowledge as an explicit signal to inform the model wh…

cs.AI2017★ 171 cited

Differentiable Learning of Logical Rules for Knowledge Base Reasoning

Fan Yang, Zhilin Yang, William W. Cohen

We study the problem of learning probabilistic first-order logical rules for knowledge base reasoning. This learning problem is difficult because it requires learning the parameter…

cs.AI2017★ 13 cited

A Probabilistic Framework for Location Inference from Social Media

Yujie Qian, Jie Tang, Zhilin Yang +3

We study the extent to which we can infer users' geographical locations from social media. Location inference from social media can benefit many applications, such as disaster mana…

cs.CL2017★ 29 cited

Semi-Supervised QA with Generative Domain-Adaptive Nets

Zhilin Yang, Junjie Hu, Ruslan Salakhutdinov +1

We study the problem of semi-supervised question answering----utilizing unlabeled text to boost the performance of question answering models. We propose a novel training framework,…