24 citations · 40 across the 5 of their papers we have counts for
5 papers
Not All Attention Is Needed: Gated Attention Network for Sequence Data
Lanqing Xue, Xiaopeng Li, Nevin L. Zhang
Although deep neural networks generally have fixed network structures, the concept of dynamic mechanism has drawn more and more attention in recent years. Attention mechanisms comp…
Learning Sparse Deep Feedforward Networks via Tree Skeleton Expansion
Zhourong Chen, Xiaopeng Li, Nevin L. Zhang
Despite the popularity of deep learning, structure learning for deep models remains a relatively under-explored area. In contrast, structure learning has been studied extensively f…
Building Sparse Deep Feedforward Networks using Tree Receptive Fields
Xiaopeng Li, Zhourong Chen, Nevin L. Zhang
Sparse connectivity is an important factor behind the success of convolutional neural networks and recurrent neural networks. In this paper, we consider the problem of learning spa…
Learning Latent Superstructures in Variational Autoencoders for Deep Multidimensional Clustering
Xiaopeng Li, Zhourong Chen, Leonard K. M. Poon +1
We investigate a variant of variational autoencoders where there is a superstructure of discrete latent variables on top of the latent features. In general, our superstructure is a…
Connection Discovery using Shared Images by Gaussian Relational Topic Model
Xiaopeng Li, Ming Cheung, James She
Social graphs, representing online friendships among users, are one of the fundamental types of data for many applications, such as recommendation, virality prediction and marketin…