237 citations · 1.3k across the 60 of their papers we have counts for
5 papers · 1 filter
PHNNs: Lightweight Neural Networks via Parameterized Hypercomplex Convolutions
Eleonora Grassucci, Aston Zhang, Danilo Comminiello
Hypercomplex neural networks have proven to reduce the overall number of parameters while ensuring valuable performance by leveraging the properties of Clifford algebras. Recently,…
Dive into Deep Learning
Aston Zhang, Zachary C. Lipton, Mu Li +1
This open-source book represents our attempt to make deep learning approachable, teaching readers the concepts, the context, and the code. The entire book is drafted in Jupyter not…
Controllable and Diverse Text Generation in E-commerce
Huajie Shao, Jun Wang, Haohong Lin +4
In E-commerce, a key challenge in text generation is to find a good trade-off between word diversity and accuracy (relevance) in order to make generated text appear more natural an…
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with Parameters
Aston Zhang, Yi Tay, Shuai Zhang +4
Recent works have demonstrated reasonable success of representation learning in hypercomplex space. Specifically, "fully-connected layers with Quaternions" (4D hypercomplex numbers…
A Unified Lottery Ticket Hypothesis for Graph Neural Networks
Tianlong Chen, Yongduo Sui, Xuxi Chen +2
With graphs rapidly growing in size and deeper graph neural networks (GNNs) emerging, the training and inference of GNNs become increasingly expensive. Existing network weight prun…