221 citations · 821 across the 21 of their papers we have counts for
23 papers
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with Parameters
Aston Zhang, Yi Tay, Shuai Zhang +4
Recent works have demonstrated reasonable success of representation learning in hypercomplex space. Specifically, "fully-connected layers with Quaternions" (4D hypercomplex numbers…
Collecting and Analyzing Multidimensional Data with Local Differential Privacy
Ning Wang, Xiaokui Xiao, Yin Yang +5
Local differential privacy (LDP) is a recently proposed privacy standard for collecting and analyzing data, which has been used, e.g., in the Chrome browser, iOS and macOS. In LDP,…
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
Yi Tay, Aston Zhang, Luu Anh Tuan +5
Many state-of-the-art neural models for NLP are heavily parameterized and thus memory inefficient. This paper proposes a series of lightweight and memory efficient neural architect…
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives
Yi Tay, Shuohang Wang, Luu Anh Tuan +6
This paper tackles the problem of reading comprehension over long narratives where documents easily span over thousands of tokens. We propose a curriculum learning (CL) based Point…
Recurrently Controlled Recurrent Networks
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
Recurrent neural networks (RNNs) such as long short-term memory and gated recurrent units are pivotal building blocks across a broad spectrum of sequence modeling problems. This pa…
Densely Connected Attention Propagation for Reading Comprehension
Yi Tay, Luu Anh Tuan, Siu Cheung Hui +1
We propose DecaProp (Densely Connected Attention Propagation), a new densely connected neural architecture for reading comprehension (RC). There are two distinct characteristics of…