98 citations · 103 across the 13 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.CL2019★ 98 cited
A Tensorized Transformer for Language Modeling
Xindian Ma, Peng Zhang, Shuai Zhang +4
Latest development of neural models has connected the encoder and decoder through a self-attention mechanism. In particular, Transformer, which is solely based on self-attention, h…
cs.CL2019
A Generalized Language Model in Tensor Space
Lipeng Zhang, Peng Zhang, Xindian Ma +3
In the literature, tensors have been effectively used for capturing the context information in language models. However, the existing methods usually adopt relatively-low order ten…