Encoding word order in complex embeddings

Benyou Wang, Donghao Zhao, Christina Lioma +3

Sequential word order is important when processing text. Currently, neural networks (NNs) address this by modeling word position using position embeddings. The problem is that posi…