4 citations · 7 across the 6 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 4 cited
Learning Multiscale Transformer Models for Sequence Generation
Bei Li, Tong Zheng, Yi Jing +3
Multiscale feature hierarchies have been witnessed the success in the computer vision area. This further motivates researchers to design multiscale Transformer for natural language…
cs.CL2022★ 2 cited
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation
Bei Li, Quan Du, Tao Zhou +7
Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). This paper explores a deeper relationship between Transformer and numerical ODE…