Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning

Bei Li, Tong Zheng, Rui Wang +8

Residual networks, as discrete approximations of Ordinary Differential Equations (ODEs), have inspired significant advancements in neural network design, including multistep method…