IIET: Efficient Numerical Transformer via Implicit Iterative Euler Method

Xinyu Liu, Bei Li, Jiahao Liu +6

High-order numerical methods enhance Transformer performance in tasks like NLP and CV, but introduce a performance-efficiency trade-off due to increased computational overhead. Our…