On the Mirage of Long-Range Dependency, with an Application to Integer Multiplication

Zichao Wei

Integer multiplication has long been considered a hard problem for neural networks, with the difficulty widely attributed to the O(n) long-range dependency induced by carry chains.…