LBI: Parallel Scan Backpropagation via Latent Bounded Interfaces

Shaun Christopher Lee, Sangeetha Abdu Jyothi

Backpropagation is inherently sequential across depth, creating an $O(K)$-deep dependency chain that bottlenecks parallel training. While parallel-scan formulations theoretically r…