On the Representational Geometry of Dynamic Programs

Richard F. M. Lim, Ruriko Yoshida

Standard neural architectures often fail to generalize to longer inputs for dynamic programming (DP) targets. We investigate what makes this hard geometrically. Every finite min-pl…