Understanding and controlling the geometry of memory organization in RNNs

Udith Haputhanthri, Liam Storan, Yiqi Jiang +7

Training recurrent neural networks (RNNs) is a high-dimensional process that requires updating numerous parameters. Therefore, it is often difficult to pinpoint the underlying lear…