8 citations · 13 across the 5 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cond-mat.dis-nn2020
Theory of gating in recurrent neural networks
Kamesh Krishnamurthy, Tankut Can, David J. Schwab
Recurrent neural networks (RNNs) are powerful dynamical models, widely used in machine learning (ML) and neuroscience. Prior theoretical work has focused on RNNs with additive inte…
cs.LG2020★ 8 cited
Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs
Tankut Can, Kamesh Krishnamurthy, David J. Schwab
Recurrent neural networks (RNNs) are powerful dynamical models for data with complex temporal structure. However, training RNNs has traditionally proved challenging due to explodin…