73 citations · 242 across the 17 of their papers we have counts for
3 papers · 1 filter
Gated Recurrent Neural Networks with Weighted Time-Delay Feedback
N. Benjamin Erichson, Soon Hoe Lim, Michael W. Mahoney
In this paper, we present a novel approach to modeling long-term dependencies in sequential data by introducing a gated recurrent unit (GRU) with a weighted time-delay feedback mec…
Chaotic Regularization and Heavy-Tailed Limits for Deterministic Gradient Descent
Soon Hoe Lim, Yijun Wan, Umut Şimşekli
Recent studies have shown that gradient descent (GD) can achieve improved generalization when its dynamics exhibits a chaotic behavior. However, to obtain the desired effect, the s…
NoisyMix: Boosting Model Robustness to Common Corruptions
N. Benjamin Erichson, Soon Hoe Lim, Winnie Xu +3
For many real-world applications, obtaining stable and robust statistical performance is more important than simply achieving state-of-the-art predictive test accuracy, and thus ro…