193 citations · 255 across the 17 of their papers we have counts for
3 papers · 1 filter
Adaptive-saturated RNN: Remember more with less instability
Khoi Minh Nguyen-Duy, Quang Pham, Binh T. Nguyen
Orthogonal parameterization is a compelling solution to the vanishing gradient problem (VGP) in recurrent neural networks (RNNs). With orthogonal parameters and non-saturated activ…
Learning Fast and Slow for Online Time Series Forecasting
Quang Pham, Chenghao Liu, Doyen Sahoo +1
The fast adaptation capability of deep neural networks in non-stationary environments is critical for online time series forecasting. Successful solutions require handling changes…
Online Deep Learning: Learning Deep Neural Networks on the Fly
Doyen Sahoo, Quang Pham, Jing Lu +1
Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning…