72 citations · 98 across the 13 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019★ 2 cited
Approximated Orthonormal Normalisation in Training Neural Networks
Guoqiang Zhang, Kenta Niwa, W. B. Kleijn
Generalisation of a deep neural network (DNN) is one major concern when employing the deep learning approach for solving practical problems. In this paper we propose a new techniqu…
cs.LG2019
Rapidly Adapting Moment Estimation
Guoqiang Zhang, Kenta Niwa, W. Bastiaan Kleijn
Adaptive gradient methods such as Adam have been shown to be very effective for training deep neural networks (DNNs) by tracking the second moment of gradients to compute the indiv…