68 citations · 493 across the 40 of their papers we have counts for
4 papers · 1 filter
Mechanisms of dimensionality reduction and decorrelation in deep neural networks
Haiping Huang
Deep neural networks are widely used in various domains. However, the nature of computations at each layer of the deep networks is far from being well understood. Increasing the in…
Random active path model of deep neural networks with diluted binary synapses
Haiping Huang, Alireza Goudarzi
Deep learning has become a powerful and popular tool for a variety of machine learning tasks. However, it is challenging to understand the mechanism of deep learning from a theoret…
Role of zero synapses in unsupervised feature learning
Haiping Huang
Synapses in real neural circuits can take discrete values, including zero (silent or potential) synapses. The computational role of zero synapses in unsupervised feature learning o…
Reinforced stochastic gradient descent for deep neural network learning
Haiping Huang, Taro Toyoizumi
Stochastic gradient descent (SGD) is a standard optimization method to minimize a training error with respect to network parameters in modern neural network learning. However, it t…