229 citations · 277 across the 10 of their papers we have counts for
4 papers · 1 filter
Transportation analysis of denoising autoencoders: a novel method for analyzing deep neural networks
Sho Sonoda, Noboru Murata
The feature map obtained from the denoising autoencoder (DAE) is investigated by determining transportation dynamics of the DAE, which is a cornerstone for deep learning. Despite t…
Transport Analysis of Infinitely Deep Neural Network
Sho Sonoda, Noboru Murata
We investigated the feature map inside deep neural networks (DNNs) by tracking the transport map. We are interested in the role of depth (why do DNNs perform better than shallow mo…
Nonparametric Weight Initialization of Neural Networks via Integral Representation
Sho Sonoda, Noboru Murata
A new initialization method for hidden parameters in a neural network is proposed. Derived from the integral representation of the neural network, a nonparametric probability distr…
Multiplicative Nonholonomic/Newton -like Algorithm
Toshinao Akuzawa, Noboru Murata
We construct new algorithms from scratch, which use the fourth order cumulant of stochastic variables for the cost function. The multiplicative updating rule here constructed is na…