Unsupervised Learning of Initialization in Deep Neural Networks via Maximum Mean Discrepancy

Cheolhyoung Lee, Kyunghyun Cho

Despite the recent success of stochastic gradient descent in deep learning, it is often difficult to train a deep neural network with an inappropriate choice of its initial paramet…