Guiding Neural Network Initialization via Marginal Likelihood Maximization

Anthony S. Tai, Chunfeng Huang

We propose a simple, data-driven approach to help guide hyperparameter selection for neural network initialization. We leverage the relationship between neural network and Gaussian…