Automatic Node Selection for Deep Neural Networks using Group Lasso Regularization

Tsubasa Ochiai, Shigeki Matsuda, Hideyuki Watanabe +1

We examine the effect of the Group Lasso (gLasso) regularizer in selecting the salient nodes of Deep Neural Network (DNN) hidden layers by applying a DNN-HMM hybrid speech recogniz…