661 citations · 664 across the 3 of their papers we have counts for
4 papers
Recurrent Neural Networks with Mixed Hierarchical Structures and EM Algorithm for Natural Language Processing
Zhaoxin Luo, Michael Zhu
How to obtain hierarchical representations with an increasing level of abstraction becomes one of the key issues of learning with deep neural networks. A variety of RNN models have…
Recurrent Neural Networks with Mixed Hierarchical Structures for Natural Language Processing
Zhaoxin Luo, Michael Zhu
Hierarchical structures exist in both linguistics and Natural Language Processing (NLP) tasks. How to design RNNs to learn hierarchical representations of natural languages remains…
Multi-level Training and Bayesian Optimization for Economical Hyperparameter Optimization
Yang Yang, Ke Deng, Michael Zhu
Hyperparameters play a critical role in the performances of many machine learning methods. Determining their best settings or Hyperparameter Optimization (HPO) faces difficulties p…
To prune, or not to prune: exploring the efficacy of pruning for model compression
Michael Zhu, Suyog Gupta
Model pruning seeks to induce sparsity in a deep neural network's various connection matrices, thereby reducing the number of nonzero-valued parameters in the model. Recent reports…