On the Initialization of Long Short-Term Memory Networks

Mostafa Mehdipour Ghazi, Mads Nielsen, Akshay Pai +4

Weight initialization is important for faster convergence and stability of deep neural networks training. In this paper, a robust initialization method is developed to address the…