82 citations · 102 across the 3 of their papers we have counts for
3 papers
Accelerating Training of Deep Neural Networks with a Standardization Loss
Jasmine Collins, Johannes Balle, Jonathon Shlens
A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better…
Protein Secondary Structure Prediction Using Deep Multi-scale Convolutional Neural Networks and Next-Step Conditioning
Akosua Busia, Jasmine Collins, Navdeep Jaitly
Recently developed deep learning techniques have significantly improved the accuracy of various speech and image recognition systems. In this paper we adapt some of these technique…
Capacity and Trainability in Recurrent Neural Networks
Jasmine Collins, Jascha Sohl-Dickstein, David Sussillo
Two potential bottlenecks on the expressiveness of recurrent neural networks (RNNs) are their ability to store information about the task in their parameters, and to store informat…