80 citations · 139 across the 6 of their papers we have counts for
4 papers · 1 filter
Adaptive Optimization with Examplewise Gradients
Julius Kunze, James Townsend, David Barber
We propose a new, more general approach to the design of stochastic gradient-based optimization methods for machine learning. In this new framework, optimizers assume access to a b…
Gaussian Mean Field Regularizes by Limiting Learned Information
Julius Kunze, Louis Kirsch, Hippolyt Ritter +1
Variational inference with a factorized Gaussian posterior estimate is a widely used approach for learning parameters and hidden variables. Empirically, a regularizing effect can b…
Modular Networks: Learning to Decompose Neural Computation
Louis Kirsch, Julius Kunze, David Barber
Scaling model capacity has been vital in the success of deep learning. For a typical network, necessary compute resources and training time grow dramatically with model size. Condi…
Transfer Learning for Speech Recognition on a Budget
Julius Kunze, Louis Kirsch, Ilia Kurenkov +3
End-to-end training of automated speech recognition (ASR) systems requires massive data and compute resources. We explore transfer learning based on model adaptation as an approach…