9 citations · 9 across the 1 of their papers we have counts for
5 papers
HiLLoC: Lossless Image Compression with Hierarchical Latent Variable Models
James Townsend, Thomas Bird, Julius Kunze +1
We make the following striking observation: fully convolutional VAE models trained on 32x32 ImageNet can generalize well, not just to 64x64 but also to far larger photographs, with…
Gaussian Mean Field Regularizes by Limiting Learned Information
Julius Kunze, Louis Kirsch, Hippolyt Ritter +1
Variational inference with a factorized Gaussian posterior estimate is a widely used approach for learning parameters and hidden variables. Empirically, a regularizing effect can b…
Modular Networks: Learning to Decompose Neural Computation
Louis Kirsch, Julius Kunze, David Barber
Scaling model capacity has been vital in the success of deep learning. For a typical network, necessary compute resources and training time grow dramatically with model size. Condi…
Stochastic Variational Optimization
Thomas Bird, Julius Kunze, David Barber
Variational Optimization forms a differentiable upper bound on an objective. We show that approaches such as Natural Evolution Strategies and Gaussian Perturbation, are special cas…
Transfer Learning for Speech Recognition on a Budget
Julius Kunze, Louis Kirsch, Ilia Kurenkov +3
End-to-end training of automated speech recognition (ASR) systems requires massive data and compute resources. We explore transfer learning based on model adaptation as an approach…