9 citations · 16 across the 2 of their papers we have counts for
4 papers
Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes
James Lucas, Juhan Bae, Michael R. Zhang +3
Linear interpolation between initial neural network parameters and converged parameters after training with stochastic gradient descent (SGD) typically leads to a monotonic decreas…
Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians
Juhan Bae, Roger Grosse
Hyperparameter optimization of neural networks can be elegantly formulated as a bilevel optimization problem. While research on bilevel optimization of neural networks has been dom…
Eigenvalue Corrected Noisy Natural Gradient
Juhan Bae, Guodong Zhang, Roger Grosse
Variational Bayesian neural networks combine the flexibility of deep learning with Bayesian uncertainty estimation. However, inference procedures for flexible variational posterior…
Learnable Pooling Methods for Video Classification
Sebastian Kmiec, Juhan Bae, Ruijian An
We introduce modifications to state-of-the-art approaches to aggregating local video descriptors by using attention mechanisms and function approximations. Rather than using ensemb…