activity
20162022
most citedPractical Gauss-Newton Optimisation for Deep Learning

35 citations · 51 across the 6 of their papers we have counts for

collaborators

9 papers

hep-lat20225 cited

Aspects of scaling and scalability for flow-based sampling of lattice QCD

Ryan Abbott, Michael S. Albergo, Aleksandar Botev +10

Recent applications of machine-learned normalizing flows to sampling in lattice field theory suggest that such methods may be able to mitigate critical slowing down and topological…

cs.LG20221 cited

Deep Learning without Shortcuts: Shaping the Kernel with Tailored Rectifiers

Guodong Zhang, Aleksandar Botev, James Martens

Training very deep neural networks is still an extremely challenging task. The common solution is to use shortcut connections and normalization layers, which are both crucial ingre…

physics.comp-ph20207 cited

Better, Faster Fermionic Neural Networks

James S. Spencer, David Pfau, Aleksandar Botev +1

The Fermionic Neural Network (FermiNet) is a recently-developed neural network architecture that can be used as a wavefunction Ansatz for many-electron systems, and has already dem…

stat.ML2020

Disentangling by Subspace Diffusion

David Pfau, Irina Higgins, Aleksandar Botev +1

We present a novel nonparametric algorithm for symmetry-based disentangling of data manifolds, the Geometric Manifold Component Estimator (GEOMANCER). GEOMANCER provides a partial…

cs.LG2019

Hamiltonian Generative Networks

Peter Toth, Danilo Jimenez Rezende, Andrew Jaegle +3

The Hamiltonian formalism plays a central role in classical and quantum physics. Hamiltonians are the main tool for modelling the continuous time evolution of systems with conserve…

stat.ML2018

Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting

Hippolyt Ritter, Aleksandar Botev, David Barber

We introduce the Kronecker factored online Laplace approximation for overcoming catastrophic forgetting in neural networks. The method is grounded in a Bayesian online learning fra…