10 papers
Beyond Laplace: Closed-form wrapped Gaussian posterior approximations on statistical manifolds
Marcelo Hartmann, Luu Hoang Phuc Hau, Anton Mallasto +8
In Bayesian statistics, the Laplace approximation provides a computationally efficient approximation to posterior distributions. However, its Gaussian form restricts it to elliptic…
Don't Stop Me Yet: Sampling Loss Minima via Dissipative Riemannian Mechanics
Albert Kjøller Jacobsen, Leo Uhre Jakobsen, Johanna Marie Gegenfurtner +1
The minima of modern neural network loss functions are typically not isolated, rather they form connected components of reparameterization invariant solutions on the training data.…
Learning Geometry and Topology via Multi-Chart Flows
Hanlin Yu, Søren Hauberg, Marcelo Hartmann +2
Real world data often lie on low-dimensional Riemannian manifolds embedded in high-dimensional spaces. This motivates learning degenerate normalizing flows that map between the amb…
Reducing Memorisation in Generative Models via Riemannian Bayesian Inference
Johanna Marie Gegenfurtner, Albert Kjøller Jacobsen, Naima Elosegui Borras +2
Modern generative models can produce realistic samples, however, balancing memorisation and generalisation remains an open problem. We approach this challenge from a Bayesian persp…
Staying on the Manifold: Geometry-Aware Noise Injection
Albert Kjøller Jacobsen, Johanna Marie Gegenfurtner, Georgios Arvanitidis
It has been shown that perturbing the input during training implicitly regularises the gradient of the learnt function, leading to smoother models and enhancing generalisation. How…
Connecting Neural Models Latent Geometries with Relative Geodesic Representations
Hanlin Yu, Berfin Inal, Georgios Arvanitidis +3
Neural models learn representations of high-dimensional data on low-dimensional manifolds. Multiple factors, including stochasticities in the training process, model architectures,…