7 citations · 22 across the 46 of their papers we have counts for
4 papers · 1 filter
On skip connections and normalisation layers in deep optimisation
Lachlan Ewen MacDonald, Jack Valmadre, Hemanth Saratchandran +1
We introduce a general theoretical framework, designed for the study of gradient optimisation of deep neural networks, that encompasses ubiquitous architecture choices including ba…
How You Start Matters for Generalization
Sameera Ramasinghe, Lachlan MacDonald, Moshiur Farazi +2
Characterizing the remarkable generalization properties of over-parameterized neural networks remains an open problem. In this paper, we promote a shift of focus towards initializa…
Equivariant analytic torsion for proper actions
Peter Hochs, Hemanth Saratchandran
We construct an equivariant version of Ray-Singer analytic torsion for proper, isometric actions by locally compact groups on Riemannian manifolds, with compact quotients. We obtai…
A new higher order Yang--Mills--Higgs flow in Riemannian -manifold
Hemanth Saratchandran, Jiaogen Zhang, Pan Zhang
Let be a closed Riemannian -manifold and let be a vector bundle over with structure group , where is a compact Lie group. In this paper, we consider a new…