12 citations · 30 across the 11 of their papers we have counts for
Showing math.OCShow all
2 papers · 1 filter
math.OC2022
First order online optimisation using forward gradients in over-parameterised systems
Behnam Mafakheri, Iman Shames, Jonathan H. Manton
The success of deep learning over the past decade mainly relies on gradient-based optimisation and backpropagation. This paper focuses on analysing the performance of first-order g…
math.OC2012★ 7 cited
Optimisation Geometry
Jonathan H. Manton
This article demonstrates how an understanding of the geometry of a family of cost functions can be used to develop efficient numerical algorithms for real-time optimisation. Cruci…