10 citations · 10 across the 3 of their papers we have counts for
Showing stat.MLShow all
2 papers · 1 filter
stat.ML2024
Corridor Geometry in Gradient-Based Optimization
Benoit Dherin, Mihaela Rosca
We characterize regions of a loss surface as corridors when the continuous curves of steepest descent -- the solutions of the gradient flow -- become straight lines. We show that c…
stat.ML2023
On discretisation drift and smoothness regularisation in neural network training
Mihaela Claudia Rosca
The deep learning recipe of casting real-world problems as mathematical optimisation and tackling the optimisation by training deep neural networks using gradient-based optimisatio…