3 papers
cs.LG2023
Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks
Elre T. Oldewage, Ross M. Clarke, José Miguel Hernández-Lobato
Despite their popularity in the field of continuous optimisation, second-order quasi-Newton methods are challenging to apply in machine learning, as the Hessian matrix is intractab…
cs.LG2022
Adversarial Attacks are a Surprisingly Strong Baseline for Poisoning Few-Shot Meta-Learners
Elre T. Oldewage, John Bronskill, Richard E. Turner
This paper examines the robustness of deployed few-shot meta-learning systems when they are fed an imperceptibly perturbed few-shot dataset. We attack amortized meta-learners, whic…
cs.LG2021
Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation
Ross M. Clarke, Elre T. Oldewage, José Miguel Hernández-Lobato
Machine learning training methods depend plentifully and intricately on hyperparameters, motivating automated strategies for their optimisation. Many existing algorithms restart tr…