1 citations · 1 across the 5 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
A Functional Perspective on Knowledge Distillation in Neural Networks
Israel Mason-Williams, Gabryel Mason-Williams, Helen Yannakoudakis
Knowledge distillation is considered a compression mechanism when judged on the resulting student's accuracy and loss, yet its functional impact is poorly understood. We quantify t…
cs.LG2025
A Function-Centric Perspective on Flat and Sharp Minima
Israel Mason-Williams, Gabryel Mason-Williams, Helen Yannakoudakis
Flat minima are strongly associated with improved generalisation in deep neural networks. However, this connection has proven nuanced in recent studies, with both theoretical count…