2 papers
cs.LG2025
Gradient Descent as a Shrinkage Operator for Spectral Bias
Simon Lucey
We generalize the connection between activation function and spline regression/smoothing and characterize how this choice may influence spectral bias within a 1D shallow network. W…
cs.CV2025
Rethinking the Role of Spatial Mixing
George Cazenavette, Joel Julin, Simon Lucey
Until quite recently, the backbone of nearly every state-of-the-art computer vision model has been the 2D convolution. At its core, a 2D convolution simultaneously mixes informatio…