3 papers
cs.LG2026
A simple connection from loss flatness to compressed neural representations
Shirui Chen, Stefano Recanatesi, Eric Shea-Brown
Despite extensive study, the significance of sharpness -- the trace of the loss Hessian at local minima -- remains unclear. We investigate an alternative perspective: how sharpness…
cs.LG2025
KPFlow: An Operator Perspective on Dynamic Collapse Under Gradient Descent Training of Recurrent Networks
James Hazelden, Laura Driscoll, Eli Shlizerman +1
Gradient Descent (GD) and its variants are the primary tool for enabling efficient training of recurrent dynamical systems such as Recurrent Neural Networks (RNNs), Neural ODEs and…
q-bio.NC2025
Identifying the impact of local connectivity patterns on dynamics in excitatory-inhibitory networks
Yuxiu Shao, David Dahmen, Stefano Recanatesi +2
Networks of excitatory and inhibitory (EI) neurons form a canonical circuit in the brain. Seminal theoretical results on dynamics of such networks are based on the assumption that…