Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
The Routing and Filtering Structure of Attention
Shafayeth Jamil, Rehan Kapadia
The attention interaction matrix contains two entangled computations: a skew-symmetric component that redistributes information between positions (routing) and a symmet…
cs.LG2026
Lie Generator Networks for Nonlinear Partial Differential Equations
Shafayeth Jamil, Rehan Kapadia
Linear dynamical systems are fully characterized by their eigenspectra, accessible directly from the generator of the dynamics. For nonlinear systems governed by partial differenti…
cs.LG2026
Interpretable Physics Extraction from Data for Linear Dynamical Systems using Lie Generator Networks
Shafayeth Jamil, Rehan Kapadia
When the system is linear, why should learning be nonlinear? Linear dynamical systems, the analytical backbone of control theory, signal processing and circuit analysis, have exact…