activity
20222026
most citedSymplectic Momentum Neural Networks -- Using Discrete Variational Mechanics as a prior in Deep Learning

1 citations · 2 across the 8 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.LG2026

Sparse Attention as Compact Kernel Regression

Saul Santos, Nuno Gonçalves, Daniel C. McNamee +2

Recent work has revealed a link between self-attention mechanisms in transformers and test-time kernel regression via the Nadaraya-Watson estimator, with standard softmax attention…