37 citations · 37 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Hierarchical Shift Mixing -- Beyond Dense Attention in Transformers
Robert Forchheimer
Since the introduction of the Transformer architecture for large language models, the softmax-based attention layer has faced increasing scrutinity due to its quadratic-time comput…
cs.LG2022
Local Approximations, Real Interpolation and Machine Learning
Eric Setterqvist, Natan Kruglyak, Robert Forchheimer
We suggest a novel classification algorithm that is based on local approximations and explain its connections with Artificial Neural Networks (ANNs) and Nearest Neighbour classifie…