560 citations · 560 across the 3 of their papers we have counts for
3 papers
cs.LG2026
Low-Rank Attention Residuals
Jonathan Su
Attention Residuals (AttnRes) replace the fixed residual sum with depth-wise attention over previous sub-layer outputs in Large Language Models (LLMs), but use each output as both…
cs.CL2026
Attention Projection Mixing with Exogenous Anchors
Jonathan Su
Cross-layer reuse of early attention projections can improve optimization and data efficiency, but it creates a structural conflict: the first layer must simultaneously act as a st…
cs.LG2018★ 560 cited
This Looks Like That: Deep Learning for Interpretable Image Recognition
Chaofan Chen, Oscar Li, Chaofan Tao +3
When we are faced with challenging image classification tasks, we often explain our reasoning by dissecting the image, and pointing out prototypical aspects of one class or another…