11 citations · 11 across the 2 of their papers we have counts for
2 papers
cs.LG2026
A Controlled Study of Attention-Only Transformers
Henry Ndubuaku, Karen Mosoyan, Jakub Mroz +5
Feed-forward networks hold two thirds of a transformer's non-embedding parameters, yet the architecture has not received a necessity test that controls parameters, compute, and dep…
cs.CV2022★ 11 cited
SoMoFormer: Multi-Person Pose Forecasting with Transformers
Edward Vendrow, Satyajit Kumar, Ehsan Adeli +1
Human pose forecasting is a challenging problem involving complex human body motion and posture dynamics. In cases that there are multiple people in the environment, one's motion m…