221 citations · 816 across the 9 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CV2021★ 15 cited
Revisiting 3D ResNets for Video Recognition
Xianzhi Du, Yeqing Li, Yin Cui +3
A recent work from Bello shows that training and scaling strategies may be more significant than model architectures for visual recognition. This short note studies effective train…
cs.CV2021★ 210 cited
Revisiting ResNets: Improved Training and Scaling Strategies
Irwan Bello, William Fedus, Xianzhi Du +5
Novel computer vision architectures monopolize the spotlight, but the impact of the model architecture is often conflated with simultaneous changes to training methodology and scal…
cs.CV2021★ 48 cited
LambdaNetworks: Modeling Long-Range Interactions Without Attention
Irwan Bello
We present lambda layers -- an alternative framework to self-attention -- for capturing long-range interactions between an input and structured contextual information (e.g. a pixel…