papers
Publications (12)
cs.CL2022
ST-MoE: Designing Stable and Transferable Sparse Expert Models
Barret Zoph, Irwan Bello, Sameer Kumar +5
cs.CV2021
Revisiting 3D ResNets for Video Recognition
Xianzhi Du, Yeqing Li, Yin Cui +3
cs.CV2020
Global Self-Attention Networks for Image Recognition
Zhuoran Shen, Irwan Bello, Raviteja Vemulapalli +2
cs.CV2021
Revisiting ResNets: Improved Training and Scaling Strategies
Irwan Bello, William Fedus, Xianzhi Du +5
cs.IR2019
Seq2Slate: Re-ranking and Slate Optimization with RNNs
Irwan Bello, Sayali Kulkarni, Sagar Jain +6
cs.CV2020
Attention Augmented Convolutional Networks
Irwan Bello, Barret Zoph, Ashish Vaswani +2
cs.NE2018
Backprop Evolution
Maximilian Alber, Irwan Bello, Barret Zoph +3
cs.AI2017
Neural Optimizer Search with Reinforcement Learning
Irwan Bello, Barret Zoph, Vijay Vasudevan +1
cs.CV2021
LambdaNetworks: Modeling Long-Range Interactions Without Attention
Irwan Bello
cs.CL2024
GPT-4 Technical Report
OpenAI, Josh Achiam, Steven Adler +278
cs.CV2019
Stand-Alone Self-Attention in Vision Models
Prajit Ramachandran, Niki Parmar, Ashish Vaswani +3
cs.AI2017
Neural Combinatorial Optimization with Reinforcement Learning
Irwan Bello, Hieu Pham, Quoc V. Le +2