86 citations · 112 across the 11 of their papers we have counts for
8 papers · 1 filter
LongT5: Efficient Text-To-Text Transformer for Long Sequences
Mandy Guo, Joshua Ainslie, David Uthus +4
Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer-based neural models. In this paper, we pre…
Gym-RTS: Toward Affordable Full Game Real-time Strategy Games Research with Deep Reinforcement Learning
Shengyi Huang, Santiago Ontañón, Chris Bamford +1
In recent years, researchers have achieved great success in applying Deep Reinforcement Learning (DRL) algorithms to Real-time Strategy (RTS) games, creating strong autonomous agen…
FNet: Mixing Tokens with Fourier Transforms
James Lee-Thorp, Joshua Ainslie, Ilya Eckstein +1
We show that Transformer encoder architectures can be sped up, with limited accuracy costs, by replacing the self-attention sublayers with simple linear transformations that "mix"…
Rotating Boson Stars Using Finite Differences and Global Newton Methods
Santiago Ontanon, Miguel Alcubierre
We study Rotating Boson Star initial data for Numerical Relativity as previously considered by Yoshida and Eriguchi, Lai (arXiv:gr-qc/0410040v2), and Grandclement, Somé and Gourgou…
Player-Centered AI for Automatic Game Personalization: Open Problems
Jichen Zhu, Santiago Ontañón
Computer games represent an ideal research domain for the next generation of personalized digital applications. This paper presents a player-centered framework of AI for game perso…
Personalization Paradox in Behavior Change Apps: Lessons from a Social Comparison-Based Personalized App for Physical Activity
Jichen Zhu, Diane H. Dallal, Robert C. Gray +4
Social comparison-based features are widely used in social computing apps. However, most existing apps are not grounded in social comparison theories and do not consider individual…