196 citations · 543 across the 22 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.LG2021
CARLS: Cross-platform Asynchronous Representation Learning System
Chun-Ta Lu, Yun Zeng, Da-Cheng Juan +13
In this work, we propose CARLS, a novel framework for augmenting the capacity of existing deep learning frameworks by enabling multiple components -- model trainers, knowledge make…
cs.LG2021★ 2 cited
Switch Spaces: Learning Product Spaces with Sparse Gating
Shuai Zhang, Yi Tay, Wenqi Jiang +2
Learning embedding spaces of suitable geometry is critical for representation learning. In order for learned representations to be effective and efficient, it is ideal that the geo…
cs.CV2021★ 9 cited
OmniNet: Omnidirectional Representations from Transformers
Yi Tay, Mostafa Dehghani, Vamsi Aribandi +6
This paper proposes Omnidirectional Representations from Transformers (OmniNet). In OmniNet, instead of maintaining a strictly horizontal receptive field, each token is allowed to…