887 citations · 1.3k across the 14 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2021
RID-Noise: Towards Robust Inverse Design under Noisy Environments
Jia-Qi Yang, Ke-Bin Fan, Hao Ma +1
From an engineering perspective, a design should not only perform well in an ideal condition, but should also resist noises. Such a design methodology, namely robust design, has be…
cs.LG2021★ 49 cited
Luna: Linear Unified Nested Attention
Xuezhe Ma, Xiang Kong, Sinong Wang +4
The quadratic computational and memory complexities of the Transformer's attention mechanism have limited its scalability for modeling long sequences. In this paper, we propose Lun…
cs.LG2020★ 887 cited
Linformer: Self-Attention with Linear Complexity
Sinong Wang, Belinda Z. Li, Madian Khabsa +2
Large transformer models have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However, training and deploying th…