174 citations · 566 across the 18 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
Associative Transformer
Yuwei Sun, Hideya Ochiai, Zhirong Wu +2
Emerging from the pairwise attention in conventional Transformers, there is a growing interest in sparse attention mechanisms that align more closely with localized, contextual lea…
cs.LG2015★ 11 cited
Adjustable Bounded Rectifiers: Towards Deep Binary Representations
Zhirong Wu, Dahua Lin, Xiaoou Tang
Binary representation is desirable for its memory efficiency, computation speed and robustness. In this paper, we propose adjustable bounded rectifiers to learn binary representati…