54 citations · 112 across the 11 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.LG2020★ 7 cited
Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference
Bang An, Jie Lyu, Zhenyi Wang +6
The neural attention mechanism plays an important role in many natural language processing applications. In particular, the use of multi-head attention extends single-head attentio…
cs.CL2020★ 23 cited
Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraints
Zhenyi Wang, Xiaoyang Wang, Bang An +2
Text generation from a knowledge base aims to translate knowledge triples to natural language descriptions. Most existing methods ignore the faithfulness between a generated text d…
cs.LG2020
Guess First to Enable Better Compression and Adversarial Robustness
Sicheng Zhu, Bang An, Shiyu Niu
Machine learning models are generally vulnerable to adversarial examples, which is in contrast to the robustness of humans. In this paper, we try to leverage one of the mechanisms…