183 citations · 340 across the 16 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 11 cited
Attention-guided Generative Models for Extractive Question Answering
Peng Xu, Davis Liang, Zhiheng Huang +1
We propose a novel method for applying Transformer models to extractive question answering (QA) tasks. Recently, pretrained generative sequence-to-sequence (seq2seq) models have ac…
cs.CL2021★ 1 cited
Multiplicative Position-aware Transformer Models for Language Understanding
Zhiheng Huang, Davis Liang, Peng Xu +1
Transformer models, which leverage architectural improvements like self-attention, perform remarkably well on Natural Language Processing (NLP) tasks. The self-attention mechanism…