652 citations · 1.7k across the 25 of their papers we have counts for
4 papers · 1 filter
Contrastive Document Representation Learning with Graph Attention Networks
Peng Xu, Xinchi Chen, Xiaofei Ma +2
Recent progress in pretrained Transformer-based language models has shown great success in learning contextual representation of text. However, due to the quadratic self-attention…
Attention-guided Generative Models for Extractive Question Answering
Peng Xu, Davis Liang, Zhiheng Huang +1
We propose a novel method for applying Transformer models to extractive question answering (QA) tasks. Recently, pretrained generative sequence-to-sequence (seq2seq) models have ac…
Multiplicative Position-aware Transformer Models for Language Understanding
Zhiheng Huang, Davis Liang, Peng Xu +1
Transformer models, which leverage architectural improvements like self-attention, perform remarkably well on Natural Language Processing (NLP) tasks. The self-attention mechanism…
Spatially indirect intervalley excitons in bilayer WSe2
Zhiheng Huang, Yanchong Zhao, Tao Bo +16
Spatially indirect excitons with displaced wavefunctions of electrons and holes play a pivotal role in a large portfolio of fascinating physical phenomena and emerging optoelectron…