33 citations · 172 across the 29 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.LG2021
GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks
Weicheng Ma, Renze Lou, Kai Zhang +2
A key problem in multi-task learning (MTL) research is how to select high-quality auxiliary tasks automatically. This paper presents GradTS, an automatic auxiliary task selection m…
cs.CL2021★ 7 cited
Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks
Weicheng Ma, Kai Zhang, Renze Lou +2
This paper studies the relative importance of attention heads in Transformer-based models to aid their interpretability in cross-lingual and multi-lingual tasks. Prior research has…
cs.CL2021
RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER
Lin Sun, Jiquan Wang, Kai Zhang +2
Recently multimodal named entity recognition (MNER) has utilized images to improve the accuracy of NER in tweets. However, most of the multimodal methods use attention mechanisms t…