7 citations · 7 across the 2 of their papers we have counts for
2 papers
cs.LG2021
GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks
Weicheng Ma, Renze Lou, Kai Zhang +2
A key problem in multi-task learning (MTL) research is how to select high-quality auxiliary tasks automatically. This paper presents GradTS, an automatic auxiliary task selection m…
cs.CL2021★ 7 cited
Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks
Weicheng Ma, Kai Zhang, Renze Lou +2
This paper studies the relative importance of attention heads in Transformer-based models to aid their interpretability in cross-lingual and multi-lingual tasks. Prior research has…