17 citations · 38 across the 10 of their papers we have counts for
4 papers · 1 filter
Robust Lottery Tickets for Pre-trained Language Models
Rui Zheng, Rong Bao, Yuhao Zhou +6
Recent works on Lottery Ticket Hypothesis have shown that pre-trained language models (PLMs) contain smaller matching subnetworks(winning tickets) which are capable of reaching acc…
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion
Jian Song, Di Liang, Rumei Li +5
Transformer-based pre-trained models like BERT have achieved great progress on Semantic Sentence Matching. Meanwhile, dependency prior knowledge has also shown general benefits in…
DABERT: Dual Attention Enhanced BERT for Semantic Matching
Sirui Wang, Di Liang, Jian Song +2
Transformer-based pre-trained language models such as BERT have achieved remarkable results in Semantic Sentence Matching. However, existing models still suffer from insufficient a…
Searching for Optimal Subword Tokenization in Cross-domain NER
Ruotian Ma, Yiding Tan, Xin Zhou +6
Input distribution shift is one of the vital problems in unsupervised domain adaptation (UDA). The most popular UDA approaches focus on domain-invariant representation learning, tr…