24 citations · 50 across the 7 of their papers we have counts for
10 papers
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering
Fu Sun, Feng-Lin Li, Ruize Wang +3
Knowledge enhanced pre-trained language models (K-PLMs) are shown to be effective for many public tasks in the literature but few of them have been successfully applied in practice…
MlTr: Multi-label Classification with Transformer
Xing Cheng, Hezheng Lin, Xiangyu Wu +5
The task of multi-label image classification is to recognize all the object labels presented in an image. Though advancing for years, small objects, similar objects and objects wit…
CAT: Cross Attention in Vision Transformer
Hezheng Lin, Xing Cheng, Xiangyu Wu +5
Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for…
Dual-View Distilled BERT for Sentence Embedding
Xingyi Cheng
Recently, BERT realized significant progress for sentence matching via word-level cross sentence attention. However, the performance significantly drops when using siamese BERT-net…
A Workflow for Exploring Ligand Dissociation from a Macromolecule: Efficient Random Acceleration Molecular Dynamics Simulation and Interaction Fingerprints Analysis of Ligand Trajectories
Daria B. Kokha, Bernd Doser, Stefan Richter +3
The dissociation of ligands from proteins and other biomacromolecules occurs over a wide range of timescales. For most pharmaceutically relevant inhibitors, these timescales are fa…
SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check
Xingyi Cheng, Weidi Xu, Kunlong Chen +5
Chinese Spelling Check (CSC) is a task to detect and correct spelling errors in Chinese natural language. Existing methods have made attempts to incorporate the similarity knowledg…