204 citations · 879 across the 52 of their papers we have counts for
6 papers · 1 filter
Rank4Class: A Ranking Formulation for Multiclass Classification
Nan Wang, Zhen Qin, Le Yan +4
Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive…
Improving Neural Ranking via Lossless Knowledge Distillation
Zhen Qin, Le Yan, Yi Tay +4
We explore a novel perspective of knowledge distillation (KD) for learning to rank (LTR), and introduce Self-Distilled neural Rankers (SDR), where student rankers are parameterized…
Dynamic Language Models for Continuously Evolving Content
Spurthi Amba Hombaiah, Tao Chen, Mingyang Zhang +2
The content on the web is in a constant state of flux. New entities, issues, and ideas continuously emerge, while the semantics of the existing conversation topics gradually shift.…
LAMPRET: Layout-Aware Multimodal PreTraining for Document Understanding
Te-Lin Wu, Cheng Li, Mingyang Zhang +3
Document layout comprises both structural and visual (eg. font-sizes) information that is vital but often ignored by machine learning models. The few existing models which do use l…
Natural Language Understanding with Privacy-Preserving BERT
Chen Qu, Weize Kong, Liu Yang +3
Privacy preservation remains a key challenge in data mining and Natural Language Understanding (NLU). Previous research shows that the input text or even text embeddings can leak p…
WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learning
Krishna Srinivasan, Karthik Raman, Jiecao Chen +2
The milestone improvements brought about by deep representation learning and pre-training techniques have led to large performance gains across downstream NLP, IR and Vision tasks.…