57 citations · 253 across the 33 of their papers we have counts for
4 papers · 1 filter
Rank4Class: A Ranking Formulation for Multiclass Classification
Nan Wang, Zhen Qin, Le Yan +4
Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive…
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
Vamsi Aribandi, Yi Tay, Tal Schuster +11
Despite the recent success of multi-task learning and transfer learning for natural language processing (NLP), few works have systematically studied the effect of scaling up the nu…
Improving Neural Ranking via Lossless Knowledge Distillation
Zhen Qin, Le Yan, Yi Tay +4
We explore a novel perspective of knowledge distillation (KD) for learning to rank (LTR), and introduce Self-Distilled neural Rankers (SDR), where student rankers are parameterized…
Distilling Interpretable Models into Human-Readable Code
Walker Ravina, Ethan Sterling, Olexiy Oryeshko +5
The goal of model distillation is to faithfully transfer teacher model knowledge to a model which is faster, more generalizable, more interpretable, or possesses other desirable ch…