273 citations · 1.6k across the 53 of their papers we have counts for
3 papers · 1 filter
A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features
Zhenmei Shi, Junyi Wei, Yingyu Liang
An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key fac…
What Knowledge Gets Distilled in Knowledge Distillation?
Utkarsh Ojha, Yuheng Li, Anirudh Sundara Rajan +2
Knowledge distillation aims to transfer useful information from a teacher network to a student network, with the primary goal of improving the student's performance for the task at…
On the identifiability of mixtures of ranking models
Xiaomin Zhang, Xucheng Zhang, Po-Ling Loh +1
Mixtures of ranking models are standard tools for ranking problems. However, even the fundamental question of parameter identifiability is not fully understood: the identifiability…