2 citations · 2 across the 1 of their papers we have counts for
1 paper · 1 filter
Don Kurian Dennis, Abhishek Shetty, Anish Sevekari +2
We study the problem of progressive ensemble distillation: Given a large, pretrained teacher model g, we seek to decompose the model into smaller, low-inference cost student mode…