most citedKroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation

10 citations · 10 across the 1 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2021

Block Pruning For Faster Transformers

François Lagunas, Ella Charlaix, Victor Sanh +1

Pre-training has improved model accuracy for both classification and generation tasks at the cost of introducing much larger and slower models. Pruning methods have proven to be an…