39 citations · 78 across the 3 of their papers we have counts for
3 papers
cs.CL2022★ 39 cited
A Fast Post-Training Pruning Framework for Transformers
Woosuk Kwon, Sehoon Kim, Michael W. Mahoney +3
Pruning is an effective way to reduce the huge inference cost of Transformer models. However, prior work on pruning Transformers requires retraining the models. This can add high t…
cs.CL2021★ 24 cited
Learned Token Pruning for Transformers
Sehoon Kim, Sheng Shen, David Thorsley +4
Deploying transformer models in practice is challenging due to their inference cost, which scales quadratically with input sequence length. To address this, we present a novel Lear…
cs.LG2020★ 15 cited
Nimble: Lightweight and Parallel GPU Task Scheduling for Deep Learning
Woosuk Kwon, Gyeong-In Yu, Eunji Jeong +1
Deep learning (DL) frameworks take advantage of GPUs to improve the speed of DL inference and training. Ideally, DL frameworks should be able to fully utilize the computation power…