activity
20212026
most citedNN-LUT: Neural Approximation of Non-Linear Operations for Efficient Transformer Inference

5 citations · 7 across the 12 of their papers we have counts for

collaborators
Showing 2022Show all

1 paper · 1 filter

cs.CL2022

Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders

Minsoo Kim, Sihwa Lee, Sukjin Hong +2

Knowledge distillation (KD) has been a ubiquitous method for model compression to strengthen the capability of a lightweight model with the transferred knowledge from the teacher.…