67 citations · 164 across the 20 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2021
Distilling Linguistic Context for Language Model Compression
Geondo Park, Gyeongman Kim, Eunho Yang
A computationally expensive and memory intensive neural network lies behind the recent success of language representation learning. Knowledge distillation, a major technique for de…
cs.CL2021
Mutually-Constrained Monotonic Multihead Attention for Online ASR
Jaeyun Song, Hajin Shim, Eunho Yang
Despite the feature of real-time decoding, Monotonic Multihead Attention (MMA) shows comparable performance to the state-of-the-art offline methods in machine translation and autom…