25 citations · 38 across the 11 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
EM-Network: Oracle Guided Self-distillation for Sequence Learning
Ji Won Yoon, Sunghwan Ahn, Hyeonseung Lee +3
We introduce EM-Network, a novel self-distillation approach that effectively leverages target information for supervised sequence-to-sequence (seq2seq) learning. In contrast to con…
cs.LG2021★ 2 cited
Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models
Ji Won Yoon, Hyung Yong Kim, Hyeonseung Lee +2
Knowledge distillation (KD), best known as an effective method for model compression, aims at transferring the knowledge of a bigger network (teacher) to a much smaller network (st…