25 citations · 38 across the 11 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
EM-Network: Oracle Guided Self-distillation for Sequence Learning
Ji Won Yoon, Sunghwan Ahn, Hyeonseung Lee +3
We introduce EM-Network, a novel self-distillation approach that effectively leverages target information for supervised sequence-to-sequence (seq2seq) learning. In contrast to con…
eess.AS2023
MCR-Data2vec 2.0: Improving Self-supervised Speech Pre-training via Model-level Consistency Regularization
Ji Won Yoon, Seok Min Kim, Nam Soo Kim
Self-supervised learning (SSL) has shown significant progress in speech processing tasks. However, despite the intrinsic randomness in the Transformer structure, such as dropout va…