EM-Network: Oracle Guided Self-distillation for Sequence Learning

Ji Won Yoon, Sunghwan Ahn, Hyeonseung Lee +3

We introduce EM-Network, a novel self-distillation approach that effectively leverages target information for supervised sequence-to-sequence (seq2seq) learning. In contrast to con…