Masked Pre-trained Encoder base on Joint CTC-Transformer

Lu Liu, Yiheng Huang

This study (The work was accomplished during the internship in Tencent AI lab) addresses semi-supervised acoustic modeling, i.e. attaining high-level representations from unsupervi…