Adapting Whisper for Code-Switching through Encoding Refining and Language-Aware Decoding

Jiahui Zhao, Hao Shi, Chenrui Cui +5

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. A…