LegoSLM: Connecting LLM with Speech Encoder using CTC Posteriors

Rao Ma, Tongzhou Chen, Kartik Audhkhasi +1

Recently, large-scale pre-trained speech encoders and Large Language Models (LLMs) have been released, which show state-of-the-art performance on a range of spoken language process…