activity
20242026
most citedPhi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs

7 citations · 7 across the 13 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

eess.AS2024

AlignFormer: Modality Matching Can Achieve Better Zero-shot Instruction-Following Speech-LLM

Ruchao Fan, Bo Ren, Yuxuan Hu +3

Integrating speech into LLM (speech-LLM) has gaining increased attention recently. The mainstream solution is to connect a well-trained speech encoder and LLM with a neural adapter…

cs.CL2024

CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation

Rui Zhao, Jinyu Li, Ruchao Fan +1

Models for streaming speech translation (ST) can achieve high accuracy and low latency if they're developed with vast amounts of paired audio in the source language and written tex…