5 papers
Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs
Linhao Zhang, Yuhan Song, Aiwei Liu +6
Recent Audio Large Language Models (AudioLLMs) exhibit a striking performance inversion: while excelling at complex reasoning tasks, they consistently underperform on fine-grained…
WeDLM: Reconciling Diffusion Language Models with Standard Causal Attention for Fast Inference
Aiwei Liu, Minghua He, Shaoxun Zeng +7
Autoregressive (AR) generation is the standard decoding paradigm for Large Language Models (LLMs), but its token-by-token nature limits parallelism at inference time. Diffusion Lan…
StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMs
Yuhan Song, Linhao Zhang, Chuhan Wu +4
Prevalent semantic speech tokenizers, designed to capture linguistic content, are surprisingly fragile. We find they are not robust to meaning-irrelevant acoustic perturbations; ev…
POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion
Yuan Liu, Zhongyin Zhao, Le Tian +8
High-quality labeled data is essential for training accurate document conversion models, particularly in domains with complex formats such as tables, formulas, and multi-column tex…
WildSpeech-Bench: Benchmarking End-to-End SpeechLLMs in the Wild
Linhao Zhang, Jian Zhang, Bokai Lei +4
Recent multi-modal Large Language Models (LLMs) such as GPT-4o have demonstrated strong capabilities of direct speech interaction. However, the lack of specialized and comprehensiv…