7 papers · 1 filter
Acoustic-to-Text KV Compression for Full-Duplex Speech Models
Yejin Lee, Seungbeom Kim, Yongha Lee +1
Full-duplex speech language models continuously accumulate acoustic key-value (KV) states, making long-running interactions memory-intensive. During listening, the model can finish…
Beyond Binary Instrument QA: Probing Instrument Grounding in Music Audio-Language Models
Yujun Lee, Joonhyeok Shin, Hyoeun Kim +1
Recent music audio-language models achieve high accuracy on instrument question-answering benchmarks, but it remains unclear whether this reflects robust audio grounding or benchma…
TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech
Yejin Lee, Junwon Moon, Hyoeun Kim +3
Codec-based autoregressive (AR) speech language models have achieved strong text-to-speech (TTS) quality by modeling speech as sequences of discrete audio tokens with large pretrai…
GLASS: GRPO-Trained LoRA for Acoustic Style Steering in Zero-Shot Text-to-Speech
Jaehoon Kang, Yejin Lee, Kyuhong Shim
We propose GLASS, a framework for composable acoustic style control in zero-shot autoregressive text-to-speech (TTS) that learns controls from post-generation rewards rather than s…
Mask2Flow-TSE: Two-Stage Target Speaker Extraction with Masking and Flow Matching
Junwon Moon, Seungbeom Kim, Hansol Park +4
Target speaker extraction (TSE) extracts the target speaker's voice from overlapping speech given a reference utterance. Existing masking-based approaches are lightweight and effec…
Whisper-CD: Accurate Long-Form Speech Recognition using Multi-Negative Contrastive Decoding
Hoseong Ahn, Jeongyun Chae, Yoonji Park +1
Long-form speech recognition with large encoder-decoder models such as Whisper often exhibit hallucinations, repetition loops, and content omissions. These errors can accumulate an…
Evaluating Hallucinations in Audio-Visual Multimodal LLMs with Spoken Queries under Diverse Acoustic Conditions
Hansol Park, Hoseong Ahn, Junwon Moon +2
Hallucinations in multimodal models have been extensively studied using benchmarks that probe reliability in image-text query settings. However, the effect of spoken queries on mul…