activity
20242026
most citedDeSTA2: Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data

15 citations · 53 across the 43 of their papers we have counts for

collaborators
Showing 2026Show all

16 papers · 1 filter

cs.AI2026

Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents

Yi-Cheng Lin, Yu-Kai Guo, Szu-Chi Chen +15

AI agents can now solve problems, answer like subject experts, and generate long-form multimodal content. However, whether they can adapt a lesson to fit a specified learner, which…

cs.HC2026

EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibration

Jia-Kai Dong, Yi-Cheng Lin, Hung-yi Lee

Teaching videos are becoming a major medium for education, creating a growing need for scalable evaluation of their pedagogical quality. Existing automatic judges do not fully addr…

cs.CL2026

REDDIT: Forgetting-Resistant Correction of Timestamp Drift in ASR via Replay-Based Distribution Editing

Cheng-Kang Chou, Ming-To Chuang, Ke-Han Lu +2

Modern autoregressive ASR systems can emit timestamps as decoded tokens, enabling timestamped transcription without frame-level aligners or inference-time post-processing. We show…

cs.SD2026

BlueMagpie-TTS: A Token-Efficient Tokenizer, Language Model, and TTS for Taiwanese-Accent Code-Switching Speech

Ho Lam Chung, Bo-Xuan Zheng, Cheng-Chieh Huang +8

Off-the-shelf TTS systems are poorly adapted to Taiwanese Mandarin. Their accent defaults to other Mandarin variants, their tokenizers over-segment common Taiwanese text, and their…

cs.SD2026

Listen, Think, Transcribe: Continuous Latent Test-Time Scaling for ASR

Ho Lam Chung, Yiming Chen, Dau-Cheng Lyu +2

End-to-end ASR models transcribe in a single pass, leaving no room for the decoder to revisit hard inputs. We propose LatentASR, a parameter-efficient method that adds continuous l…

eess.AS2026

CAAD: Contrastive Audio-Aware Distillation for Efficient Speech Language Models

Chun-Wei Chen, Tzu-Quan Lin, Ke-Han Lu +2

Speech Language Models achieve reasoning capabilities, but are often hindered by massive parameter counts and a tendency to prioritize linguistic priors over acoustic features. Whi…

cs.CL2026

Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAG

Wei-Chieh Chou, Xuanjun Chen, Jian-Ren Lin +3

Multi-hop question answering remains challenging for Retrieval-Augmented Generation (RAG) because existing approaches either propagate errors across iterative retrieval rounds or o…

eess.AS2026

Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach

Tzu-Chieh Wei, Yi-Cheng Lin, Huang-Cheng Chou +4

As expressive text-to-speech (TTS) and voice conversion (VC) systems increasingly generate non-verbal vocalizations (NVVs) to enhance naturalness, reliable speaker verification (SV…

eess.AS2026

Toward Fair Speech Technologies: A Comprehensive Survey of Bias and Fairness in Speech AI

Yi-Cheng Lin, Yun-Shao Tsai, Kuan-Yu Chen +6

Speech technologies are deployed in high-stakes settings, yet fairness concerns remain fragmented across tasks and disciplines. Existing surveys either adopt a general machine-lear…

cs.SD2026

LLM-Codec: Neural Audio Codec Meets Language Model Objectives

Ho-Lam Chung, Yiming Chen, Hung-yi Lee

Neural audio codecs are widely used as tokenizers for spoken language models, but they are optimized for waveform reconstruction rather than autoregressive prediction. This mismatc…

cs.CL2026

MoVE: Translating Laughter and Tears via Mixture of Vocalization Experts in Speech-to-Speech Translation

Szu-Chi Chen, I-Ning Tsai, Yi-Cheng Lin +2

Recent Speech-to-Speech Translation (S2ST) systems achieve strong semantic accuracy yet consistently strip away non-verbal vocalizations (NVs), such as laughter and crying that con…

eess.AS2026

VIBE: Voice-Induced open-ended Bias Evaluation for Large Audio-Language Models via Real-World Speech

Yi-Cheng Lin, Yusuke Hirota, Sung-Feng Huang +1

Large Audio-Language Models (LALMs) are increasingly integrated into daily applications, yet their generative biases remain underexplored. Existing speech fairness benchmarks rely…

eess.SP2026

The Binding Effect: Analyzing How Multi-Dimensional Cues Form Gender Bias in Instruction TTS

Kuan-Yu Chen, Yi-Cheng Lin, Po-Chung Hsieh +5

Current bias evaluations in Instruction Text-to-Speech (ITTS) often rely on univariate testing, overlooking the compositional structure of social cues. In this work, we investigate…

cs.SD2026

Membership Inference Attacks against Large Audio Language Models

Jia-Kai Dong, Yu-Xiang Lin, Hung-Yi Lee

We present the first systematic Membership Inference Attack (MIA) evaluation of LALMs. Using Multi-modal Blind Baselines based on textual, spectral and prosodic features, we demons…

cs.SD2026

Latent-Mark: An Audio Watermark Robust to Neural Codec Compression

Yen-Shan Chen, Shih-Yu Lai, Ying-Jung Tsou +5

While existing audio watermarking techniques have achieved strong robustness against traditional digital signal processing (DSP) attacks, they remain vulnerable to neural compressi…

cs.SD2026

TW-Sound580K: A Regional Audio-Text Dataset with Verification-Guided Curation for Localized Audio-Language Modeling

Hao-Hui Xie, Ho-Lam Chung, Yi-Cheng Lin +4

Large Audio-Language Models (LALMs) typically struggle with localized dialectal prosody due to the scarcity of specialized corpora. We present TW-Sound580K, a Taiwanese audio-text…