activity
20232026
most citedCHAI: Clustered Head Attention for Efficient LLM Inference

2 citations · 3 across the 10 of their papers we have counts for

collaborators

10 papers

eess.AS2026

DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech

Junwon Moon, Yejin Lee, Seungbeom Kim +4

Autoregressive (AR) text-to-speech (TTS) models generate discrete speech tokens sequentially, which makes inference slow and can degrade robustness, since local errors propagate to…

cs.SD2026

TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech

Yejin Lee, Junwon Moon, Hyoeun Kim +3

Codec-based autoregressive (AR) speech language models have achieved strong text-to-speech (TTS) quality by modeling speech as sequences of discrete audio tokens with large pretrai…

cs.SD2026

GLASS: GRPO-Trained LoRA for Acoustic Style Steering in Zero-Shot Text-to-Speech

Jaehoon Kang, Yejin Lee, Kyuhong Shim

We propose GLASS, a framework for composable acoustic style control in zero-shot autoregressive text-to-speech (TTS) that learns controls from post-generation rewards rather than s…

cs.CL2026

Unlocking Fine-Grained and Within-Utterance Speaking Style Control in Prompt-Based Text-to-Speech Models

Jaehoon Kang, Yejin Lee, Yoonji Park +1

While prompt-based text-to-speech (TTS) models enable natural language-driven speaking style control, they often provide limited fine-grained control and apply a single global styl…

cs.AI2026

DialBGM: A Benchmark for Background Music Recommendation from Everyday Multi-Turn Dialogues

Joonhyeok Shin, Jaehoon Kang, Yujun Lee +4

Selecting an appropriate background music (BGM) that supports natural human conversation is a common production step in media and interactive systems. In this paper, we introduce d…

cs.CL2025

Efficient Speculative Decoding for Llama at Scale: Challenges and Solutions

Bangsheng Tang, Carl Chengyan Fu, Fei Kou +35

Speculative decoding is a standard method for accelerating the inference speed of large language models. However, scaling it for production environments poses several engineering c…

cs.LG2024

Characterizing and Efficiently Accelerating Multimodal Generation Model Inference

Yejin Lee, Anna Sun, Basil Hosmer +27

Generative artificial intelligence (AI) technology is revolutionizing the computing industry. Not only its applications have broadened to various sectors but also poses new system…

cs.LG2024

Is Flash Attention Stable?

Alicia Golden, Samuel Hsia, Fei Sun +8

Training large-scale machine learning models poses distinct system challenges, given both the size and complexity of today's workloads. Recently, many organizations training state-…

cs.LG2024★ 2 cited

CHAI: Clustered Head Attention for Efficient LLM Inference

Saurabh Agarwal, Bilge Acun, Basil Hosmer +5

Large Language Models (LLMs) with hundreds of billions of parameters have transformed the field of machine learning. However, serving these models at inference time is both compute…

cs.DC2023★ 1 cited

Generative AI Beyond LLMs: System Implications of Multi-Modal Generation

Alicia Golden, Samuel Hsia, Fei Sun +8

As the development of large-scale Generative AI models evolve beyond text (1D) generation to include image (2D) and video (3D) generation, processing spatial and temporal informati…