Showing 2024Show all
2 papers · 1 filter
cs.CL2024
Interventional Speech Noise Injection for ASR Generalizable Spoken Language Understanding
Yeonjoon Jung, Jaeseong Lee, Seungtaek Choi +3
Recently, pre-trained language models (PLMs) have been increasingly adopted in spoken language understanding (SLU). However, automatic speech recognition (ASR) systems frequently p…
cs.LG2024
STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning
Jaeseong Lee, seung-won hwang, Aurick Qiao +3
Mixture-of-experts (MoEs) have been adopted for reducing inference costs by sparsely activating experts in Large language models (LLMs). Despite this reduction, the massive number…