4 papers · 1 filter
Koa-decision: Fast and Consistent Structured Decision Making with Generative LLMs
Shenghong Dai, Shiva Kumar Pentyala, Yingchi Liu +6
Industry applications often demand low-latency classification, yet current large language model (LLM) approaches remain poorly suited for latency-critical applications. Existing pr…
Statistical Convergence of Transformer Encoder-Accelerated Robust Reinforcement Learning
Suman Banerjee, Hiroyasu Tsukamoto
Obtaining the optimal action-value function in Markov decision processes is computationally intensive in large state--action spaces. In this study, we present statistically rigorou…
NPUsper: Eliminating Redundant Computation for Real-Time Whisper on Mobile NPUs
Sihyeon Lee, Hojeong Lee, Sungwon Woo +3
We present NPUsper, a live transcription system that makes Whisper efficient on mobile NPUs by eliminating redundant computation. To avoid the heavy padding used by prior streaming…
Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoning
Yilong Li, Suman Banerjee, Tong Che
Repeated sampling with a verifier is the standard way to allocate test-time compute for code generation, with pass@ as the canonical metric. Yet the standard policy class draws…