11 papers
Koa-decision: Fast and Consistent Structured Decision Making with Generative LLMs
Shenghong Dai, Shiva Kumar Pentyala, Yingchi Liu +6
Industry applications often demand low-latency classification, yet current large language model (LLM) approaches remain poorly suited for latency-critical applications. Existing pr…
Statistical Convergence of Transformer Encoder-Accelerated Robust Reinforcement Learning
Suman Banerjee, Hiroyasu Tsukamoto
Obtaining the optimal action-value function in Markov decision processes is computationally intensive in large state--action spaces. In this study, we present statistically rigorou…
NPUsper: Eliminating Redundant Computation for Real-Time Whisper on Mobile NPUs
Sihyeon Lee, Hojeong Lee, Sungwon Woo +3
We present NPUsper, a live transcription system that makes Whisper efficient on mobile NPUs by eliminating redundant computation. To avoid the heavy padding used by prior streaming…
Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoning
Yilong Li, Suman Banerjee, Tong Che
Repeated sampling with a verifier is the standard way to allocate test-time compute for code generation, with pass@ as the canonical metric. Yet the standard policy class draws…
Tiny but Mighty: A Software-Hardware Co-Design Approach for Efficient Multimodal Inference on Battery-Powered Small Devices
Yilong Li, Shuai Zhang, Yijing Zeng +5
Large Multimodal Models (LMMs) are inherently modular, comprising vision and audio encoders, a projector, and a language backbone. Yet existing systems execute them monolithically,…
AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection
Weidi Luo, Shenghong Dai, Xiaogeng Liu +4
The rapid advancements in Large Language Models (LLMs) have enabled their deployment as autonomous agents for handling complex tasks in dynamic environments. These LLMs demonstrate…
PalmBench: A Comprehensive Benchmark of Compressed Large Language Models on Mobile Platforms
Yilong Li, Jingyu Liu, Hao Zhang +7
Deploying large language models (LLMs) locally on mobile devices is advantageous in scenarios where transmitting data to remote cloud servers is either undesirable due to privacy c…
Buffer-based Gradient Projection for Continual Federated Learning
Shenghong Dai, Jy-yong Sohn, Yicong Chen +5
Continual Federated Learning (CFL) is essential for enabling real-world applications where multiple decentralized clients adaptively learn from continuous data streams. A significa…
Babel: A Scalable Pre-trained Model for Multi-Modal Sensing via Expandable Modality Alignment
Shenghong Dai, Shiqi Jiang, Yifan Yang +4
This paper presents Babel, the expandable modality alignment model, specially designed for multi-modal sensing. While there has been considerable work on multi-modality alignment,…
Gemini: Integrating Full-fledged Sensing upon Millimeter Wave Communications
Yilong Li, Zhe Chen, Jun Luo +1
Integrating millimeter wave (mmWave)technology in both communication and sensing is promising as it enables the reuse of existing spectrum and infrastructure without draining resou…
MEDUSA: Scalable Biometric Sensing in the Wild through Distributed MIMO Radars
Yilong Li, Ramanujan K Sheshadri, Karthik Sundaresan +2
Radar-based techniques for detecting vital signs have shown promise for continuous contactless vital sign sensing and healthcare applications. However, real-world indoor environmen…