12 papers
BARTER: Compact Dynamic Sparse Training with Standard Dense Kernels
Yueyuan Sui, Payal Mohapatra, Qi Zhu +1
Dynamic sparse training (DST) aims to reduce training costs while maintaining accuracy. Existing DST methods mask out parameters but keep matrix dimensions unchanged. Training spee…
Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series
Payal Mohapatra, Yueyuan Sui, Haodong Yang +3
Multimodal wearable systems must remain reliable when sensor streams become noisy or unavailable. Existing multimodal test-time adaptation (TTA) methods often assess reliability on…
Efficient Multimodal Inference through Adaptive Acquisition and Sequential Fusion
Payal Mohapatra, Haodong Yang, Yueyuan Sui +3
Multimodal systems often encode every available input, even when a subset suffices for prediction. Adaptive acquisition can reduce this cost by using predictions from incrementally…
PELM: Power Efficient On-Device LLM Inference with Speculative Decoding and Dynamic Voltage Frequency Scaling
Weisi Yang, Stephen Xia
Deploying Large Language Models (LLMs) directly on mobile platforms at the edge is gaining traction due to a myriad of benefits, such as increased privacy, personalization, and red…
Depth Exploration for LLM Decoding
Weisi Yang, Zipeng Sun, Stephen Xia
Autoregressive LLM decoding evaluates every generated token through the full layer stack, even though many tokens become predictable at intermediate depths. Existing lossless depth…
Attention Drift: What Autoregressive Speculative Decoding Models Learn
Doğaç Eldenk, Payal Mohapatra, Yigitcan Comlek +3
Speculative decoding accelerates LLM inference by drafting future tokens with a small model, but drafter models degrade sharply under template perturbation and long-context inputs.…
Modality-Aware Zero-Shot Pruning and Sparse Attention for Efficient Multimodal Edge Inference
Yueyuan Sui, Payal Mohapatra, Doğaç Eldenk +5
Edge devices increasingly run multimodal sensing pipelines that must remain accurate despite fluctuating power budgets and unpredictable sensor dropout. Existing pruning methods fa…
UNIFERENCE: A Discrete Event Simulation Framework for Developing Distributed AI Models
Doğaç Eldenk, Stephen Xia
Developing and evaluating distributed inference algorithms remains difficult due to the lack of standardized tools for modeling heterogeneous devices and networks. Existing studies…
MAESTRO : Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series
Payal Mohapatra, Yueyuan Sui, Akash Pandey +2
From clinical healthcare to daily living, continuous sensor monitoring across multiple modalities has shown great promise for real-world intelligent decision-making but also faces…
MambaLite-Micro: Memory-Optimized Mamba Inference on MCUs
Hongjun Xu, Junxi Xia, Weisi Yang +2
Deploying Mamba models on microcontrollers (MCUs) remains challenging due to limited memory, the lack of native operator support, and the absence of embedded-friendly toolchains. W…
Towards On-Device Evidence Gathering for Intimate Partner Infiltration: A Feasibility Study for Joint Identity-Action Detection
Weisi Yang, Shinan Liu, Feng Xiao +2
Intimate Partner Infiltration (IPI) refers to phone-side privacy infiltration in intimate or close relationships, often enabled by physical access to a person's smartphone and disc…
ElastiFormer: Learned Redundancy Reduction in Transformer via Self-Distillation
Junzhang Liu, Tingkai Liu, Yueyuan Sui +1
We introduce ElastiFormer, a post-training technique that adapts pretrained Transformer models into an elastic counterpart with variable inference time compute. ElastiFormer introd…