Showing 2026Show all
3 papers · 1 filter
cs.LG2026
LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference
Renyuan Liu, Yuyang Leng, Kaiyan Liu +7
On-device LLM inference is attractive for privacy and responsiveness, but remains challenging on mobile and embedded devices because model weights far exceed available DRAM. Prior…
cs.RO2026
On Exploring Input Resolution Scaling For Anytime LiDAR Object Detection
Ahmet Soyyigit, Shuochao Yao, Heechul Yun
Making tradeoffs between execution latency and result utility (i.e., anytime computing) for adapting to dynamic operational requirements has been shown to enhance the performance o…
cs.RO2026
Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving
Qitao Weng, Heechul Yun
Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends…