Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
FastEagle: Cascaded Drafting for Accelerating Speculative Decoding
Haiduo Huang, Jiangcheng Song, Wenzhe Zhao +1
Speculative decoding accelerates generation by drafting candidates and verifying them in parallel, yet state-of-the-art drafters (e.g., EAGLE) still require N sequential passes to…
cs.LG2025
NMS: Efficient Edge DNN Training via Near-Memory Sampling on Manifolds
Boran Zhao, Haiduo Huang, Qiwei Dang +3
Training deep neural networks (DNNs) on edge devices has attracted increasing attention due to its potential to address challenges related to domain adaptation and privacy preserva…