13 papers
GeGS-PCR: Effective and Robust 3D Point Cloud Registration with Two-Stage Color-Enhanced Geometric-3DGS Fusion
Jiayi Tian, Haiduo Huang, Tian Xia +2
We address the challenge of point cloud registration using color information, where traditional methods relying solely on geometric features often struggle in low-overlap and incom…
SelecTKD: Selective Token-Weighted Knowledge Distillation for LLMs
Haiduo Huang, Jiangcheng Song, Yadong Zhang +1
Knowledge distillation (KD) is a standard route to compress Large Language Models (LLMs) into compact students, yet most pipelines uniformly apply token-wise loss regardless of tea…
KernelDNA: Dynamic Kernel Sharing via Decoupled Naive Adapters
Haiduo Huang, Yadong Zhang, Yinghui Xu +1
Dynamic convolution enhances model capacity by adaptively combining multiple kernels, yet faces critical trade-offs: prior works either (1) incur significant parameter overhead by…
FastEagle: Cascaded Drafting for Accelerating Speculative Decoding
Haiduo Huang, Jiangcheng Song, Wenzhe Zhao +1
Speculative decoding accelerates generation by drafting candidates and verifying them in parallel, yet state-of-the-art drafters (e.g., EAGLE) still require N sequential passes to…
SpecVLM: Fast Speculative Decoding in Vision-Language Models
Haiduo Huang, Fuwei Yang, Zhenhua Liu +4
Speculative decoding is a powerful way to accelerate autoregressive large language models (LLMs), but directly porting it to vision-language models (VLMs) faces unique systems cons…
NMS: Efficient Edge DNN Training via Near-Memory Sampling on Manifolds
Boran Zhao, Haiduo Huang, Qiwei Dang +3
Training deep neural networks (DNNs) on edge devices has attracted increasing attention due to its potential to address challenges related to domain adaptation and privacy preserva…