1 citations · 1 across the 7 of their papers we have counts for
9 papers
TSS: Target-Side Sparsification for Speculative Decoding in Domain-Specific Large Language Models
Haibo Hu, Lianming Huang, Qiao Li +2
Speculative decoding accelerates large language model inference through collaboration between a lightweight draft model and a target verifier. Existing methods mainly improve the d…
Efficient Block-Layer Parallel Inference for Vision-Language-Action on Hybrid Architectures
Haibo HU, Lianming Huang, Qiao Li +2
Vision-Language-Action (VLA) models are becoming a promising paradigm for autonomous driving, but their deployment on existing vehicle platforms remains difficult because they intr…
DeeAD: Dynamic Early Exit of Vision-Language Action for Efficient Autonomous Driving
Haibo HU, Lianming Huang, Nan Guan +1
Vision-Language Action (VLA) models unify perception, reasoning, and trajectory generation for autonomous driving, but suffer from significant inference latency due to deep transfo…
On-Demand Multi-Task Sparsity for Efficient Large-Model Deployment on Edge Devices
Lianming Huang, Haibo Hu, Qiao Li +2
Sparsity is essential for deploying large models on resource constrained edge platforms. However, optimizing sparsity patterns for individual tasks in isolation ignores the signifi…
Nav-EE: Navigation-Guided Early Exiting for Efficient Vision-Language Models in Autonomous Driving
Haibo Hu, Lianming Huang, Xinyu Wang +4
Vision-Language Models (VLMs) are increasingly applied in autonomous driving for unified perception and reasoning, but high inference latency hinders real-time deployment. Early-ex…
GM-Skip: Metric-Guided Transformer Block Skipping for Efficient Vision-Language Models
Lianming Huang, Haibo Hu, Qiao Li +3
Transformer-based Vision-Language Models (VLMs) have achieved impressive performance on tasks such as image captioning, object recognition, and visual reasoning, but their high com…
AD-EE: Early Exiting for Fast and Reliable Vision-Language Models in Autonomous Driving
Lianming Huang, Haibo Hu, Yufei Cui +4
With the rapid advancement of autonomous driving, deploying Vision-Language Models (VLMs) to enhance perception and decision-making has become increasingly common. However, the rea…
Retrieval-Augmented Generation for Natural Language Processing: A Survey
Shangyu Wu, Ying Xiong, Yufei Cui +8
Large language models (LLMs) have achieved strong empirical performance in various fields, benefiting from their huge amount of parameters that store knowledge. However, LLMs still…
RAEE: A Robust Retrieval-Augmented Early Exit Framework for Efficient Inference
Lianming Huang, Shangyu Wu, Yufei Cui +6
Deploying large language model inference remains challenging due to their high computational overhead. Early exit optimizes model inference by adaptively reducing the number of inf…