6 papers
Alignment Drift in Single-Model Speculative Decoding for ASR: Mechanism, Correction, and Cost
Xinyu Wang, Huapeng Zhou, Ziyu Zhao +5
Speculative decoding speeds up generation by letting a cheap draft propose several tokens that a target model checks in one pass. In the single-model form, the draft is a lightweig…
SafeRx-Agent: A Knowledge-Grounded Multi-Agent Framework for Safe and Explainable Medication Recommendation
Xinyu Wang, Hanwei Wu, Zhenghan Tai +7
Medication recommendation predicts medications for patient visits, but existing methods still face two key challenges. At the model level, traditional drug recommendation methods o…
TARQ: Tail-Aware Reconstruction Quantization for Rare-Word Robust Automatic Speech Recognition
Xinyu Wang, Ziyu Zhao, Ke Bai +4
Data-aware post-training quantization (PTQ) minimizes a per-token reconstruction loss on a small calibration corpus, implicitly weighting positions by their empirical frequency. Fo…
HoloQ-VLA: Uniform W4A4 Quantization of Vision-Language-Action Models
Xinyu Wang, Mingze Li, Sicheng Lyu +6
Vision-Language-Action (VLA) models unify perception, reasoning, and control in a single policy, but their multi-billion-parameter backbones and diffusion-based action heads make o…
OJBKQ: Objective-Joint Babai-Klein Quantization
Xinyu Wang, Ziyu Zhao, Peng Lu +2
Post-training quantization (PTQ) is widely used to compress large language models without retraining. However, many existing weight-only methods rely on heuristic objectives and gr…
Diagnostic-Driven Layer-Wise Compensation for Post-Training Quantization of Encoder-Decoder ASR Models
Xinyu Wang, Ziyu Zhao, Yajie Luo +6
Layer-wise post-training quantization reconstructs each layer from inputs already altered by the quantized prefix. QEP compensates for this drift with one model-wide coefficient, c…