Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
Bruce Changlong Xu, Adarsh Kumarappan, Mu Zhou
Key-value (KV) cache quantization is widely used to reduce Large Language Model (LLM) inference memory, yet existing evaluations solely focus on measuring perplexity and accuracy w…
cs.LG2026
Behavioral Consistency in Machine Learning
Bruce Changlong Xu, Lan Wu
A trained model is usually described by its weights, as if the weights fixed its behavior. In practice the same weights are run by different programs. Training uses high-precision…
cs.LG2026
Activation Sensitivity as a Unifying Principle for Post-Training Quantization
Bruce Changlong Xu
Post-training quantization (PTQ) methods for large language models compress pretrained weights to low bit-widths without retraining by optimizing layer-local proxy objectives. Acti…