3 papers
cs.AI2026
Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?
Minhao Fan, Yinyi Liu, Jiayu Zhao +3
Small vision-language models may be able to read external evidence yet struggle to obtain it. We introduce Harness Compilation (HC), an offline procedure that adapts the division o…
cs.LG2026
SlimKV: Joint Token-Feature KV Cache Compression with Reconstruction-Free Beacon Attention
Zihan Teng, Jiayu Zhao, Wentao Ren +4
Long-context LLM serving is increasingly bottlenecked by KV-cache memory, especially in resource-constrained scenarios. Among existing KV-cache compression strategies, token-wise m…
cs.LG2026
BitsMoE: Cost-Aware Bit Allocation in Spectral Space for MoE LLM Quantization
Jiayu Zhao, Zihan Teng, Minhao Fan +4
Mixture-of-Experts (MoE) large language models incur substantial memory costs due to their large expert parameter counts. Mixed-precision quantization reduces these costs by alloca…