3 papers
cs.CV2026
DAIT: Distillation from Vision-Language Models to Lightweight Classifiers with Adaptive Intermediate Teacher Transfer
Zhengxu He, Jun Li, Zhijian Wu
Large-scale Vision-Language Models (VLMs) encode rich multimodal semantics that are highly beneficial for fine-grained visual categorization (FGVC). However, their prohibitive comp…
cs.CL2025
LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model
Wei Shao, Lingchao Zheng, Pengyu Wang +3
Long context inference scenarios have become increasingly important for large language models, yet they introduce significant computational latency. While prior research has optimi…
cs.LG2025
AMLA: MUL by ADD in FlashAttention Rescaling
Qichen Liao, Chengqiu Hu, Fangzheng Miao +8
Multi-head Latent Attention (MLA) significantly reduces KVCache memory usage in Large Language Models while introducing substantial computational overhead and intermediate variable…