8 citations · 22 across the 16 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Distance-KV: Exploiting Relative Distance for Efficient Long-Context Inference
Xianpeng Shang, Canbin Huang, Jiang Li +4
The memory usage and decoding latency of LLM inference grow rapidly with context length. To reduce these costs, key-value (KV) cache compression methods selectively retain cached s…
cs.LG2025
Mutual-Taught for Co-adapting Policy and Reward Models
Tianyuan Shi, Canbin Huang, Fanqi Wan +5
During the preference optimization of large language models (LLMs), distribution shifts may arise between newly generated model samples and the data used to train the reward model…