Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Outcome-Guided On-Policy Self-Distillation
ZheXu Wang, Mao-Lin Luo, Yankun Hong +6
On-policy self-distillation (OPSD) provides denser token-level supervision and better computational efficiency than Reinforcement Learning with Verifiable Rewards (RLVR). However,…
cs.LG2025
SVDq: 1.25-bit and 410x Key Cache Compression for LLM Attention
Hong Yankun, Li Xing, Zhen Hui-Ling +3
For the efficient inference of Large Language Models (LLMs), the effective compression of key-value (KV) cache is essential. Three main types of KV cache compression techniques, na…