activity
20242026
most citedClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.LG2026

StreamKL: Fast and Memory-Efficient KL Divergence for Boosting Attention Distillation

Guangda Liu, Yiquan Wang, Chengwei Li +6

Attention distillation, which trains one attention distribution to match another by minimizing their Kullback-Leibler (KL) divergence, is widely used in knowledge distillation, mod…