Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
PQ-HSA: Reusing Product-Quantized Scores for Hybrid Sparse-Approximate Attention
Kunming Shao, Jierun Chen, Yanli Wang +4
At each decoding step a language model attends over the key-value (KV) cache of every earlier token, so at long context the attention call is bounded by memory bandwidth. Sparse at…
cs.LG2024
Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning
Xiaoyu Gan, Jingbo Jiang, Jingyang Zhu +3
Substantial efforts have been devoted to alleviating the impact of the long-tailed class distribution in federated learning. In this work, we observe an interesting phenomenon that…