2 papers
cs.LG2026
StreamKL: Fast and Memory-Efficient KL Divergence for Boosting Attention Distillation
Guangda Liu, Yiquan Wang, Chengwei Li +6
Attention distillation, which trains one attention distribution to match another by minimizing their Kullback-Leibler (KL) divergence, is widely used in knowledge distillation, mod…
cs.AR2026
CODO: An Automated Compiler for Comprehensive Dataflow Optimization
Weichuang Zhang, Yiquan Wang, Xinzhou Zhang +6
FPGAs are well-suited for dataflow architectures that process data in a streaming or pipelined manner, thus satisfying the high computational and communication demands of emerging…