2 papers
cs.LG2026
BAPS: A Fine-Grained Low-Precision Scheme for Softmax in Attention via Block-Aware Precision reScaling
Zisheng Ye, Xiaoyu He, Maoyuan Song +10
As the performance gains from accelerating quantized matrix multiplication plateau, the softmax operation becomes the critical bottleneck in Transformer inference. This bottleneck…
math.ST2023
Optimality in Mean Estimation: Beyond Worst-Case, Beyond Sub-Gaussian, and Beyond Moments
Trung Dang, Jasper C. H. Lee, Maoyuan Song +1
There is growing interest in improving our algorithmic understanding of fundamental statistical problems such as mean estimation, driven by the goal of understanding the limits of…