2 papers
cs.LG2026
Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs
Pierre Abillama, Changwoo Lee, Juechu Dong +3
Recent advances in transformer-based foundation models have made them the default choice for many tasks, but their rapidly growing size makes fitting a full model on a single GPU i…
cs.LG2024
Flex Attention: A Programming Model for Generating Optimized Attention Kernels
Juechu Dong, Boyuan Feng, Driss Guessous +2
Over the past 7 years, attention has become one of the most important primitives in deep learning. The primary approach to optimize attention is FlashAttention, which fuses the ope…