Masked Matrix Multiplication for Emergent Sparsity

Brian Wheatman, Meghana Madhyastha, Randal Burns

Artificial intelligence workloads, especially transformer models, exhibit emergent sparsity in which computations perform selective sparse access to dense data. The workloads are i…