The Sparsity Roofline: Understanding the Hardware Limits of Sparse Neural Networks

Cameron Shinn, Collin McCarthy, Saurav Muralidharan +2

We introduce the Sparsity Roofline, a visual performance model for evaluating sparsity in neural networks. The Sparsity Roofline jointly models network accuracy, sparsity, and theo…