Structured vs. Unstructured Pruning: An Exponential Gap

Davide Ferre', Frédéric Giroire, Frederik Mallmann-Trenn +1

The Strong Lottery Ticket Hypothesis (SLTH) states that large, randomly initialized neural networks contain sparse subnetworks capable of approximating a target function at initial…