Routing the Lottery: Adaptive Subnetworks for Heterogeneous Data

Grzegorz Stefanski, Alberto Presta, Michal Byra

In pruning, the Lottery Ticket Hypothesis posits that large networks contain sparse subnetworks, or winning tickets, that can be trained in isolation to match the performance of th…