Toy Combinatorial Interpretability Models Reveal Lottery Tickets in Early Feature Space

Alon Bebchuk, Nir Shavit

The lottery ticket hypothesis posits that dense networks contain sparse subnetworks, ``winning tickets,'' that, when rewound to their initial weights and retrained in isolation, ma…