Critical Percolation as a Synthetic Data Model for Interpretability

Aryeh Brill, Tom Ingebretsen Carlson

Neural networks learn features that reflect the hierarchical, multi-scale structure of natural data. Synthetic datasets used to evaluate interpretability methods typically lack thi…