Brownian Heads for Deep ReLU Representations: Activation Mass and the Cost of Same-Sample Selection

Mahdi Mohammadigohari, Nicole Mücke

Deep representation learning often selects hidden features and fits the final predictor on the same sample, so fixed-feature analysis performed after selection can omit selection c…