On Privileged and Convergent Bases in Neural Network Representations

Davis Brown, Nikhil Vyas, Yamini Bansal

In this study, we investigate whether the representations learned by neural networks possess a privileged and convergent basis. Specifically, we examine the significance of feature…