Learning Compact Features via In-Training Representation Alignment

Xin Li, Xiangrui Li, Deng Pan +2

Deep neural networks (DNNs) for supervised learning can be viewed as a pipeline of the feature extractor (i.e., last hidden layer) and a linear classifier (i.e., output layer) that…