Generalization in Representation Models via Random Matrix Theory: Application to Recurrent Networks

Yessin Moakher, Malik Tiomoko, Cosme Louart +1

We first study the generalization error of models that use a fixed feature representation (frozen intermediate layers) followed by a trainable readout layer. This setting encompass…