Orthogonal Transforms in Neural Networks Amount to Effective Regularization

Krzysztof Zając, Wojciech Sopot, Paweł Wachel

We consider applications of neural networks in nonlinear system identification and formulate a hypothesis that adjusting general network structure by incorporating frequency inform…