Multichannel Orthogonal Transform-Based Perceptron Layers for Efficient ResNets

Hongyi Pan, Emadeldeen Hamdan, Xin Zhu +2

In this paper, we propose a set of transform-based neural network layers as an alternative to the $3\times 3$ Conv2D layers in Convolutional Neural Networks (CNNs). The proposed lay…