Convolutional layers are equivariant to discrete shifts but not continuous translations

Nick McGreivy, Ammar Hakim

The purpose of this short and simple note is to clarify a common misconception about convolutional neural networks (CNNs). CNNs are made up of convolutional layers which are shift…