AdjointBackMapV2: Precise Reconstruction of Arbitrary CNN Unit's Activation via Adjoint Operators

Abstract

Adjoint operators have been found to be effective in the exploration of CNN's inner workings [1]. However, the previous no-bias assumption restricted its generalization. We overcome the restriction via embedding input images into an extended normed space that includes bias in all CNN layers as part of the extended space and propose an adjoint-operator-based algorithm that maps high-level weights back to the extended input space for reconstructing an effective hypersurface. Such hypersurface can be computed for an arbitrary unit in the CNN, and we prove that this reconstructed hypersurface, when multiplied by the original input (through an inner product), will precisely replicate the output value of each unit. We show experimental results based on the CIFAR-10 and CIFAR-100 data sets where the proposed approach achieves near 0 activation value reconstruction error.

This is a preprint prior to peer-review. For the revised/finalized version, please see https://doi.org/10.1016/j.neunet.2023.11.009

References in corpus (12)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Striving for Simplicity: The All Convolutional Net
• Neural Tangent Kernel: Convergence and Generalization in Neural Networks
• Understanding Black-box Predictions via Influence Functions
• cuDNN: Efficient Primitives for Deep Learning
• How to Explain Individual Classification Decisions
• Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models
• Explanations can be manipulated and geometry is to blame
• Fooling Neural Network Interpretations via Adversarial Model Manipulation
• Fixup Initialization: Residual Learning Without Normalization
• DCFNet: Deep Neural Network with Decomposed Convolutional Filters
• Interpreting the Predictions of Complex ML Models by Layer-wise Relevance Propagation