Fast gradient-free activation maximization for neurons in spiking neural networks

Abstract

Elements of neural networks, both biological and artificial, can be described by their selectivity for specific cognitive features. Understanding these features is important for understanding the inner workings of neural networks. For a living system, such as a neuron, whose response to a stimulus is unknown and not differentiable, the only way to reveal these features is through a feedback loop that exposes it to a large set of different stimuli. The properties of these stimuli should be varied iteratively in order to maximize the neuronal response. To utilize this feedback loop for a biological neural network, it is important to run it quickly and efficiently in order to reach the stimuli that maximizes certain neurons' activation with the least number of iterations possible. Here we present a framework with an efficient design for such a loop. We successfully tested it on an artificial spiking neural network (SNN), which is a model that simulates the asynchronous spiking activity of neurons in living brains. Our optimization method for activation maximization is based on the low-rank Tensor Train decomposition of the discrete activation function. The optimization space is the latent parameter space of images generated by SN-GAN or VQ-VAE generative models. To our knowledge, this is the first time that effective AM has been applied to SNNs. We track changes in the optimal stimuli for artificial neurons during training and show that highly selective neurons can form already in the early epochs of training and in the early layers of a convolutional spiking network. This formation of refined optimal stimuli is associated with an increase in classification accuracy. Some neurons, especially in the deeper layers, may gradually change the concepts they are selective for during learning, potentially explaining their importance for model performance.

References in corpus (25)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Auto-Encoding Variational Bayes
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• An overview of gradient descent optimization algorithms
• Spectral Normalization for Generative Adversarial Networks
• Neural Discrete Representation Learning
• Methods for Interpreting and Understanding Deep Neural Networks
• Recent Advances in Physical Reservoir Computing: A Review
• Understanding Neural Networks Through Deep Visualization
• On the Number of Linear Regions of Deep Neural Networks
• Next Generation Reservoir Computing
• Low-Rank Tensor Networks for Dimensionality Reduction and Large-Scale Optimization Problems: Perspectives and Challenges PART 1
• Understanding the Role of Individual Units in a Deep Neural Network
• Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations. Part 2 Applications and Future Perspectives
• Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks
• Representation Engineering: A Top-Down Approach to AI Transparency
• Critical Learning Periods in Deep Neural Networks
• Gradient-free activation maximization for identifying effective stimuli
• Measuring complexity with zippers
• TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning
• Uncovering the Representation of Spiking Neural Networks Trained with Surrogate Gradient
• High-performance Evolutionary Algorithms for Online Neuron Control
• Stimulus sensitivity of a spiking neural network model
• PROTES: Probabilistic Optimization with Tensor Sampling
• Optimization of Functions Given in the Tensor Train Format