Exploring Biologically Inspired Mechanisms of Adversarial Robustness

Abstract

Backpropagation-optimized artificial neural networks, while precise, lack robustness, leading to unforeseen behaviors that affect their safety. Biological neural systems do solve some of these issues already. Unlike artificial models, biological neurons adjust connectivity based on neighboring cell activity. Understanding the biological mechanisms of robustness can pave the way towards building trust worthy and safe systems. Robustness in neural representations is hypothesized to correlate with the smoothness of the encoding manifold. Recent work suggests power law covariance spectra, which were observed studying the primary visual cortex of mice, to be indicative of a balanced trade-off between accuracy and robustness in representations. Here, we show that unsupervised local learning models with winner takes all dynamics learn such power law representations, providing upcoming studies a mechanistic model with that characteristic. Our research aims to understand the interplay between geometry, spectral properties, robustness, and expressivity in neural representations. Hence, we study the link between representation smoothness and spectrum by using weight, Jacobian and spectral regularization while assessing performance and adversarial robustness. Our work serves as a foundation for future research into the mechanisms underlying power law spectra and optimally smooth encodings in both biological and artificial systems. The insights gained may elucidate the mechanisms that realize robust neural networks in mammalian brains and inform the development of more stable and reliable artificial systems.

References in corpus (7)

• On instabilities of deep learning in image reconstruction - Does AI come at a cost?
• Generalisation in humans and deep neural networks
• Unsupervised Learning by Competing Hidden Units
• The Geometry of Deep Generative Image Models and its Applications
• Adversarially trained neural representations may already be as robust as corresponding biological neural representations
• Local Unsupervised Learning for Image Analysis
• How does training shape the Riemannian geometry of neural network representations?