35 citations · 140 across the 13 of their papers we have counts for
13 papers
Associative Memories in the Feature Space
Tommaso Salvatori, Beren Millidge, Yuhang Song +2
An autoassociative memory model is a function that, given a set of data points, takes as input an arbitrary vector and outputs the most similar data point from the memorized set. H…
Sequential Memory with Temporal Predictive Coding
Mufeng Tang, Helen Barron, Rafal Bogacz
Forming accurate memory of sequential stimuli is a fundamental function of biological agents. However, the computational mechanism underlying sequential memory in the brain remains…
A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks
Tommaso Salvatori, Yuhang Song, Yordan Yordanov +6
Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. Training such models, however, is quite inefficient and unstabl…
A Theoretical Framework for Inference and Learning in Predictive Coding Networks
Beren Millidge, Yuhang Song, Tommaso Salvatori +2
Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process o…
Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning
Beren Millidge, Yuhang Song, Tommaso Salvatori +2
How the brain performs credit assignment is a fundamental unsolved problem in neuroscience. Many `biologically plausible' algorithms have been proposed, which compute gradients tha…
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
Beren Millidge, Tommaso Salvatori, Yuhang Song +2
The backpropagation of error algorithm used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backward updates a…
Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models
Beren Millidge, Tommaso Salvatori, Yuhang Song +2
A large number of neural network models of associative memory have been proposed in the literature. These include the classical Hopfield networks (HNs), sparse distributed memories…
Learning on Arbitrary Graph Topologies via Predictive Coding
Tommaso Salvatori, Luca Pinchetti, Beren Millidge +4
Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagate…
Associative Memories via Predictive Coding
Tommaso Salvatori, Yuhang Song, Yujian Hong +5
Associative memories in the brain receive and store patterns of activity registered by the sensory neurons, and are able to retrieve them when necessary. Due to their importance in…
Embedding digital chronotherapy into medical devices -- A canine validation for controlling status epilepticus through multi-scale rhythmic brain stimulation
Mayela Zamora, Sebastian Meller, Filip Kajin +10
Circadian and other physiological rhythms play a key role in both normal homeostasis and disease processes. Such is the case of circadian and infradian seizure patterns observed in…
Predictive Coding Can Do Exact Backpropagation on Convolutional and Recurrent Neural Networks
Tommaso Salvatori, Yuhang Song, Thomas Lukasiewicz +2
Predictive coding networks (PCNs) are an influential model for information processing in the brain. They have appealing theoretical interpretations and offer a single mechanism tha…
Reverse Differentiation via Predictive Coding
Tommaso Salvatori, Yuhang Song, Thomas Lukasiewicz +2
Deep learning has redefined the field of artificial intelligence (AI) thanks to the rise of artificial neural networks, which are architectures inspired by their neurological count…
Cross-Frequency Coupling of Neuronal Oscillations During Cognition
Thomas E. Gorochowski, Rafal Bogacz, Matthew Jones
How the brain co-ordinates the actions of distant regions in an efficient manner is an open problem. Many believe that cross-frequency coupling between the amplitude of high freque…