7 papers
On the Infinite Width and Depth Limits of Predictive Coding Networks
Francesco Innocenti, El Mehdi Achour, Rafal Bogacz
Predictive coding (PC) is a biologically plausible alternative to standard backpropagation (BP) that minimises an energy function with respect to network activities before updating…
Normative Networks for Source Separation via Local Plasticity and Dendritic Computation
Bariscan Bozkurt, Efe Ali Gorguner, Francesco Innocenti +1
Blind source separation (BSS) is a natural framework for studying how latent causes may be recovered from sensory mixtures, but deriving online and biologically plausible algorithm…
A Simple Generalisation of the Implicit Dynamics of In-Context Learning
Francesco Innocenti, El Mehdi Achour
In-context learning (ICL) refers to the ability of a model to learn new tasks from examples in its input without any parameter updates. In contrast to previous theories of ICL rely…
PC: Scaling Predictive Coding to 100+ Layer Networks
Francesco Innocenti, El Mehdi Achour, Christopher L. Buckley
The biological implausibility of backpropagation (BP) has motivated many alternative, brain-inspired algorithms that attempt to rely only on local information, such as predictive c…
Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice
Francesco Innocenti
Backpropagation (BP) is the standard algorithm for training the deep neural networks that power modern artificial intelligence including large language models. However, BP is energ…
JPC: Flexible Inference for Predictive Coding Networks in JAX
Francesco Innocenti, Paul Kinghorn, Will Yun-Farmbrough +3
We introduce JPC, a JAX library for training neural networks with Predictive Coding. JPC provides a simple, fast and flexible interface to train a variety of PC networks (PCNs) inc…