59 citations · 113 across the 7 of their papers we have counts for
7 papers
Range, not Independence, Drives Modularity in Biologically Inspired Representations
Will Dorrell, Kyle Hsu, Luke Hollingsworth +6
Why do biological and artificial neurons sometimes modularise, each encoding a single meaningful variable, and sometimes entangle their representation of many variables? In this wo…
Disentanglement with Biological Constraints: A Theory of Functional Cell Types
James C. R. Whittington, Will Dorrell, Surya Ganguli +1
Neurons in the brain are often finely tuned for specific task variables. Moreover, such disentangled representations are highly sought after in machine learning. Here we mathematic…
Actionable Neural Representations: Grid Cells from Minimal Constraints
William Dorrell, Peter E. Latham, Timothy E. J. Behrens +1
To afford flexible behaviour, the brain must build internal representations that mirror the structure of variables in the external world. For example, 2D space obeys rules: the sam…
Replay and compositional computation
Zeb Kurth-Nelson, Timothy Behrens, Greg Wayne +5
Replay in the brain has been viewed as rehearsal, or, more recently, as sampling from a transition model. Here, we propose a new hypothesis: that replay is able to implement a form…
How to build a cognitive map: insights from models of the hippocampal formation
James C. R. Whittington, David McCaffary, Jacob J. W. Bakermans +1
Learning and interpreting the structure of the environment is an innate feature of biological systems, and is integral to guiding flexible behaviours for evolutionary viability. Th…
Relating transformers to models and neural representations of the hippocampal formation
James C. R. Whittington, Joseph Warren, Timothy E. J. Behrens
Many deep neural network architectures loosely based on brain networks have recently been shown to replicate neural firing patterns observed in the brain. One of the most exciting…
Prediction and Generalisation over Directed Actions by Grid Cells
Changmin Yu, Timothy E. J. Behrens, Neil Burgess
Knowing how the effects of directed actions generalise to new situations (e.g. moving North, South, East and West, or turning left, right, etc.) is key to rapid generalisation acro…