activity
20182026
most citedRelating transformers to models and neural representations of the hippocampal formation

59 citations · 134 across the 9 of their papers we have counts for

collaborators

9 papers

cs.AI2026

DiG-bench: Discovery in Games

Ruairidh M. Battleday, Kai Sandbrink, Jimi Cullen-Drohan +13

Discovery---formulating novel generalizations---is a central part of the scientific process. Despite its importance, there is a gap in the current AI benchmark landscape, with few…

q-bio.NC2026★ 2 cited

How much neuroscience does a neuroscientist need to know?

James C. R. Whittington, William Dorrell

How much of the brain's learned algorithms depend on the fact it is a brain? We argue: a lot, but surprisingly few details matter. We point to simple biological details -- e.g. non…

cs.LG2023★ 1 cited

Disentanglement via Latent Quantization

Kyle Hsu, Will Dorrell, James C. R. Whittington +2

In disentangled representation learning, a model is asked to tease apart a dataset's underlying sources of variation and represent them independently of one another. Since the mode…

q-bio.NC2022★ 13 cited

Disentanglement with Biological Constraints: A Theory of Functional Cell Types

James C. R. Whittington, Will Dorrell, Surya Ganguli +1

Neurons in the brain are often finely tuned for specific task variables. Moreover, such disentangled representations are highly sought after in machine learning. Here we mathematic…

q-bio.NC2022★ 17 cited

Actionable Neural Representations: Grid Cells from Minimal Constraints

William Dorrell, Peter E. Latham, Timothy E. J. Behrens +1

To afford flexible behaviour, the brain must build internal representations that mirror the structure of variables in the external world. For example, 2D space obeys rules: the sam…

q-bio.NC2022★ 19 cited

How to build a cognitive map: insights from models of the hippocampal formation

James C. R. Whittington, David McCaffary, Jacob J. W. Bakermans +1

Learning and interpreting the structure of the environment is an innate feature of biological systems, and is integral to guiding flexible behaviours for evolutionary viability. Th…

cs.NE2021★ 59 cited

Relating transformers to models and neural representations of the hippocampal formation

James C. R. Whittington, Joseph Warren, Timothy E. J. Behrens

Many deep neural network architectures loosely based on brain networks have recently been shown to replicate neural firing patterns observed in the brain. One of the most exciting…

cs.LG2021

Constellation: Learning relational abstractions over objects for compositional imagination

James C. R. Whittington, Rishabh Kabra, Loic Matthey +2

Learning structured representations of visual scenes is currently a major bottleneck to bridging perception with reasoning. While there has been exciting progress with slot-based m…

cs.AI2018★ 23 cited

Generalisation of structural knowledge in the hippocampal-entorhinal system

James C. R. Whittington, Timothy H. Muller, Shirley Mark +2

A central problem to understanding intelligence is the concept of generalisation. This allows previously learnt structure to be exploited to solve tasks in novel situations differi…