9 papers
Integrating Simulation and Chain-of-thought Reasoning in Multimodal-Language Models For Physical Reasoning
YingQiao Wang, Eric Bigelow, Tomer Ullman +2
Multimodal language models often need to reason about the physical dynamics of the world in order to answer questions appropriately. Various methods have emerged for solving physic…
Continuous Memory Machines
Ciaran Regan, Kai Arulkumaran, Luke Darlow +3
Recurrent neural networks typically compress information into a single vector-valued recurrent state, forcing short-term computation and long-term retention to share the same repre…
Temporal Recurrence Favors Fewer Layers
Ivan Anokhin, Johan Obando-Ceron, Irina Rish +1
In streaming tasks, recurrent models can carry latent computation across time, allowing each update to build on representations produced earlier. This raises a basic question: once…
Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networks
Yutaro Yamada, Luca Grillotti, Rujikorn Charakorn +3
Biological neural circuits obey Dale's principle: each neuron's synapses are uniformly excitatory or inhibitory. Artificial networks that respect this constraint must coordinate se…
In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models
Sam Earle, Kai Arulkumaran, Andrew Dai +3
We are in the midst of large-scale industrial and academic efforts to automate the processes of scientific, technological and creative production through AI-driven assistants. Hist…
Vector Policy Optimization: Training for Diversity Improves Test-Time Search
Ryan Bahlous-Boldi, Isha Puri, Idan Shenfeld +6
Language models must now generalize out of the box to novel environments and work inside inference-scaling search procedures, such as AlphaEvolve, that select rollouts with a varie…
Simple Baselines are Competitive with Code Evolution
Yonatan Gideoni, Sebastian Risi, Yarin Gal
Code evolution is a family of techniques that rely on large language models to search through possible computer programs by evolving existing code. While code evolution pipelines h…
Digital Red Queen: Adversarial Program Evolution in Core War with LLMs
Akarsh Kumar, Ryan Bahlous-Boldi, Prafull Sharma +4
Large language models (LLMs) are increasingly being used to evolve solutions to problems in many domains, in a process inspired by biological evolution. However, unlike biological…
Continuous Thought Machines
Luke Darlow, Ciaran Regan, Sebastian Risi +2
Biological brains demonstrate complex neural activity, where neural dynamics are critical to how brains process information. Most artificial neural networks ignore the complexity o…