380 citations · 705 across the 18 of their papers we have counts for
22 papers
Meta-in-context learning in large language models
Julian Coda-Forno, Marcel Binz, Zeynep Akata +3
Large language models have shown tremendous performance in a variety of tasks. In-context learning -- the ability to improve at a task after being provided with a number of demonst…
Passive learning of active causal strategies in agents and language models
Andrew Kyle Lampinen, Stephanie C Y Chan, Ishita Dasgupta +2
What can be learned about causality and experimentation from passive data? This question is salient given recent successes of passively-trained language models in interactive domai…
DiscoGen: Learning to Discover Gene Regulatory Networks
Nan Rosemary Ke, Sara-Jane Dunn, Jorg Bornschein +11
Accurately inferring Gene Regulatory Networks (GRNs) is a critical and challenging task in biology. GRNs model the activatory and inhibitory interactions between genes and are inhe…
Beyond Bayes-optimality: meta-learning what you know you don't know
Jordi Grau-Moya, Grégoire Delétang, Markus Kunesch +11
Meta-training agents with memory has been shown to culminate in Bayes-optimal agents, which casts Bayes-optimality as the implicit solution to a numerical optimization problem rath…
Data Distributional Properties Drive Emergent In-Context Learning in Transformers
Stephanie C. Y. Chan, Adam Santoro, Andrew K. Lampinen +5
Large transformer-based models are able to perform in-context few-shot learning, without being explicitly trained for it. This observation raises the question: what aspects of the…
Semantic Exploration from Language Abstractions and Pretrained Representations
Allison C. Tam, Neil C. Rabinowitz, Andrew K. Lampinen +6
Effective exploration is a challenge in reinforcement learning (RL). Novelty-based exploration methods can suffer in high-dimensional state spaces, such as continuous partially-obs…