Publications (16)
I can see your halo: Constraining the Milky Way halo DM with FRB population studies
Jordan Hoffmann, Clancy James, Jason Xavier Prochaska +1
Fast radio bursts (FRBs) probe the electron column density along the line of sight and hence can be used to probe foreground structures. One such structure is the Galactic halo. In…
Improving language models by retrieving from trillions of tokens
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann +25
We enhance auto-regressive language models by conditioning on document chunks retrieved from a large corpus, based on local similarity with preceding tokens. With a trillion to…
Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Jack W. Rae, Sebastian Borgeaud, Trevor Cai +77
Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.…
vGraph: A Generative Model for Joint Community Detection and Node Representation Learning
Fan-Yun Sun, Meng Qu, Jordan Hoffmann +2
This paper focuses on two fundamental tasks of graph analysis: community detection and node representation learning, which capture the global and local structures of graphs, respec…
Recurrent Independent Mechanisms
Anirudh Goyal, Alex Lamb, Jordan Hoffmann +4
Learning modular structures which reflect the dynamics of the environment can lead to better generalization and robustness to changes which only affect a few of the underlying caus…
A fast radio burst from the first 3 billion years of the Universe
Manisha Caleb, Themiya Nanayakkara, Benjamin Stappers +25
Fast radio bursts (FRBs) are enigmatic millisecond-duration signals which encode otherwise unattainable information on the plasma which permeates our Universe, providing insights i…