Publications (15)
EpMAN: Episodic Memory AttentioN for Generalizing to Longer Contexts
Subhajit Chaudhury, Payel Das, Sarathkrishna Swaminathan +6
Recent advances in Large Language Models (LLMs) have yielded impressive successes on many language tasks. However, efficient processing of long contexts using LLMs remains a signif…
Cosmological bounds on TeV-scale physics and beyond
Niayesh Afshordi, Elliot Nelson
We study the influence of the fluctuations of a Lorentz invariant and conserved vacuum on cosmological metric perturbations, and show that they generically blow up in the IR. We co…
Larimar: Large Language Models with Episodic Memory Control
Payel Das, Subhajit Chaudhury, Elliot Nelson +10
Efficient and accurate updating of knowledge stored in Large Language Models (LLMs) is one of the most pressing research challenges today. This paper presents Larimar - a novel, br…
Quantum Decoherence During Inflation from Gravitational Nonlinearities
Elliot Nelson
We study the inflationary quantum-to-classical transition for the adiabatic curvature perturbation due to quantum decoherence, focusing on the role played by squeezed-limit mo…
Non-local bispectra from super cosmic variance
Bekir BaytaÅ, Aruna Kesavan, Elliot Nelson +2
We present examples of non-Gaussian statistics that can induce bispectra matching local and non-local (including equilateral) templates in biased sub-volumes. We find cases where t…
Needle in the Haystack for Memory Based Large Language Models
Elliot Nelson, Georgios Kollias, Payel Das +2
Current large language models (LLMs) often perform poorly on simple fact retrieval tasks. Here we investigate if coupling a dynamically adaptable external memory to a LLM can allev…
Non-Gaussian Mode Coupling and the Statistical Cosmological Principle
Marilena LoVerde, Elliot Nelson, Sarah Shandera
Local-type primordial non-Gaussianity couples statistics of the curvature perturbation ζon vastly different physical scales. Because of this coupling, statistics (i.e. the polyspe…
Fossilized Gravitational Wave Relic and Primordial Clocks
Suddhasattwa Brahma, Elliot Nelson, Sarah Shandera
If long wavelength primordial tensor modes are coupled to short wavelength scalar modes, the scalar curvature two-point function will have an off-diagonal component. This `fossil'…
Q-function Decomposition with Intervention Semantics with Factored Action Spaces
Junkyu Lee, Tian Gao, Elliot Nelson +3
Many practical reinforcement learning environments have a discrete factored action space that induces a large combinatorial set of actions, thereby posing significant challenges. E…
Classical Entanglement Structure in the Wavefunction of Inflationary Fluctuations
Elliot Nelson, C. Jess Riedel
We argue that the preferred classical variables that emerge from a pure quantum state are determined by its entanglement structure in the form of redundant records: information sha…
Classical branches and entanglement structure in the wavefunction of cosmological fluctuations
Elliot Nelson, C. Jess Riedel
The emergence of preferred classical variables within a many-body wavefunction is encoded in its entanglement structure in the form of redundant classical information shared betwee…
Cosmic Variance of the Spectral Index from Mode Coupling
Joseph Bramante, Jason Kumar, Elliot Nelson +1
We demonstrate that local, scale-dependent non-Gaussianity can generate cosmic variance uncertainty in the observed spectral index of primordial curvature perturbations. In a unive…
Statistical Naturalness and non-Gaussianity in a Finite Universe
Elliot Nelson, Sarah Shandera
We study the behavior of n-point functions of the primordial curvature perturbations, assuming our observed Universe is only a subset of a larger space with statistically homogeneo…
Pulsar Timing Constraints on Physics Beyond the Standard Model
Niayesh Afshordi, Hyungjin Kim, Elliot Nelson
We argue that massive quantum fields source low-frequency long-wavelength metric fluctuations through the quantum fluctuations of their stress-energy, given reasonable assumptions…
Higher time derivatives in effective equations of canonical quantum systems
Martin Bojowald, Suddhasattwa Brahma, Elliot Nelson
Quantum-corrected equations of motion generically contain higher time derivatives, computed here in the setting of canonically quantized systems. The main example in which detailed…