120 citations · 142 across the 4 of their papers we have counts for
4 papers
Attention Sorting Combats Recency Bias In Long Context Language Models
Alexander Peysakhovich, Adam Lerer
Current language models often fail to incorporate long contexts efficiently during generation. We show that a major contributor to this issue are attention priors that are likely l…
Observational Causal Inference in Novel Diseases: A Case Study of COVID-19
Alexander Peysakhovich, Yin Aphinyanaphongs
A key issue for all observational causal inference is that it relies on an unverifiable assumption - that observed characteristics are sufficient to proxy for treatment confounding…
Multi-Agent Cooperation and the Emergence of (Natural) Language
Angeliki Lazaridou, Alexander Peysakhovich, Marco Baroni
The current mainstream approach to train natural language systems is to expose them to large amounts of text. This passive learning is problematic if we are interested in developin…
Combining observational and experimental data to find heterogeneous treatment effects
Alexander Peysakhovich, Akos Lada
Every design choice will have different effects on different units. However traditional A/B tests are often underpowered to identify these heterogeneous effects. This is especially…