233 citations · 581 across the 28 of their papers we have counts for
3 papers · 1 filter
Attention Sorting Combats Recency Bias In Long Context Language Models
Alexander Peysakhovich, Adam Lerer
Current language models often fail to incorporate long contexts efficiently during generation. We show that a major contributor to this issue are attention priors that are likely l…
Diagnosis Uncertain Models For Medical Risk Prediction
Alexander Peysakhovich, Rich Caruana, Yin Aphinyanaphongs
We consider a patient risk models which has access to patient features such as vital signs, lab values, and prior history but does not have access to a patient's diagnosis. For exa…
Observational Causal Inference in Novel Diseases: A Case Study of COVID-19
Alexander Peysakhovich, Yin Aphinyanaphongs
A key issue for all observational causal inference is that it relies on an unverifiable assumption - that observed characteristics are sufficient to proxy for treatment confounding…