9 citations · 15 across the 11 of their papers we have counts for
5 papers · 1 filter
How to quantify the coherence of a set of beliefs
Rowan Hess, Lionel Levine
Given conflicting probability estimates for a set of events, how can we quantify how much they conflict? How can we find a single probability distribution that best encapsulates th…
Locally Markov walks on finite graphs
Robin Kaiser, Lionel Levine, Ecaterina Sava-Huss
Locally Markov walks are natural generalizations of classical Markov chains, where instead of a particle moving independently of the past, it decides where to move next depending o…
FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
Elliot Glazer, Ege Erdil, Tamay Besiroglu +21
We introduce FrontierMath, a benchmark of hundreds of original, exceptionally challenging mathematics problems crafted and vetted by expert mathematicians. The questions cover most…
Exploring Cross-model Neuronal Correlations in the Context of Predicting Model Performance and Generalizability
Haniyeh Ehsani Oskouie, Sajjad Ghiasvand, Lionel Levine +1
As Artificial Intelligence (AI) models are increasingly integrated into critical systems, the need for a robust framework to establish the trustworthiness of AI is increasingly par…
Do language models plan ahead for future tokens?
Wilson Wu, John X. Morris, Lionel Levine
Do transformers "think ahead" during inference at a given position? It is known transformers prepare information in the hidden states of the forward pass at time step that is t…