4 papers
When does Gaussian equivalence fail and how to fix it: Non-universal behavior of random features with quadratic scaling
Garrett G. Wen, Hong Hu, Yue M. Lu +2
A major effort in modern high-dimensional statistics has been devoted to the analysis of linear predictors trained on nonlinear feature embeddings via empirical risk minimization (…
ASearch: Ambiguity-Aware Question Answering with Reinforcement Learning
Fengji Zhang, Xinyao Niu, Chengyang Ying +7
Recent advances in Large Language Models (LLMs) and Reinforcement Learning (RL) have led to strong performance in open-domain question answering (QA). However, existing models stil…
Dynamical mean-field analysis of adaptive Langevin diffusions: Replica-symmetric fixed point and empirical Bayes
Zhou Fan, Justin Ko, Bruno Loureiro +2
In many applications of statistical estimation via sampling, one may wish to sample from a high-dimensional target distribution that is adaptively evolving to the samples already s…
Dynamical mean-field analysis of adaptive Langevin diffusions: Propagation-of-chaos and convergence of the linear response
Zhou Fan, Justin Ko, Bruno Loureiro +2
Motivated by an application to empirical Bayes learning in high-dimensional regression, we study a class of Langevin diffusions in a system with random disorder, where the drift co…