4 papers
SGD in Multiclass Logistic Regression: Sequential Learning and Scaling Laws
Konstantinos Christopher Tsiolis, Denny Wu, Christos Thrampoulidis +1
We study the training dynamics of multiclass logistic regression on high-dimensional Gaussian mixture models with a large number of classes and establish precise scaling laws gover…
High-Dimensional Statistics: Reflections on Progress and Open Problems
Arian Maleki, Subhabrata Sen, Sivaraman Balakrishnan +9
Over the past two decades, the field of high-dimensional statistics has experienced substantial progress, driven largely by technological advances that have dramatically reduced th…
Analytic Study of Double Descent in Binary Classification: The Impact of Loss
Ganesh Kini, Christos Thrampoulidis
Extensive empirical evidence reveals that, for a wide range of different learning methods and datasets, the risk curve exhibits a double-descent (DD) trend as a function of the mod…
A Model of Double Descent for High-dimensional Binary Linear Classification
Zeyu Deng, Abla Kammoun, Christos Thrampoulidis
We consider a model for logistic regression where only a subset of features of size is used for training a linear classifier over training samples. The classifier is obtain…