4 papers
The Phase Transition in Online PCA Depends on , not
Apratim Dey
High dimensional statistical theory has established the importance of constant aspect ratio, when the number of dimensions () and samples () satisfy with $n/d\…
Optimal Vector Compressed Sensing Using James Stein Shrinkage
Apratim Dey, David Donoho
The trend in modern science and technology is to take vector measurements rather than scalars, ruthlessly scaling to ever higher dimensional vectors. For about two decades now, tra…
Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating World
Joshua Kazdan, Rylan Schaeffer, Apratim Dey +4
What happens when generative machine learning models are pretrained on web-scale datasets containing data generated by earlier models? Some prior work warns of "model collapse" as…
Universality of the Pathway in Avoiding Model Collapse
Apratim Dey, David Donoho
Researchers in empirical machine learning recently spotlighted their fears of so-called Model Collapse. They imagined a discard workflow, where an initial generative model is train…