4 papers · 1 filter
Understanding Parallel Samplers in Masked Diffusion via Random Walks on Graphs
Vansh Bansal, Cho Cholyeon, Syamantak Kumar +2
In this paper, we propose using random walks on graphs as a verifiable sandbox to study different parallel sampling strategies in masked diffusion models (MDMs). We train an MDM on…
On the Curse of Dimensionality in Private Sparse Covariance Estimation and PCA
Syamantak Kumar, Shourya Pandey, Purnamrita Sarkar +1
We study high-dimensional differentially private (DP) covariance estimation in the operator norm, and principal component analysis (PCA), under -row-column sparsity (-RCS) of…
Low-Precision Streaming PCA
Sanjoy Dasgupta, Syamantak Kumar, Shourya Pandey +1
Low-precision streaming PCA estimates the top principal component in a streaming setting under limited precision. We establish an information-theoretic lower bound on the quantizat…
Dimension-free Score Matching and Time Bootstrapping for Diffusion Models
Syamantak Kumar, Dheeraj Nagaraj, Purnamrita Sarkar
Diffusion models generate samples by estimating the score function of the target distribution at various noise levels. The model is trained using samples drawn from the target dist…