activity
20202026
most citedInfoNCE Loss Provably Learns Cluster-Preserving Representations

9 citations · 20 across the 10 of their papers we have counts for

collaborators

11 papers

cs.LG2026

Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability

Matias G. Delgadino, Sebastien Motsch, Advait Parulekar +2

Diffusion-based posterior samplers draw from measurement- or reward-conditioned posteriors using pretrained diffusion priors. Though widely used for inverse problems, their output…

cs.LG2025

Efficient Approximate Posterior Sampling with Annealed Langevin Monte Carlo

Advait Parulekar, Litu Rout, Karthikeyan Shanmugam +1

We study the problem of posterior sampling in the context of score based generative models. We have a trained score network for a prior , a measurement model , and ar…

cs.LG2024

In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness

Liam Collins, Advait Parulekar, Aryan Mokhtari +2

A striking property of transformers is their ability to perform in-context learning (ICL), a machine learning framework in which the learner is presented with a novel context durin…

cs.LG2023★ 9 cited

InfoNCE Loss Provably Learns Cluster-Preserving Representations

Advait Parulekar, Liam Collins, Karthikeyan Shanmugam +2

The goal of contrasting learning is to learn a representation that preserves underlying clusters by keeping samples with similar content, e.g. the ``dogness'' of a dog, close to ea…

stat.ML2023★ 4 cited

A Theoretical Justification for Image Inpainting using Denoising Diffusion Probabilistic Models

Litu Rout, Advait Parulekar, Constantine Caramanis +1

We provide a theoretical justification for sample recovery using diffusion based image inpainting in a linear model setting. While most inpainting algorithms require retraining wit…

cs.LG2022

PAC Generalization via Invariant Representations

Advait Parulekar, Karthikeyan Shanmugam, Sanjay Shakkottai

One method for obtaining generalizable solutions to machine learning tasks when presented with diverse training environments is to find \textit{invariant representations} of the da…

cs.LG2021★ 1 cited

Improved Algorithms for Misspecified Linear Markov Decision Processes

Daniel Vial, Advait Parulekar, Sanjay Shakkottai +1

For the misspecified linear Markov decision process (MLMDP) model of Jin et al. [2020], we propose an algorithm with three desirable properties. (P1) Its regret after episodes…

cs.LG2021

L1 Regression with Lewis Weights Subsampling

Aditya Parulekar, Advait Parulekar, Eric Price

We consider the problem of finding an approximate solution to regression while only observing a small number of labels. Given an unlabeled data matrix , we…

cs.LG2021★ 4 cited

Regret Bounds for Stochastic Shortest Path Problems with Linear Function Approximation

Daniel Vial, Advait Parulekar, Sanjay Shakkottai +1

We propose an algorithm that uses linear function approximation (LFA) for stochastic shortest path (SSP). Under minimal assumptions, it obtains sublinear regret, is computationally…

cs.LG2020★ 1 cited

Stochastic Linear Bandits with Protected Subspace

Advait Parulekar, Soumya Basu, Aditya Gopalan +2

We study a variant of the stochastic linear bandit problem wherein we optimize a linear objective function but rewards are accrued only orthogonal to an unknown subspace (which we…

math.SP2020★ 1 cited

Locating conical degeneracies in the spectra of parametric self-adjoint matrices

Gregory Berkolaiko, Advait Parulekar

A simple iterative scheme is proposed for locating the parameter values for which a 2-parameter family of real symmetric matrices has a double eigenvalue. The convergence is proved…