11 citations · 18 across the 3 of their papers we have counts for
7 papers
Recoverability Landscape of Tree Structured Markov Random Fields under Symmetric Noise
Ashish Katiyar, Soumya Basu, Vatsal Shah +1
We study the problem of learning tree-structured Markov random fields (MRF) on discrete random variables with common support when the observations are corrupted by a -ary symmet…
On Generalization of Adaptive Methods for Over-parameterized Linear Regression
Vatsal Shah, Soumya Basu, Anastasios Kyrillidis +1
Over-parameterization and adaptive methods have played a crucial role in the success of deep learning in the last decade. The widespread use of over-parameterization has forced us…
Robust Estimation of Tree Structured Ising Models
Ashish Katiyar, Vatsal Shah, Constantine Caramanis
We consider the task of learning Ising models when the signs of different random variables are flipped independently with possibly unequal, unknown probabilities. In this paper, we…
Choosing the Sample with Lowest Loss makes SGD Robust
Vatsal Shah, Xiaoxia Wu, Sujay Sanghavi
The presence of outliers can potentially significantly skew the parameters of machine learning models trained via stochastic gradient descent (SGD). In this paper we propose a simp…
Negative sampling in semi-supervised learning
John Chen, Vatsal Shah, Anastasios Kyrillidis
We introduce Negative Sampling in Semi-Supervised Learning (NS3L), a simple, fast, easy to tune algorithm for semi-supervised learning (SSL). NS3L is motivated by the success of ne…
Minimum weight norm models do not always generalize well for over-parameterized problems
Vatsal Shah, Anastasios Kyrillidis, Sujay Sanghavi
This work is substituted by the paper in arXiv:2011.14066. Stochastic gradient descent is the de facto algorithm for training deep neural networks (DNNs). Despite its popularity, i…