activity
20142023
most citedByzantine-Robust Distributed Learning: Towards Optimal Statistical Rates

610 citations · 1.2k across the 24 of their papers we have counts for

collaborators

25 papers

cs.LG2023★ 2 cited

Sample Efficient Deep Reinforcement Learning via Local Planning

Dong Yin, Sridhar Thiagarajan, Nevena Lazic +3

The focus of this work is sample-efficient deep reinforcement learning (RL) with a simulator. One useful property of simulators is that it is typically easy to reset the environmen…

cs.LG2022★ 25 cited

Architecture Matters in Continual Learning

Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin +4

A large body of research in continual learning is devoted to overcoming the catastrophic forgetting of neural networks by designing new algorithms that are robust to the distributi…

cs.LG2021★ 4 cited

Wide Neural Networks Forget Less Catastrophically

Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin +4

A primary focus area in continual learning research is alleviating the "catastrophic forgetting" problem in neural networks by designing new algorithms that are more robust to the…

cs.CR2021★ 1 cited

Morse-STF: Improved Protocols for Privacy-Preserving Machine Learning

Qizhi Zhang, Sijun Tan, Lichun Li +3

Secure multi-party computation enables multiple mutually distrusting parties to perform computations on data without revealing the data itself, and has become one of the core techn…

cs.LG2021★ 2 cited

Efficient Local Planning with Linear Function Approximation

Dong Yin, Botao Hao, Yasin Abbasi-Yadkori +2

We study query and computationally efficient planning algorithms with linear function approximation and a simulator. We assume that the agent only has local access to the simulator…

cs.LG2021★ 1 cited

An Instance-Dependent Simulation Framework for Learning with Label Noise

Keren Gu, Xander Masotto, Vandana Bachani +3

We propose a simulation framework for generating instance-dependent noisy labels via a pseudo-labeling paradigm. We show that the distribution of the synthetic noisy labels generat…

cs.LG2021★ 2 cited

Improved Regret Bound and Experience Replay in Regularized Policy Iteration

Nevena Lazic, Dong Yin, Yasin Abbasi-Yadkori +1

In this work, we study algorithms for learning in infinite-horizon undiscounted Markov decision processes (MDPs) with function approximation. We first show that the regret analysis…

cs.LG2020★ 18 cited

The Effectiveness of Memory Replay in Large Scale Continual Learning

Yogesh Balaji, Mehrdad Farajtabar, Dong Yin +2

We study continual learning in the large scale setting where tasks in the input sequence are not limited to classification, and the outputs can be of high dimension. Among multiple…

cs.LG2020

A maximum-entropy approach to off-policy evaluation in average-reward MDPs

Nevena Lazic, Dong Yin, Mehrdad Farajtabar +4

This work focuses on off-policy evaluation (OPE) with function approximation in infinite-horizon undiscounted Markov decision processes (MDPs). For MDPs that are ergodic and linear…

cs.LG2020★ 14 cited

Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint

Dong Yin, Mehrdad Farajtabar, Ang Li +2

Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performanc…

stat.ML2020

An Efficient Framework for Clustered Federated Learning

Avishek Ghosh, Jichan Chung, Dong Yin +1

We address the problem of federated learning (FL) where users are distributed and partitioned into clusters. This setup captures settings where different groups of users have their…

cs.LG2019★ 10 cited

Stochastic Gradient and Langevin Processes

Xiang Cheng, Dong Yin, Peter L. Bartlett +1

We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the…

cs.LG2019★ 93 cited

Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentation

Raphael Gontijo Lopes, Dong Yin, Ben Poole +2

Deploying machine learning systems in the real world requires both high accuracy on clean data and robustness to naturally occurring corruptions. While architectural advances have…

cs.LG2019★ 84 cited

A Fourier Perspective on Model Robustness in Computer Vision

Dong Yin, Raphael Gontijo Lopes, Jonathon Shlens +2

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, howe…

cs.LG2019★ 147 cited

Robust Federated Learning in a Heterogeneous Environment

Avishek Ghosh, Justin Hong, Dong Yin +1

We study a recently proposed large-scale distributed learning paradigm, namely Federated Learning, where the worker machines are end users' own devices. Statistical and computation…

cs.LG2018★ 116 cited

Rademacher Complexity for Adversarially Robust Generalization

Dong Yin, Kannan Ramchandran, Peter Bartlett

Many machine learning models are vulnerable to adversarial attacks; for example, adding adversarial perturbations that are imperceptible to humans can often make machine learning m…

cs.LG2018★ 8 cited

Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning

Dong Yin, Yudong Chen, Kannan Ramchandran +1

We study robust distributed learning that involves minimizing a non-convex loss function with saddle points. We consider the Byzantine setting where some worker machines have abnor…

cs.LG2018★ 610 cited

Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates

Dong Yin, Yudong Chen, Kannan Ramchandran +1

In large-scale distributed learning, security issues have become increasingly important. Particularly in a decentralized environment, some computing units may behave abnormally, or…

cs.LG2018

Online Learning for Non-Stationary A/B Tests

Andrés Muñoz Medina, Sergei Vassilvitskii, Dong Yin

The rollout of new versions of a feature in modern applications is a manual multi-stage process, as the feature is released to ever larger groups of users, while its performance is…

cs.LG2017★ 20 cited

Gradient Diversity: a Key Ingredient for Scalable Distributed Learning

Dong Yin, Ashwin Pananjady, Max Lam +3

It has been experimentally observed that distributed implementations of mini-batch stochastic gradient descent (SGD) algorithms exhibit speedup saturation and decaying generalizati…

cs.IT2017

Learning Mixtures of Sparse Linear Regressions Using Sparse Graph Codes

Dong Yin, Ramtin Pedarsani, Yudong Chen +1

In this paper, we consider the mixture of sparse linear regressions model. Let be unknown sparse parameter vectors with a total of $ K…

cs.IT2016★ 4 cited

Fast and Robust Compressive Phase Retrieval with Sparse-Graph Codes

Dong Yin, Kangwook Lee, Ramtin Pedarsani +1

In this paper, we tackle the compressive phase retrieval problem in the presence of noise. The noisy compressive phase retrieval problem is to recover a -sparse complex signal $…

cs.IT2016★ 6 cited

Distributed Sequence Memory of Multidimensional Inputs in Recurrent Networks

Adam Charles, Dong Yin, Christopher Rozell

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tas…

cs.CV2015

Sliding-Window Optimization on an Ambiguity-Clearness Graph for Multi-object Tracking

Qi Guo, Le Dan, Dong Yin +1

Multi-object tracking remains challenging due to frequent occurrence of occlusions and outliers. In order to handle this problem, we propose an Approximation-Shrink Scheme for sequ…